Sep 15 16:10:44 devstack cinder-volume[75061]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 15 16:10:44 devstack cinder-volume[75061]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 15 16:10:44 devstack cinder-volume[75061]: we strongly recommend against using it for new projects. Sep 15 16:10:44 devstack cinder-volume[75061]: If you are already using Eventlet, we recommend migrating to a different Sep 15 16:10:44 devstack cinder-volume[75061]: framework. For more detail see Sep 15 16:10:44 devstack cinder-volume[75061]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 15 16:10:44 devstack cinder-volume[75061]: import eventlet # noqa Sep 15 16:10:48 devstack cinder-volume[75061]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75061) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 15 16:10:48 devstack cinder-volume[75061]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75061) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 15 16:10:48 devstack cinder-volume[75061]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75061) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 15 16:10:48 devstack cinder-volume[75061]: INFO dbcounter [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] Registered counter for database cinder Sep 15 16:10:49 devstack cinder-volume[75061]: DEBUG oslo_db.sqlalchemy.engines [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75061) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 15 16:10:49 devstack cinder-volume[75061]: DEBUG dbcounter [-] [75061] Writer thread running {{(pid=75061) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 15 16:10:49 devstack cinder-volume[75061]: INFO cinder.rpc [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 15 16:10:49 devstack cinder-volume[75061]: INFO cinder.rpc [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 15 16:10:49 devstack cinder-volume[75061]: DEBUG oslo_db.sqlalchemy.engines [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75061) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 15 16:10:49 devstack cinder-volume[75061]: INFO cinder.volume.manager [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] Determined volume DB was empty at startup. Sep 15 16:10:49 devstack cinder-volume[75061]: DEBUG cinder.volume.manager [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75061) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 15 16:10:49 devstack cinder-volume[75061]: INFO cinder.volume.manager [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 15 16:10:49 devstack cinder-volume[75061]: WARNING stevedore.named [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 15 16:10:49 devstack cinder-volume[75061]: WARNING castellan.key_manager [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 15 16:10:49 devstack cinder-volume[75061]: WARNING cinder.keymgr.conf_key_mgr [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 15 16:10:49 devstack cinder-volume[75061]: DEBUG cinder.volume.drivers.lvm [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75061) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 15 16:10:49 devstack cinder-volume[75061]: DEBUG oslo_concurrency.processutils [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_concurrency.processutils [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] CMD "cinder-rtstool verify" returned: 0 in 0.447s {{(pid=75061) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_db.sqlalchemy.engines [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75061) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 15 16:10:50 devstack cinder-volume[75061]: INFO cinder.rpc [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 15 16:10:50 devstack cinder-volume[75061]: INFO cinder.rpc [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 15 16:10:50 devstack cinder-volume[75061]: WARNING stevedore.named [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 15 16:10:50 devstack cinder-volume[75061]: WARNING castellan.key_manager [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 15 16:10:50 devstack cinder-volume[75061]: INFO cinder.volume.manager [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_db.sqlalchemy.engines [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75061) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 15 16:10:50 devstack cinder-volume[75061]: INFO oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] Starting 1 workers Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] Started child 75218 {{(pid=75061) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] Full set of CONF: {{(pid=75061) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] ******************************************************************************** {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] Configuration options gathered from: {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] ================================================================================ {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] allow_availability_zone_fallback = False {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75218]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] allow_compression_on_image_upload = False {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] allowed_direct_url_schemes = [] {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] api_rate_limit = True {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] auth_strategy = keystone {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] az_cache_duration = 3600 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] backend_availability_zone = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] backend_host = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] backend_name = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] backend_stats_polling_interval = 60 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] backup_api_class = cinder.backup.api.API {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] backup_name_template = backup-%s {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] backup_use_same_host = False {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] backup_use_temp_snapshot = False {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] chap_password = **** {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] chap_username = {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] cinder_internal_tenant_project_id = bab006bd62bd4f3d8fe504a9633e7966 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] cinder_internal_tenant_user_id = 1b3ee3422beb43a49b7426d0c23aa86b {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] cloned_volume_same_az = True {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] cluster = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] compression_format = gzip {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] compute_api_class = cinder.compute.nova.API {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] config_dir = [] {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] config_source = [] {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] control_exchange = openstack {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] debug = True {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] default_availability_zone = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] default_group_type = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] default_volume_type = lvmdriver-1 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] disk_geometry = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] driver_client_cert = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] driver_client_cert_key = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] driver_data_namespace = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] driver_ssl_cert_path = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] driver_ssl_cert_verify = False {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] driver_use_ssl = False {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] enable_force_upload = False {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] enable_new_services = True {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] enable_unsupported_driver = False {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] enabled_backends = ['lvmdriver-1'] {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] enforce_multipath_for_image_xfer = False {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] filter_function = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] glance_api_insecure = False {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] glance_api_servers = ['http://192.168.122.195/image'] {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] glance_api_ssl_compression = False {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] glance_ca_certificates_file = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] glance_catalog_info = image:glance:publicURL {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] glance_certfile = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] glance_keyfile = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] glance_num_retries = 3 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] glance_request_timeout = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] goodness_function = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] graceful_shutdown_timeout = 5 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] group_api_class = cinder.group.api.API {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] host = devstack {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] image_compress_on_upload = True {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] image_conversion_address_space_limit = 1 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] image_conversion_cpu_limit = 60 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] image_conversion_disable = False {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] image_introspection_address_space_limit = 1 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] image_introspection_cpu_limit = 60 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] image_upload_use_cinder_backend = False {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] image_upload_use_internal_tenant = False {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] image_volume_cache_enabled = False {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] image_volume_cache_max_count = 0 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] image_volume_cache_max_size_gb = 0 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] init_host_max_objects_retrieval = 0 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] instance_format = [instance: %(uuid)s] {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] iscsi_target_flags = {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] iscsi_write_cache = on {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75218]: INFO cinder.volume.manager [None req-0f7efa49-cbd8-4cc2-b312-6197c59564ba None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 15 16:10:50 devstack cinder-volume[75218]: DEBUG oslo_concurrency.processutils [None req-0f7efa49-cbd8-4cc2-b312-6197c59564ba None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] iser_helper = tgtadm {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] iser_ip_address = 192.168.122.195 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] iser_port = 3260 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] log_color = False {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] log_config_append = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] log_dir = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] log_file = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] log_options = True {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] log_rotate_interval = 1 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] log_rotate_interval_type = days {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] log_rotation_type = none {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] max_age = 0 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] max_logfile_count = 30 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] max_logfile_size_mb = 200 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] max_over_subscription_ratio = 20.0 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] message_reap_interval = 86400 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] message_ttl = 2592000 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] migration_create_volume_timeout_secs = 300 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] monkey_patch = False {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] monkey_patch_modules = [] {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] my_ip = 192.168.122.195 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] no_snapshot_gb_quota = False {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] num_iser_scan_tries = 3 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] num_shell_tries = 3 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] num_volume_device_scan_tries = 3 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] nvmeof_conn_info_version = 1 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] nvmet_ns_id = 10 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] nvmet_port_id = 1 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] osapi_max_limit = 1000 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75218]: DEBUG oslo_concurrency.processutils [None req-0f7efa49-cbd8-4cc2-b312-6197c59564ba None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.032s {{(pid=75218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:10:50 devstack cinder-volume[75218]: DEBUG oslo_concurrency.processutils [None req-0f7efa49-cbd8-4cc2-b312-6197c59564ba None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] osapi_volume_ext_list = [] {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] osapi_volume_listen = 0.0.0.0 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] osapi_volume_listen_port = 8776 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] osapi_volume_use_ssl = False {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] osapi_volume_workers = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] per_volume_size_limit = -1 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] periodic_fuzzy_delay = 60 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] periodic_interval = 60 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] project_id_regex = [0-9a-f\-]+ {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] public_endpoint = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] publish_errors = False {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] quota_backup_gigabytes = 1000 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] quota_backups = 10 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] quota_gigabytes = 1000 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] quota_groups = 10 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] quota_snapshots = 10 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] quota_volumes = 10 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] rate_limit_burst = 0 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] rate_limit_except_level = CRITICAL {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] rate_limit_interval = 0 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] reinit_driver_count = 3 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] replication_device = **** {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] report_discard_supported = False {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] report_interval = 120 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] reservation_clean_interval = 86400 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] reservation_expire = 86400 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] reserved_image_namespaces = [] {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] reserved_percentage = 0 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] rpc_response_timeout = 120 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] run_external_periodic_tasks = True {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] scst_target_driver = iscsi {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] scst_target_iqn_name = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] service_down_time = 720 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] shell_completion = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] snapshot_name_template = snapshot-%s {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] snapshot_same_host = True {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] split_loggers = False {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75218]: DEBUG oslo_concurrency.processutils [None req-0f7efa49-cbd8-4cc2-b312-6197c59564ba None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.026s {{(pid=75218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] state_path = /opt/stack/data/cinder {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75218]: DEBUG oslo_concurrency.processutils [None req-0f7efa49-cbd8-4cc2-b312-6197c59564ba None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] storage_availability_zone = nova {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] storage_protocol = iSCSI {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] syslog_log_facility = LOG_USER {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] target_helper = lioadm {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] target_ip_address = 192.168.122.195 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] target_port = 3260 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] target_protocol = iscsi {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] target_secondary_ip_addresses = [] {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] trace_flags = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] transfer_api_class = cinder.transfer.api.API {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] transport_url = **** {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] until_refresh = 0 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] use_chap_auth = False {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] use_default_quota_class = True {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] use_journal = False {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] use_json = False {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] use_multipath_for_image_xfer = False {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] use_stderr = False {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] use_syslog = False {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] verify_glance_signatures = enabled {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] volume_api_class = cinder.volume.api.API {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] volume_backend_name = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] volume_clear = zero {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] volume_clear_ionice = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] volume_clear_size = 0 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] volume_copy_bps_limit = 0 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] volume_dd_blocksize = 1M {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75218]: DEBUG oslo_concurrency.processutils [None req-0f7efa49-cbd8-4cc2-b312-6197c59564ba None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=75218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] volume_name_template = volume-%s {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] volume_service_inithost_offload = False {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75218]: DEBUG oslo_concurrency.processutils [None req-0f7efa49-cbd8-4cc2-b312-6197c59564ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] volume_usage_audit_period = month {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] zoning_mode = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] oslo_concurrency.disable_process_locking = False {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] keystone_authtoken.auth_section = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] keystone_authtoken.auth_type = password {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] keystone_authtoken.auth_version = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] keystone_authtoken.cache = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] keystone_authtoken.certfile = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] keystone_authtoken.include_service_catalog = True {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] keystone_authtoken.insecure = False {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] keystone_authtoken.interface = public {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] keystone_authtoken.keyfile = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] keystone_authtoken.memcache_password = **** {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack sudo[75222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 15 16:10:50 devstack sudo[75222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] keystone_authtoken.memcache_username = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] keystone_authtoken.region_name = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] keystone_authtoken.service_token_roles_required = True {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] keystone_authtoken.service_type = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.195/identity {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] cache.backend = dogpile.cache.null {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] cache.backend_argument = **** {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] cache.backend_expiration_time = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] cache.config_prefix = cache.oslo {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] cache.debug_cache_backend = False {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] cache.enable_retry_client = False {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] cache.enable_socket_keepalive = False {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] cache.enabled = False {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] cache.expiration_time = 600 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] cache.hashclient_retry_attempts = 2 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] cache.memcache_dead_retry = 300 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] cache.memcache_pool_maxsize = 10 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] cache.memcache_sasl_enabled = False {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] cache.password = **** {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] cache.proxies = [] {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] cache.redis_db = 0 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] cache.redis_server = localhost:6379 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] cache.retry_attempts = 2 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] cache.retry_delay = 0.0 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] cache.socket_keepalive_count = 1 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] cache.socket_keepalive_idle = 1 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] cache.socket_keepalive_interval = 1 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] cache.socket_timeout = 1.0 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] cache.tls_allowed_ciphers = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] cache.tls_cafile = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] cache.tls_certfile = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] cache.tls_enabled = False {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] cache.tls_keyfile = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] cache.username = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] coordination.backend_url = **** {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] database.asyncio_connection = **** {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] database.asyncio_slave_connection = **** {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] database.backend = sqlalchemy {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] database.connection = **** {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] database.connection_debug = 0 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] database.connection_parameters = {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] database.connection_recycle_time = 3600 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] database.connection_trace = False {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] database.db_inc_retry_interval = True {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] database.db_max_retries = 20 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] database.db_max_retry_interval = 10 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] database.db_retry_interval = 1 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] database.max_overflow = 50 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] database.max_pool_size = 5 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] database.max_retries = 10 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] database.mysql_wsrep_sync_wait = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] database.pool_timeout = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] database.retry_interval = 10 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] database.slave_connection = **** {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] database.sqlite_synchronous = True {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] database.synchronous_reader = True {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] database.use_db_reconnect = False {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] oslo_messaging_tracing.insecure = False {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] profiler.connection_string = messaging:// {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] profiler.enabled = False {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] profiler.es_doc_type = notification {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] profiler.es_scroll_size = 10000 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] profiler.es_scroll_time = 2m {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] profiler.filter_error_trace = False {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] profiler.hmac_keys = **** {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] profiler.sentinel_service_name = mymaster {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] profiler.socket_timeout = 0.1 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] profiler.trace_requests = False {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] profiler.trace_sqlalchemy = False {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] profiler_jaeger.process_tags = {} {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] profiler_jaeger.service_name_prefix = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] profiler_otlp.service_name_prefix = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] oslo_policy.enforce_new_defaults = True {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] oslo_policy.policy_default_rule = default {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] oslo_policy.policy_file = policy.yaml {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] oslo_policy.remote_timeout = 60.0 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] privsep_osbrick.group = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] privsep_osbrick.helper_command = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] privsep_osbrick.user = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] cinder_sys_admin.group = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] cinder_sys_admin.helper_command = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] cinder_sys_admin.user = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] service_user.auth_section = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] service_user.auth_type = password {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] service_user.cafile = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] service_user.certfile = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] service_user.collect_timing = False {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] service_user.insecure = False {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] service_user.keyfile = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] service_user.send_service_user_token = True {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] service_user.split_loggers = False {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] service_user.timeout = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] service_user.tls_ciphers = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] service_user.tls_min_version = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] glance.auth_section = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] glance.auth_type = password {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] glance.certfile = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] glance.collect_timing = False {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] glance.insecure = False {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] glance.keyfile = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] glance.region_name = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] glance.split_loggers = False {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] glance.timeout = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] glance.tls_ciphers = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] glance.tls_min_version = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] backend_defaults.backend_availability_zone = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] backend_defaults.chap_password = **** {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] backend_defaults.chap_username = {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] backend_defaults.disk_geometry = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] backend_defaults.driver_client_cert = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] backend_defaults.driver_client_cert_key = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] backend_defaults.driver_data_namespace = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] backend_defaults.driver_use_ssl = False {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] backend_defaults.extra_capabilities = {} {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] backend_defaults.filter_function = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] backend_defaults.goodness_function = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] backend_defaults.iscsi_target_flags = {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] backend_defaults.iscsi_write_cache = on {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] backend_defaults.iser_helper = tgtadm {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] backend_defaults.iser_ip_address = 192.168.122.195 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] backend_defaults.iser_port = 3260 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] backend_defaults.lvm_mirrors = 0 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] backend_defaults.lvm_share_target = False {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] backend_defaults.lvm_type = auto {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] backend_defaults.num_shell_tries = 3 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] backend_defaults.replication_device = **** {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] backend_defaults.report_discard_supported = False {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] backend_defaults.reserved_percentage = 0 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] backend_defaults.target_helper = tgtadm {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] backend_defaults.target_ip_address = 192.168.122.195 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] backend_defaults.target_port = 3260 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] backend_defaults.target_protocol = iscsi {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] backend_defaults.trace_flags = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] backend_defaults.unique_fqdn_network = True {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] backend_defaults.use_chap_auth = False {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] backend_defaults.volume_backend_name = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] backend_defaults.volume_clear = zero {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] backend_defaults.volume_clear_ionice = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] backend_defaults.volume_clear_size = 0 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] backend_defaults.volume_group = cinder-volumes {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] oslo_reports.file_event_handler = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] oslo_reports.log_dir = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] lvmdriver-1.backend_host = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] lvmdriver-1.chap_password = **** {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] lvmdriver-1.chap_username = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] lvmdriver-1.chiscsi_conf = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] lvmdriver-1.disk_geometry = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] lvmdriver-1.driver_client_cert = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] lvmdriver-1.driver_use_ssl = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] lvmdriver-1.extra_capabilities = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] lvmdriver-1.filter_function = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] lvmdriver-1.goodness_function = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] lvmdriver-1.iser_helper = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] lvmdriver-1.iser_ip_address = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] lvmdriver-1.iser_port = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] lvmdriver-1.lvm_conf_file = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] lvmdriver-1.lvm_mirrors = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] lvmdriver-1.lvm_share_target = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] lvmdriver-1.lvm_type = auto {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] lvmdriver-1.num_shell_tries = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] lvmdriver-1.nvmet_port_id = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] lvmdriver-1.replication_device = **** {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] lvmdriver-1.report_discard_supported = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] lvmdriver-1.reserved_percentage = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] lvmdriver-1.scst_target_driver = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] lvmdriver-1.storage_protocol = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] lvmdriver-1.target_helper = lioadm {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] lvmdriver-1.target_ip_address = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] lvmdriver-1.target_port = 3260 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] lvmdriver-1.target_protocol = iscsi {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] lvmdriver-1.trace_flags = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] lvmdriver-1.use_chap_auth = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] lvmdriver-1.volume_clear = zero {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] lvmdriver-1.volume_clear_size = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] lvmdriver-1.volumes_dir = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] oslo_messaging_rabbit.ssl = False {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] oslo_messaging_rabbit.ssl_version = {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] oslo_messaging_notifications.driver = [] {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] oslo_messaging_notifications.retry = -1 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] key_manager.fixed_key = **** {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] barbican.barbican_api_version = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] barbican.barbican_endpoint = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] barbican.barbican_endpoint_type = public {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] barbican.barbican_region_name = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] barbican.cafile = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] barbican.certfile = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] barbican.collect_timing = False {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] barbican.insecure = False {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] barbican.keyfile = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] barbican.number_of_retries = 60 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] barbican.retry_delay = 1 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] barbican.send_service_user_token = False {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] barbican.split_loggers = False {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] barbican.timeout = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] barbican.tls_ciphers = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] barbican.tls_min_version = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] barbican.verify_ssl = True {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] barbican.verify_ssl_path = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] barbican_service_user.auth_section = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] barbican_service_user.auth_type = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] barbican_service_user.cafile = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] barbican_service_user.certfile = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] barbican_service_user.collect_timing = False {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] barbican_service_user.insecure = False {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] barbican_service_user.keyfile = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] barbican_service_user.split_loggers = False {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] barbican_service_user.timeout = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] barbican_service_user.tls_ciphers = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] barbican_service_user.tls_min_version = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] vault.approle_role_id = **** {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] vault.approle_secret_id = **** {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] vault.auth_method = approle {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] vault.auth_path = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] vault.kv_mountpoint = secret {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] vault.kv_path = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] vault.kv_version = 2 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] vault.namespace = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] vault.root_token_id = **** {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] vault.ssl_ca_crt_file = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] vault.timeout = 60.0 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] vault.token_file = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] vault.token_role = None {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] vault.use_ssl = False {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:10:50 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] ******************************************************************************** {{(pid=75061) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 15 16:10:50 devstack sudo[75222]: pam_unix(sudo:session): session closed for user root Sep 15 16:10:50 devstack cinder-volume[75218]: DEBUG oslo_concurrency.processutils [None req-0f7efa49-cbd8-4cc2-b312-6197c59564ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.330s {{(pid=75218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:10:50 devstack cinder-volume[75218]: DEBUG oslo_concurrency.processutils [None req-0f7efa49-cbd8-4cc2-b312-6197c59564ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:10:50 devstack sudo[75377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 15 16:10:50 devstack sudo[75377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:10:50 devstack sudo[75377]: pam_unix(sudo:session): session closed for user root Sep 15 16:10:50 devstack cinder-volume[75218]: DEBUG oslo_concurrency.processutils [None req-0f7efa49-cbd8-4cc2-b312-6197c59564ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.267s {{(pid=75218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:10:50 devstack cinder-volume[75218]: DEBUG oslo_concurrency.processutils [None req-0f7efa49-cbd8-4cc2-b312-6197c59564ba None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 15 16:10:50 devstack cinder-volume[75218]: INFO cinder.brick.local_dev.lvm [None req-0f7efa49-cbd8-4cc2-b312-6197c59564ba None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 15 16:10:50 devstack cinder-volume[75218]: DEBUG oslo_concurrency.processutils [None req-0f7efa49-cbd8-4cc2-b312-6197c59564ba None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:10:50 devstack cinder-volume[75218]: DEBUG oslo_concurrency.processutils [None req-0f7efa49-cbd8-4cc2-b312-6197c59564ba None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=75218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:10:50 devstack cinder-volume[75218]: DEBUG oslo_concurrency.processutils [None req-0f7efa49-cbd8-4cc2-b312-6197c59564ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:10:50 devstack sudo[75489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 15 16:10:50 devstack sudo[75489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:10:51 devstack sudo[75489]: pam_unix(sudo:session): session closed for user root Sep 15 16:10:51 devstack cinder-volume[75218]: DEBUG oslo_concurrency.processutils [None req-0f7efa49-cbd8-4cc2-b312-6197c59564ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=75218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:10:51 devstack cinder-volume[75218]: DEBUG cinder.brick.local_dev.lvm [None req-0f7efa49-cbd8-4cc2-b312-6197c59564ba None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75218) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 15 16:10:51 devstack cinder-volume[75218]: DEBUG oslo_concurrency.processutils [None req-0f7efa49-cbd8-4cc2-b312-6197c59564ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:10:51 devstack sudo[75592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 15 16:10:51 devstack sudo[75592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:10:52 devstack sudo[75592]: pam_unix(sudo:session): session closed for user root Sep 15 16:10:52 devstack cinder-volume[75218]: DEBUG oslo_concurrency.processutils [None req-0f7efa49-cbd8-4cc2-b312-6197c59564ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.619s {{(pid=75218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:10:52 devstack cinder-volume[75218]: DEBUG oslo_concurrency.processutils [None req-0f7efa49-cbd8-4cc2-b312-6197c59564ba None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:10:52 devstack cinder-volume[75218]: DEBUG oslo_concurrency.processutils [None req-0f7efa49-cbd8-4cc2-b312-6197c59564ba None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=75218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:10:52 devstack cinder-volume[75218]: DEBUG oslo_concurrency.processutils [None req-0f7efa49-cbd8-4cc2-b312-6197c59564ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:10:52 devstack sudo[75932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 15 16:10:52 devstack sudo[75932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:10:53 devstack sudo[75932]: pam_unix(sudo:session): session closed for user root Sep 15 16:10:53 devstack cinder-volume[75218]: DEBUG oslo_concurrency.processutils [None req-0f7efa49-cbd8-4cc2-b312-6197c59564ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.361s {{(pid=75218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:10:53 devstack cinder-volume[75218]: DEBUG oslo_concurrency.processutils [None req-0f7efa49-cbd8-4cc2-b312-6197c59564ba None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:10:53 devstack cinder-volume[75218]: DEBUG oslo_concurrency.processutils [None req-0f7efa49-cbd8-4cc2-b312-6197c59564ba None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=75218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:10:53 devstack cinder-volume[75218]: DEBUG oslo_concurrency.processutils [None req-0f7efa49-cbd8-4cc2-b312-6197c59564ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:10:53 devstack sudo[75989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 15 16:10:53 devstack sudo[75989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:10:53 devstack sudo[75989]: pam_unix(sudo:session): session closed for user root Sep 15 16:10:53 devstack cinder-volume[75218]: DEBUG oslo_concurrency.processutils [None req-0f7efa49-cbd8-4cc2-b312-6197c59564ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.300s {{(pid=75218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:10:53 devstack cinder-volume[75218]: DEBUG oslo_concurrency.processutils [None req-0f7efa49-cbd8-4cc2-b312-6197c59564ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:10:53 devstack sudo[75998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 15 16:10:53 devstack sudo[75998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:10:53 devstack sudo[75998]: pam_unix(sudo:session): session closed for user root Sep 15 16:10:53 devstack cinder-volume[75218]: DEBUG oslo_concurrency.processutils [None req-0f7efa49-cbd8-4cc2-b312-6197c59564ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.281s {{(pid=75218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:10:53 devstack cinder-volume[75218]: DEBUG oslo_concurrency.processutils [None req-0f7efa49-cbd8-4cc2-b312-6197c59564ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:10:53 devstack sudo[76001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 15 16:10:53 devstack sudo[76001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:10:54 devstack sudo[76001]: pam_unix(sudo:session): session closed for user root Sep 15 16:10:54 devstack cinder-volume[75218]: DEBUG oslo_concurrency.processutils [None req-0f7efa49-cbd8-4cc2-b312-6197c59564ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.289s {{(pid=75218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:10:54 devstack cinder-volume[75218]: DEBUG oslo_concurrency.processutils [None req-0f7efa49-cbd8-4cc2-b312-6197c59564ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:10:54 devstack sudo[76004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 15 16:10:54 devstack sudo[76004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:10:54 devstack sudo[76004]: pam_unix(sudo:session): session closed for user root Sep 15 16:10:54 devstack cinder-volume[75218]: DEBUG oslo_concurrency.processutils [None req-0f7efa49-cbd8-4cc2-b312-6197c59564ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.296s {{(pid=75218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:10:54 devstack cinder-volume[75218]: DEBUG oslo_concurrency.processutils [None req-0f7efa49-cbd8-4cc2-b312-6197c59564ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:10:54 devstack sudo[76007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 15 16:10:54 devstack sudo[76007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:10:54 devstack sudo[76007]: pam_unix(sudo:session): session closed for user root Sep 15 16:10:54 devstack cinder-volume[75218]: DEBUG oslo_concurrency.processutils [None req-0f7efa49-cbd8-4cc2-b312-6197c59564ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.279s {{(pid=75218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:10:54 devstack cinder-volume[75218]: DEBUG oslo_concurrency.processutils [None req-0f7efa49-cbd8-4cc2-b312-6197c59564ba None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:10:54 devstack cinder-volume[75218]: DEBUG oslo_concurrency.processutils [None req-0f7efa49-cbd8-4cc2-b312-6197c59564ba None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=75218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:10:54 devstack cinder-volume[75218]: DEBUG oslo_concurrency.processutils [None req-0f7efa49-cbd8-4cc2-b312-6197c59564ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:10:54 devstack sudo[76011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 15 16:10:54 devstack sudo[76011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:10:55 devstack sudo[76011]: pam_unix(sudo:session): session closed for user root Sep 15 16:10:55 devstack cinder-volume[75218]: DEBUG oslo_concurrency.processutils [None req-0f7efa49-cbd8-4cc2-b312-6197c59564ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.307s {{(pid=75218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:10:55 devstack cinder-volume[75218]: INFO cinder.volume.drivers.lvm [None req-0f7efa49-cbd8-4cc2-b312-6197c59564ba None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 15 16:10:55 devstack cinder-volume[75218]: DEBUG oslo_concurrency.processutils [None req-0f7efa49-cbd8-4cc2-b312-6197c59564ba None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:10:55 devstack cinder-volume[75218]: DEBUG oslo_concurrency.processutils [None req-0f7efa49-cbd8-4cc2-b312-6197c59564ba None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=75218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:10:55 devstack cinder-volume[75218]: DEBUG oslo_concurrency.processutils [None req-0f7efa49-cbd8-4cc2-b312-6197c59564ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:10:55 devstack sudo[76017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 15 16:10:55 devstack sudo[76017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:10:55 devstack sudo[76017]: pam_unix(sudo:session): session closed for user root Sep 15 16:10:55 devstack cinder-volume[75218]: DEBUG oslo_concurrency.processutils [None req-0f7efa49-cbd8-4cc2-b312-6197c59564ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.293s {{(pid=75218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:10:55 devstack cinder-volume[75218]: DEBUG cinder.volume.drivers.lvm [None req-0f7efa49-cbd8-4cc2-b312-6197c59564ba None None] Updating volume stats {{(pid=75218) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 15 16:10:55 devstack cinder-volume[75218]: DEBUG oslo_concurrency.processutils [None req-0f7efa49-cbd8-4cc2-b312-6197c59564ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:10:55 devstack sudo[76021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 15 16:10:55 devstack sudo[76021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:10:55 devstack sudo[76021]: pam_unix(sudo:session): session closed for user root Sep 15 16:10:55 devstack cinder-volume[75218]: DEBUG oslo_concurrency.processutils [None req-0f7efa49-cbd8-4cc2-b312-6197c59564ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.290s {{(pid=75218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:10:55 devstack cinder-volume[75218]: DEBUG oslo_concurrency.processutils [None req-0f7efa49-cbd8-4cc2-b312-6197c59564ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:10:55 devstack sudo[76025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 15 16:10:55 devstack sudo[76025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:10:55 devstack sudo[76025]: pam_unix(sudo:session): session closed for user root Sep 15 16:10:55 devstack cinder-volume[75218]: DEBUG oslo_concurrency.processutils [None req-0f7efa49-cbd8-4cc2-b312-6197c59564ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=75218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:10:55 devstack cinder-volume[75218]: DEBUG oslo_concurrency.processutils [None req-0f7efa49-cbd8-4cc2-b312-6197c59564ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:10:55 devstack sudo[76028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 15 16:10:55 devstack sudo[76028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:10:56 devstack sudo[76028]: pam_unix(sudo:session): session closed for user root Sep 15 16:10:56 devstack cinder-volume[75218]: DEBUG oslo_concurrency.processutils [None req-0f7efa49-cbd8-4cc2-b312-6197c59564ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.267s {{(pid=75218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:10:56 devstack cinder-volume[75218]: DEBUG oslo_concurrency.processutils [None req-0f7efa49-cbd8-4cc2-b312-6197c59564ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:10:56 devstack sudo[76031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 15 16:10:56 devstack sudo[76031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:10:56 devstack sudo[76031]: pam_unix(sudo:session): session closed for user root Sep 15 16:10:56 devstack cinder-volume[75218]: DEBUG oslo_concurrency.processutils [None req-0f7efa49-cbd8-4cc2-b312-6197c59564ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=75218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:10:56 devstack cinder-volume[75218]: INFO cinder.volume.driver [None req-0f7efa49-cbd8-4cc2-b312-6197c59564ba None None] Driver hasn't implemented _init_vendor_properties() Sep 15 16:10:56 devstack cinder-volume[75218]: DEBUG cinder.volume.driver [None req-0f7efa49-cbd8-4cc2-b312-6197c59564ba None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75218) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 15 16:10:56 devstack cinder-volume[75218]: DEBUG oslo_db.sqlalchemy.engines [None req-0f7efa49-cbd8-4cc2-b312-6197c59564ba None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75218) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 15 16:10:56 devstack cinder-volume[75218]: DEBUG dbcounter [-] [75218] Writer thread running {{(pid=75218) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 15 16:10:56 devstack cinder-volume[75218]: DEBUG cinder.db.api [None req-0f7efa49-cbd8-4cc2-b312-6197c59564ba None None] Building query based on filter {{(pid=75218) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 15 16:10:56 devstack cinder-volume[75218]: DEBUG cinder.image.image_utils [None req-0f7efa49-cbd8-4cc2-b312-6197c59564ba None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75218) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 15 16:10:56 devstack cinder-volume[75218]: INFO cinder.keymgr.migration [None req-bbd58bd2-d163-4cae-bee1-a3bbac1efb65 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 15 16:10:56 devstack cinder-volume[75218]: DEBUG cinder.volume.drivers.lvm [None req-0f7efa49-cbd8-4cc2-b312-6197c59564ba None None] Updating volume stats {{(pid=75218) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 15 16:10:56 devstack cinder-volume[75218]: DEBUG oslo_concurrency.processutils [None req-0f7efa49-cbd8-4cc2-b312-6197c59564ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:10:56 devstack sudo[76039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 15 16:10:56 devstack sudo[76039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:10:56 devstack sudo[76039]: pam_unix(sudo:session): session closed for user root Sep 15 16:10:56 devstack cinder-volume[75218]: DEBUG oslo_concurrency.processutils [None req-0f7efa49-cbd8-4cc2-b312-6197c59564ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.244s {{(pid=75218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:10:56 devstack cinder-volume[75218]: DEBUG oslo_concurrency.processutils [None req-0f7efa49-cbd8-4cc2-b312-6197c59564ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:10:56 devstack sudo[76042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 15 16:10:56 devstack sudo[76042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:10:57 devstack sudo[76042]: pam_unix(sudo:session): session closed for user root Sep 15 16:10:57 devstack cinder-volume[75218]: DEBUG oslo_concurrency.processutils [None req-0f7efa49-cbd8-4cc2-b312-6197c59564ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=75218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:10:57 devstack cinder-volume[75218]: DEBUG oslo_concurrency.processutils [None req-0f7efa49-cbd8-4cc2-b312-6197c59564ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:10:57 devstack sudo[76046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 15 16:10:57 devstack sudo[76046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:10:57 devstack sudo[76046]: pam_unix(sudo:session): session closed for user root Sep 15 16:10:57 devstack cinder-volume[75218]: DEBUG oslo_concurrency.processutils [None req-0f7efa49-cbd8-4cc2-b312-6197c59564ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.259s {{(pid=75218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:10:57 devstack cinder-volume[75218]: DEBUG oslo_concurrency.processutils [None req-0f7efa49-cbd8-4cc2-b312-6197c59564ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:10:57 devstack sudo[76049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 15 16:10:57 devstack sudo[76049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:10:57 devstack sudo[76049]: pam_unix(sudo:session): session closed for user root Sep 15 16:10:57 devstack cinder-volume[75218]: DEBUG oslo_concurrency.processutils [None req-0f7efa49-cbd8-4cc2-b312-6197c59564ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.247s {{(pid=75218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:10:57 devstack cinder-volume[75218]: DEBUG cinder.manager [None req-0f7efa49-cbd8-4cc2-b312-6197c59564ba None None] Notifying Schedulers of capabilities ... {{(pid=75218) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:10:57 devstack cinder-volume[75218]: INFO cinder.volume.manager [None req-0f7efa49-cbd8-4cc2-b312-6197c59564ba None None] Driver initialization completed successfully. Sep 15 16:10:57 devstack cinder-volume[75218]: INFO cinder.manager [None req-0f7efa49-cbd8-4cc2-b312-6197c59564ba None None] Initiating service 2 cleanup Sep 15 16:10:57 devstack cinder-volume[75218]: INFO cinder.manager [None req-0f7efa49-cbd8-4cc2-b312-6197c59564ba None None] Service 2 cleanup completed. Sep 15 16:10:57 devstack cinder-volume[75218]: DEBUG cinder.service [None req-0f7efa49-cbd8-4cc2-b312-6197c59564ba None None] Creating RPC server for service cinder-volume {{(pid=75218) start /opt/stack/cinder/cinder/service.py:231}} Sep 15 16:10:57 devstack cinder-volume[75218]: DEBUG cinder.service [None req-0f7efa49-cbd8-4cc2-b312-6197c59564ba None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75218) start /opt/stack/cinder/cinder/service.py:237}} Sep 15 16:10:57 devstack cinder-volume[75218]: INFO cinder.volume.manager [None req-0f7efa49-cbd8-4cc2-b312-6197c59564ba None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 15 16:10:57 devstack cinder-volume[75218]: DEBUG cinder.volume.drivers.lvm [None req-0f7efa49-cbd8-4cc2-b312-6197c59564ba None None] Updating volume stats {{(pid=75218) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 15 16:10:57 devstack cinder-volume[75218]: DEBUG oslo_concurrency.processutils [None req-0f7efa49-cbd8-4cc2-b312-6197c59564ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:10:57 devstack sudo[76052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 15 16:10:57 devstack sudo[76052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:10:58 devstack sudo[76052]: pam_unix(sudo:session): session closed for user root Sep 15 16:10:58 devstack cinder-volume[75218]: DEBUG oslo_concurrency.processutils [None req-0f7efa49-cbd8-4cc2-b312-6197c59564ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.283s {{(pid=75218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:10:58 devstack cinder-volume[75218]: DEBUG oslo_concurrency.processutils [None req-0f7efa49-cbd8-4cc2-b312-6197c59564ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:10:58 devstack sudo[76056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 15 16:10:58 devstack sudo[76056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:10:58 devstack sudo[76056]: pam_unix(sudo:session): session closed for user root Sep 15 16:10:58 devstack cinder-volume[75218]: DEBUG oslo_concurrency.processutils [None req-0f7efa49-cbd8-4cc2-b312-6197c59564ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.307s {{(pid=75218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:10:58 devstack cinder-volume[75218]: DEBUG oslo_concurrency.processutils [None req-0f7efa49-cbd8-4cc2-b312-6197c59564ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:10:58 devstack sudo[76064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 15 16:10:58 devstack sudo[76064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:10:58 devstack sudo[76064]: pam_unix(sudo:session): session closed for user root Sep 15 16:10:58 devstack cinder-volume[75218]: DEBUG oslo_concurrency.processutils [None req-0f7efa49-cbd8-4cc2-b312-6197c59564ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.315s {{(pid=75218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:10:58 devstack cinder-volume[75218]: DEBUG oslo_concurrency.processutils [None req-0f7efa49-cbd8-4cc2-b312-6197c59564ba None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:10:58 devstack sudo[76067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 15 16:10:58 devstack sudo[76067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:10:59 devstack sudo[76067]: pam_unix(sudo:session): session closed for user root Sep 15 16:10:59 devstack cinder-volume[75218]: DEBUG oslo_concurrency.processutils [None req-0f7efa49-cbd8-4cc2-b312-6197c59564ba None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.322s {{(pid=75218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:10:59 devstack cinder-volume[75218]: INFO cinder.volume.manager [None req-0f7efa49-cbd8-4cc2-b312-6197c59564ba None None] Driver post RPC initialization completed successfully. Sep 15 16:11:00 devstack cinder-volume[75061]: DEBUG dbcounter [-] [75061] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75061) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 16:11:09 devstack cinder-volume[75218]: DEBUG dbcounter [-] [75218] Writing DB stats cinder:SELECT=3 {{(pid=75218) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 16:11:09 devstack cinder-volume[75218]: DEBUG dbcounter [-] [75218] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=75218) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 16:11:41 devstack cinder-volume[75218]: DEBUG oslo_service.periodic_task [None req-25bbe2ba-7637-4793-8f46-b0163672eb88 None None] Running periodic task VolumeManager._thread_info {{(pid=75218) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 15 16:11:41 devstack cinder-volume[75218]: DEBUG cinder.volume.manager [None req-25bbe2ba-7637-4793-8f46-b0163672eb88 None None] thread count: 6 {{(pid=75218) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 15 16:11:41 devstack cinder-volume[75218]: DEBUG cinder.volume.manager [None req-25bbe2ba-7637-4793-8f46-b0163672eb88 None None] thread info: [<_MainThread(MainThread, started 135661572804736)>, , , , , ] {{(pid=75218) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 15 16:12:41 devstack cinder-volume[75218]: DEBUG oslo_service.periodic_task [None req-25bbe2ba-7637-4793-8f46-b0163672eb88 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75218) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 15 16:12:41 devstack cinder-volume[75218]: DEBUG cinder.volume.drivers.lvm [None req-25bbe2ba-7637-4793-8f46-b0163672eb88 None None] Updating volume stats {{(pid=75218) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 15 16:12:41 devstack cinder-volume[75218]: DEBUG oslo_concurrency.processutils [None req-25bbe2ba-7637-4793-8f46-b0163672eb88 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:12:41 devstack sudo[81285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 15 16:12:41 devstack sudo[81285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:12:41 devstack sudo[81285]: pam_unix(sudo:session): session closed for user root Sep 15 16:12:41 devstack cinder-volume[75218]: DEBUG oslo_concurrency.processutils [None req-25bbe2ba-7637-4793-8f46-b0163672eb88 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=75218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:12:41 devstack cinder-volume[75218]: DEBUG oslo_concurrency.processutils [None req-25bbe2ba-7637-4793-8f46-b0163672eb88 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:12:41 devstack sudo[81288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 15 16:12:41 devstack sudo[81288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:12:41 devstack sudo[81288]: pam_unix(sudo:session): session closed for user root Sep 15 16:12:41 devstack cinder-volume[75218]: DEBUG oslo_concurrency.processutils [None req-25bbe2ba-7637-4793-8f46-b0163672eb88 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.247s {{(pid=75218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:12:41 devstack cinder-volume[75218]: DEBUG oslo_concurrency.processutils [None req-25bbe2ba-7637-4793-8f46-b0163672eb88 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:12:41 devstack sudo[81291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 15 16:12:41 devstack sudo[81291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:12:41 devstack sudo[81291]: pam_unix(sudo:session): session closed for user root Sep 15 16:12:41 devstack cinder-volume[75218]: DEBUG oslo_concurrency.processutils [None req-25bbe2ba-7637-4793-8f46-b0163672eb88 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.247s {{(pid=75218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:12:41 devstack cinder-volume[75218]: DEBUG oslo_concurrency.processutils [None req-25bbe2ba-7637-4793-8f46-b0163672eb88 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:12:41 devstack sudo[81294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 15 16:12:41 devstack sudo[81294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:12:42 devstack sudo[81294]: pam_unix(sudo:session): session closed for user root Sep 15 16:12:42 devstack cinder-volume[75218]: DEBUG oslo_concurrency.processutils [None req-25bbe2ba-7637-4793-8f46-b0163672eb88 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=75218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:12:42 devstack cinder-volume[75218]: DEBUG cinder.manager [None req-25bbe2ba-7637-4793-8f46-b0163672eb88 None None] Notifying Schedulers of capabilities ... {{(pid=75218) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:12:42 devstack cinder-volume[75218]: DEBUG oslo_service.periodic_task [None req-25bbe2ba-7637-4793-8f46-b0163672eb88 None None] Running periodic task VolumeManager._thread_info {{(pid=75218) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 15 16:12:42 devstack cinder-volume[75218]: DEBUG cinder.volume.manager [None req-25bbe2ba-7637-4793-8f46-b0163672eb88 None None] thread count: 6 {{(pid=75218) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 15 16:12:42 devstack cinder-volume[75218]: DEBUG cinder.volume.manager [None req-25bbe2ba-7637-4793-8f46-b0163672eb88 None None] thread info: [<_MainThread(MainThread, started 135661572804736)>, , , , , ] {{(pid=75218) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 15 16:13:09 devstack cinder-volume[75218]: DEBUG dbcounter [-] [75218] Writing DB stats cinder:SELECT=1 {{(pid=75218) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 16:13:09 devstack cinder-volume[75218]: DEBUG dbcounter [-] [75218] Writing DB stats cinder:UPDATE=1 {{(pid=75218) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 16:13:41 devstack cinder-volume[75218]: DEBUG oslo_service.periodic_task [None req-25bbe2ba-7637-4793-8f46-b0163672eb88 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75218) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 15 16:13:41 devstack cinder-volume[75218]: DEBUG cinder.volume.drivers.lvm [None req-25bbe2ba-7637-4793-8f46-b0163672eb88 None None] Updating volume stats {{(pid=75218) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 15 16:13:41 devstack cinder-volume[75218]: DEBUG oslo_concurrency.processutils [None req-25bbe2ba-7637-4793-8f46-b0163672eb88 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:13:41 devstack sudo[83021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 15 16:13:41 devstack sudo[83021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:13:41 devstack sudo[83021]: pam_unix(sudo:session): session closed for user root Sep 15 16:13:41 devstack cinder-volume[75218]: DEBUG oslo_concurrency.processutils [None req-25bbe2ba-7637-4793-8f46-b0163672eb88 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=75218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:13:41 devstack cinder-volume[75218]: DEBUG oslo_concurrency.processutils [None req-25bbe2ba-7637-4793-8f46-b0163672eb88 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:13:41 devstack sudo[83039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 15 16:13:41 devstack sudo[83039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:13:41 devstack sudo[83039]: pam_unix(sudo:session): session closed for user root Sep 15 16:13:41 devstack cinder-volume[75218]: DEBUG oslo_concurrency.processutils [None req-25bbe2ba-7637-4793-8f46-b0163672eb88 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=75218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:13:41 devstack cinder-volume[75218]: DEBUG oslo_concurrency.processutils [None req-25bbe2ba-7637-4793-8f46-b0163672eb88 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:13:41 devstack sudo[83047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 15 16:13:41 devstack sudo[83047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:13:41 devstack sudo[83047]: pam_unix(sudo:session): session closed for user root Sep 15 16:13:41 devstack cinder-volume[75218]: DEBUG oslo_concurrency.processutils [None req-25bbe2ba-7637-4793-8f46-b0163672eb88 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.261s {{(pid=75218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:13:41 devstack cinder-volume[75218]: DEBUG oslo_concurrency.processutils [None req-25bbe2ba-7637-4793-8f46-b0163672eb88 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:13:41 devstack sudo[83052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 15 16:13:41 devstack sudo[83052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:13:42 devstack sudo[83052]: pam_unix(sudo:session): session closed for user root Sep 15 16:13:42 devstack cinder-volume[75218]: DEBUG oslo_concurrency.processutils [None req-25bbe2ba-7637-4793-8f46-b0163672eb88 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.288s {{(pid=75218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:13:42 devstack cinder-volume[75218]: DEBUG cinder.manager [None req-25bbe2ba-7637-4793-8f46-b0163672eb88 None None] Notifying Schedulers of capabilities ... {{(pid=75218) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:14:41 devstack cinder-volume[75218]: DEBUG oslo_service.periodic_task [None req-25bbe2ba-7637-4793-8f46-b0163672eb88 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75218) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 15 16:14:41 devstack cinder-volume[75218]: DEBUG cinder.volume.drivers.lvm [None req-25bbe2ba-7637-4793-8f46-b0163672eb88 None None] Updating volume stats {{(pid=75218) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 15 16:14:41 devstack cinder-volume[75218]: DEBUG oslo_concurrency.processutils [None req-25bbe2ba-7637-4793-8f46-b0163672eb88 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:14:41 devstack sudo[84404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 15 16:14:41 devstack sudo[84404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:14:41 devstack sudo[84404]: pam_unix(sudo:session): session closed for user root Sep 15 16:14:41 devstack cinder-volume[75218]: DEBUG oslo_concurrency.processutils [None req-25bbe2ba-7637-4793-8f46-b0163672eb88 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.260s {{(pid=75218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:14:41 devstack cinder-volume[75218]: DEBUG oslo_concurrency.processutils [None req-25bbe2ba-7637-4793-8f46-b0163672eb88 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:14:41 devstack sudo[84407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 15 16:14:41 devstack sudo[84407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:14:41 devstack sudo[84407]: pam_unix(sudo:session): session closed for user root Sep 15 16:14:41 devstack cinder-volume[75218]: DEBUG oslo_concurrency.processutils [None req-25bbe2ba-7637-4793-8f46-b0163672eb88 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=75218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:14:41 devstack cinder-volume[75218]: DEBUG oslo_concurrency.processutils [None req-25bbe2ba-7637-4793-8f46-b0163672eb88 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:14:41 devstack sudo[84413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 15 16:14:41 devstack sudo[84413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:14:41 devstack sudo[84413]: pam_unix(sudo:session): session closed for user root Sep 15 16:14:41 devstack cinder-volume[75218]: DEBUG oslo_concurrency.processutils [None req-25bbe2ba-7637-4793-8f46-b0163672eb88 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.250s {{(pid=75218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:14:41 devstack cinder-volume[75218]: DEBUG oslo_concurrency.processutils [None req-25bbe2ba-7637-4793-8f46-b0163672eb88 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:14:41 devstack sudo[84416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 15 16:14:41 devstack sudo[84416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:14:42 devstack sudo[84416]: pam_unix(sudo:session): session closed for user root Sep 15 16:14:42 devstack cinder-volume[75218]: DEBUG oslo_concurrency.processutils [None req-25bbe2ba-7637-4793-8f46-b0163672eb88 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=75218) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:14:42 devstack cinder-volume[75218]: DEBUG cinder.manager [None req-25bbe2ba-7637-4793-8f46-b0163672eb88 None None] Notifying Schedulers of capabilities ... {{(pid=75218) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:14:42 devstack cinder-volume[75218]: DEBUG oslo_service.periodic_task [None req-25bbe2ba-7637-4793-8f46-b0163672eb88 None None] Running periodic task VolumeManager._thread_info {{(pid=75218) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 15 16:14:42 devstack cinder-volume[75218]: DEBUG cinder.volume.manager [None req-25bbe2ba-7637-4793-8f46-b0163672eb88 None None] thread count: 6 {{(pid=75218) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 15 16:14:42 devstack cinder-volume[75218]: DEBUG cinder.volume.manager [None req-25bbe2ba-7637-4793-8f46-b0163672eb88 None None] thread info: [<_MainThread(MainThread, started 135661572804736)>, , , , , ] {{(pid=75218) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 15 16:15:09 devstack cinder-volume[75218]: DEBUG dbcounter [-] [75218] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=75218) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 16:15:16 devstack cinder-volume[75061]: INFO oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] Caught SIGTERM, stopping children Sep 15 16:15:16 devstack cinder-volume[75061]: DEBUG oslo_concurrency.lockutils [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] Acquiring lock "singleton_lock" {{(pid=75061) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 15 16:15:16 devstack cinder-volume[75061]: DEBUG oslo_concurrency.lockutils [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] Acquired lock "singleton_lock" {{(pid=75061) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 15 16:15:16 devstack cinder-volume[75061]: DEBUG oslo_concurrency.lockutils [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] Releasing lock "singleton_lock" {{(pid=75061) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 15 16:15:16 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] Stop services. {{(pid=75061) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 15 16:15:16 devstack cinder-volume[75061]: DEBUG oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] Killing children. {{(pid=75061) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 15 16:15:16 devstack cinder-volume[75061]: INFO oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] Waiting on 1 children to exit Sep 15 16:15:17 devstack cinder-volume[75218]: DEBUG oslo_concurrency.lockutils [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] Acquiring lock "singleton_lock" {{(pid=75218) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 15 16:15:17 devstack cinder-volume[75218]: DEBUG oslo_concurrency.lockutils [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] Acquired lock "singleton_lock" {{(pid=75218) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 15 16:15:17 devstack cinder-volume[75218]: DEBUG oslo_concurrency.lockutils [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] Releasing lock "singleton_lock" {{(pid=75218) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 15 16:15:17 devstack cinder-volume[75218]: WARNING amqp [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 15 16:15:17 devstack cinder-volume[75218]: WARNING amqp [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 15 16:15:17 devstack cinder-volume[75061]: INFO oslo_service.backend._eventlet.service [None req-75a5f154-2c62-4c01-aab3-c4ded34e1d76 None None] Child 75218 exited with status 0 Sep 15 16:15:18 devstack cinder-volume[85224]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 15 16:15:18 devstack cinder-volume[85224]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 15 16:15:18 devstack cinder-volume[85224]: we strongly recommend against using it for new projects. Sep 15 16:15:18 devstack cinder-volume[85224]: If you are already using Eventlet, we recommend migrating to a different Sep 15 16:15:18 devstack cinder-volume[85224]: framework. For more detail see Sep 15 16:15:18 devstack cinder-volume[85224]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 15 16:15:18 devstack cinder-volume[85224]: import eventlet # noqa Sep 15 16:15:20 devstack cinder-volume[85224]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85224) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 15 16:15:20 devstack cinder-volume[85224]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85224) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 15 16:15:20 devstack cinder-volume[85224]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85224) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 15 16:15:20 devstack cinder-volume[85224]: INFO dbcounter [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] Registered counter for database cinder Sep 15 16:15:20 devstack cinder-volume[85224]: DEBUG oslo_db.sqlalchemy.engines [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85224) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG dbcounter [-] [85224] Writer thread running {{(pid=85224) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 15 16:15:21 devstack cinder-volume[85224]: INFO cinder.rpc [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 15 16:15:21 devstack cinder-volume[85224]: INFO cinder.rpc [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_db.sqlalchemy.engines [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85224) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 15 16:15:21 devstack cinder-volume[85224]: INFO cinder.volume.manager [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] Determined volume DB was empty at startup. Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG cinder.volume.manager [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85224) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 15 16:15:21 devstack cinder-volume[85224]: INFO cinder.volume.manager [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 15 16:15:21 devstack cinder-volume[85224]: WARNING stevedore.named [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 15 16:15:21 devstack cinder-volume[85224]: WARNING castellan.key_manager [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 15 16:15:21 devstack cinder-volume[85224]: WARNING cinder.keymgr.conf_key_mgr [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 15 16:15:21 devstack cinder-volume[85224]: INFO cinder.volume.manager [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_db.sqlalchemy.engines [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85224) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 15 16:15:21 devstack cinder-volume[85224]: INFO oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] Starting 1 workers Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] Started child 85441 {{(pid=85224) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] Full set of CONF: {{(pid=85224) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] ******************************************************************************** {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] Configuration options gathered from: {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] ================================================================================ {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] allow_availability_zone_fallback = False {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] allow_compression_on_image_upload = False {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] allowed_direct_url_schemes = [] {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] api_rate_limit = True {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] auth_strategy = keystone {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85441]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] backend_availability_zone = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] backend_host = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] backend_name = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] backend_stats_polling_interval = 60 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] backup_api_class = cinder.backup.api.API {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] backup_name_template = backup-%s {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] backup_use_same_host = False {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] backup_use_temp_snapshot = False {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] chap_password = **** {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] chap_username = {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] cinder_internal_tenant_project_id = bab006bd62bd4f3d8fe504a9633e7966 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] cinder_internal_tenant_user_id = 1b3ee3422beb43a49b7426d0c23aa86b {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] cluster = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] compression_format = gzip {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] compute_api_class = cinder.compute.nova.API {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] config_dir = [] {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] config_source = [] {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] control_exchange = openstack {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] debug = True {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] default_availability_zone = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] default_group_type = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] default_volume_type = QuobyteHD {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] disk_geometry = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] driver_client_cert = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] driver_client_cert_key = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] driver_data_namespace = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] driver_ssl_cert_path = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] driver_ssl_cert_verify = False {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] driver_use_ssl = False {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] enable_new_services = True {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] enable_unsupported_driver = False {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] enabled_backends = ['QuobyteHD'] {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] enforce_multipath_for_image_xfer = False {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] filter_function = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] glance_api_insecure = False {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] glance_api_servers = ['http://192.168.122.195/image'] {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] glance_api_ssl_compression = False {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] glance_ca_certificates_file = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] glance_catalog_info = image:glance:publicURL {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] glance_certfile = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] glance_keyfile = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] glance_num_retries = 3 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] glance_request_timeout = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] goodness_function = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] graceful_shutdown_timeout = 5 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] group_api_class = cinder.group.api.API {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] host = devstack {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] image_compress_on_upload = True {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] image_conversion_address_space_limit = 1 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] image_conversion_cpu_limit = 60 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] image_conversion_disable = False {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] image_introspection_address_space_limit = 1 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] image_introspection_cpu_limit = 60 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] image_upload_use_cinder_backend = False {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] image_upload_use_internal_tenant = False {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] image_volume_cache_enabled = False {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] image_volume_cache_max_count = 0 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] image_volume_cache_max_size_gb = 0 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] init_host_max_objects_retrieval = 0 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] instance_format = [instance: %(uuid)s] {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] iscsi_target_flags = {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] iscsi_write_cache = on {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] iser_helper = tgtadm {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] iser_ip_address = 192.168.122.195 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] iser_port = 3260 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] log_color = False {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] log_config_append = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] log_dir = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] log_file = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] log_options = True {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] log_rotate_interval = 1 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] log_rotate_interval_type = days {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] log_rotation_type = none {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85441]: INFO cinder.volume.manager [None req-68e79537-3996-4001-ada1-d48ab136b2bc None None] Starting volume driver QuobyteDriver (1.2.1) Sep 15 16:15:21 devstack cinder-volume[85441]: DEBUG cinder.volume.drivers.remotefs [None req-68e79537-3996-4001-ada1-d48ab136b2bc None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=85441) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] max_age = 0 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] max_logfile_count = 30 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] max_logfile_size_mb = 200 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] max_over_subscription_ratio = 20.0 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] message_reap_interval = 86400 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] message_ttl = 2592000 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] migration_create_volume_timeout_secs = 300 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] monkey_patch = False {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] monkey_patch_modules = [] {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] my_ip = 192.168.122.195 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] no_snapshot_gb_quota = False {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] num_iser_scan_tries = 3 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] num_shell_tries = 3 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] num_volume_device_scan_tries = 3 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] nvmeof_conn_info_version = 1 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] nvmet_ns_id = 10 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] nvmet_port_id = 1 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] osapi_max_limit = 1000 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] osapi_volume_ext_list = [] {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] osapi_volume_listen = 0.0.0.0 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] osapi_volume_listen_port = 8776 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] osapi_volume_use_ssl = False {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] osapi_volume_workers = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] per_volume_size_limit = -1 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] periodic_fuzzy_delay = 60 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] periodic_interval = 60 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] project_id_regex = [0-9a-f\-]+ {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] public_endpoint = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] publish_errors = False {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] quota_backup_gigabytes = 1000 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] quota_backups = 10 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] quota_gigabytes = 1000 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] quota_groups = 10 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] quota_snapshots = 10 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] quota_volumes = 10 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] rate_limit_burst = 0 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] rate_limit_except_level = CRITICAL {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] rate_limit_interval = 0 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] reinit_driver_count = 3 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] replication_device = **** {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] report_discard_supported = False {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] report_interval = 120 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] reservation_clean_interval = 86400 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] reservation_expire = 86400 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] reserved_image_namespaces = [] {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] reserved_percentage = 0 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] rpc_response_timeout = 120 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] run_external_periodic_tasks = True {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] scst_target_driver = iscsi {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] scst_target_iqn_name = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] service_down_time = 720 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] shell_completion = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] snapshot_name_template = snapshot-%s {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] split_loggers = False {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] state_path = /opt/stack/data/cinder {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] storage_availability_zone = nova {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] storage_protocol = iSCSI {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] syslog_log_facility = LOG_USER {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] target_helper = lioadm {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] target_ip_address = 192.168.122.195 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] target_port = 3260 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] target_protocol = iscsi {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] target_secondary_ip_addresses = [] {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] trace_flags = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] transfer_api_class = cinder.transfer.api.API {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] transport_url = **** {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] until_refresh = 0 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] use_chap_auth = False {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] use_default_quota_class = True {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] use_journal = False {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] use_json = False {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] use_multipath_for_image_xfer = False {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] use_stderr = False {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] use_syslog = False {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] verify_glance_signatures = enabled {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] volume_api_class = cinder.volume.api.API {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] volume_backend_name = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] volume_clear = zero {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] volume_clear_ionice = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] volume_clear_size = 0 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] volume_copy_bps_limit = 0 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] volume_dd_blocksize = 1M {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] volume_name_template = volume-%s {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] volume_service_inithost_offload = False {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] volume_usage_audit_period = month {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] zoning_mode = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] oslo_concurrency.disable_process_locking = False {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] keystone_authtoken.auth_section = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] keystone_authtoken.auth_type = password {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] keystone_authtoken.auth_version = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] keystone_authtoken.cache = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] keystone_authtoken.certfile = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] keystone_authtoken.delay_auth_decision = False {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] keystone_authtoken.http_connect_timeout = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] keystone_authtoken.include_service_catalog = True {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] keystone_authtoken.insecure = False {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] keystone_authtoken.interface = public {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] keystone_authtoken.keyfile = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] keystone_authtoken.memcache_password = **** {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] keystone_authtoken.memcache_username = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] keystone_authtoken.region_name = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] keystone_authtoken.service_token_roles_required = True {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] keystone_authtoken.service_type = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] keystone_authtoken.token_cache_time = 300 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.195/identity {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] cache.backend = dogpile.cache.null {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] cache.backend_argument = **** {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] cache.backend_expiration_time = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] cache.config_prefix = cache.oslo {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85441]: DEBUG cinder.volume.drivers.quobyte [None req-68e79537-3996-4001-ada1-d48ab136b2bc None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=85441) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 15 16:15:21 devstack cinder-volume[85441]: WARNING cinder.volume.drivers.quobyte [None req-68e79537-3996-4001-ada1-d48ab136b2bc None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 15 16:15:21 devstack cinder-volume[85441]: WARNING cinder.volume.drivers.quobyte [None req-68e79537-3996-4001-ada1-d48ab136b2bc None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 15 16:15:21 devstack cinder-volume[85441]: DEBUG oslo_concurrency.processutils [None req-68e79537-3996-4001-ada1-d48ab136b2bc None None] Running cmd (subprocess): mount.quobyte {{(pid=85441) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] cache.debug_cache_backend = False {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] cache.enable_retry_client = False {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] cache.enable_socket_keepalive = False {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] cache.enabled = False {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] cache.expiration_time = 600 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] cache.hashclient_dead_timeout = 60.0 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] cache.hashclient_retry_attempts = 2 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] cache.memcache_dead_retry = 300 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] cache.memcache_pool_maxsize = 10 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] cache.memcache_sasl_enabled = False {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] cache.password = **** {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] cache.proxies = [] {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] cache.redis_db = 0 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] cache.redis_sentinel_service_name = mymaster {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] cache.redis_server = localhost:6379 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] cache.retry_attempts = 2 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] cache.retry_delay = 0.0 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] cache.socket_keepalive_count = 1 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] cache.socket_keepalive_idle = 1 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] cache.socket_keepalive_interval = 1 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] cache.socket_timeout = 1.0 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] cache.tls_allowed_ciphers = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] cache.tls_cafile = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] cache.tls_certfile = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] cache.tls_enabled = False {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] cache.tls_keyfile = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] cache.username = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] coordination.backend_url = **** {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] database.asyncio_connection = **** {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] database.asyncio_slave_connection = **** {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] database.backend = sqlalchemy {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] database.connection = **** {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] database.connection_debug = 0 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] database.connection_parameters = {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] database.connection_recycle_time = 3600 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] database.connection_trace = False {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] database.db_inc_retry_interval = True {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] database.db_max_retries = 20 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] database.db_max_retry_interval = 10 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] database.db_retry_interval = 1 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] database.max_overflow = 50 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] database.max_pool_size = 5 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] database.max_retries = 10 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] database.mysql_wsrep_sync_wait = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] database.pool_timeout = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] database.retry_interval = 10 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] database.slave_connection = **** {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] database.sqlite_synchronous = True {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] database.synchronous_reader = True {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] database.use_db_reconnect = False {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] oslo_messaging_tracing.insecure = False {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] profiler.connection_string = messaging:// {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] profiler.enabled = False {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] profiler.es_doc_type = notification {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] profiler.es_scroll_size = 10000 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] profiler.es_scroll_time = 2m {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] profiler.filter_error_trace = False {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] profiler.hmac_keys = **** {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] profiler.sentinel_service_name = mymaster {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] profiler.socket_timeout = 0.1 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] profiler.trace_requests = False {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] profiler.trace_sqlalchemy = False {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] profiler_jaeger.process_tags = {} {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] profiler_jaeger.service_name_prefix = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] profiler_otlp.service_name_prefix = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] oslo_policy.enforce_new_defaults = True {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] oslo_policy.policy_default_rule = default {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] oslo_policy.policy_file = policy.yaml {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] oslo_policy.remote_timeout = 60.0 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] privsep_osbrick.capabilities = [21, 2] {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] privsep_osbrick.group = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] privsep_osbrick.helper_command = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] privsep_osbrick.user = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] cinder_sys_admin.group = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] cinder_sys_admin.helper_command = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] cinder_sys_admin.user = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] service_user.auth_section = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] service_user.auth_type = password {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] service_user.cafile = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] service_user.certfile = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] service_user.collect_timing = False {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] service_user.insecure = False {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] service_user.keyfile = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] service_user.send_service_user_token = True {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] service_user.split_loggers = False {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] service_user.timeout = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] service_user.tls_ciphers = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] service_user.tls_min_version = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] glance.auth_section = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] glance.auth_type = password {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] glance.certfile = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] glance.collect_timing = False {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] glance.insecure = False {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] glance.keyfile = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] glance.region_name = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] glance.split_loggers = False {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] glance.timeout = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] glance.tls_ciphers = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] glance.tls_min_version = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] backend_defaults.backend_availability_zone = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] backend_defaults.chap_password = **** {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] backend_defaults.chap_username = {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] backend_defaults.disk_geometry = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] backend_defaults.driver_client_cert = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] backend_defaults.driver_client_cert_key = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] backend_defaults.driver_data_namespace = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] backend_defaults.driver_use_ssl = False {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] backend_defaults.enable_unsupported_driver = False {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] backend_defaults.extra_capabilities = {} {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] backend_defaults.filter_function = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] backend_defaults.goodness_function = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] backend_defaults.iscsi_target_flags = {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] backend_defaults.iscsi_write_cache = on {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] backend_defaults.iser_helper = tgtadm {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] backend_defaults.iser_ip_address = 192.168.122.195 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] backend_defaults.iser_port = 3260 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] backend_defaults.nas_host = {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] backend_defaults.nas_login = admin {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] backend_defaults.nas_mount_options = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] backend_defaults.nas_password = **** {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] backend_defaults.nas_private_key = {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] backend_defaults.nas_share_path = {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] backend_defaults.nas_ssh_port = 22 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] backend_defaults.num_shell_tries = 3 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] backend_defaults.nvmet_port_id = 1 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] backend_defaults.quobyte_client_cfg = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] backend_defaults.quobyte_volume_url = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] backend_defaults.replication_device = **** {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] backend_defaults.report_discard_supported = False {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] backend_defaults.reserved_percentage = 0 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] backend_defaults.scst_target_driver = iscsi {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] backend_defaults.scst_target_iqn_name = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] backend_defaults.storage_protocol = iSCSI {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] backend_defaults.target_helper = tgtadm {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] backend_defaults.target_ip_address = 192.168.122.195 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] backend_defaults.target_port = 3260 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] backend_defaults.target_protocol = iscsi {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] backend_defaults.trace_flags = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] backend_defaults.unique_fqdn_network = True {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] backend_defaults.use_chap_auth = False {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] backend_defaults.volume_backend_name = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] backend_defaults.volume_clear = zero {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] backend_defaults.volume_clear_ionice = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] backend_defaults.volume_clear_size = 0 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] oslo_reports.file_event_handler = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] oslo_reports.log_dir = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] QuobyteHD.backend_availability_zone = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] QuobyteHD.backend_host = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] QuobyteHD.chap_password = **** {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] QuobyteHD.chap_username = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] QuobyteHD.chiscsi_conf = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] QuobyteHD.disk_geometry = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] QuobyteHD.driver_client_cert = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] QuobyteHD.driver_client_cert_key = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack quobyte-client[85442]: Reading configuration file: /etc/quobyte/client.cfg Sep 15 16:15:21 devstack quobyte-client[85442]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] QuobyteHD.driver_data_namespace = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85441]: DEBUG oslo_concurrency.processutils [None req-68e79537-3996-4001-ada1-d48ab136b2bc None None] CMD "mount.quobyte" returned: 1 in 0.135s {{(pid=85441) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:15:21 devstack cinder-volume[85441]: DEBUG oslo_concurrency.lockutils [None req-68e79537-3996-4001-ada1-d48ab136b2bc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85441) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:15:21 devstack cinder-volume[85441]: DEBUG oslo_concurrency.lockutils [None req-68e79537-3996-4001-ada1-d48ab136b2bc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85441) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] QuobyteHD.driver_use_ssl = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] QuobyteHD.enable_unsupported_driver = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] QuobyteHD.extra_capabilities = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] QuobyteHD.filter_function = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85441]: DEBUG cinder.volume.drivers.quobyte [None req-68e79537-3996-4001-ada1-d48ab136b2bc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=85441) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:15:21 devstack cinder-volume[85441]: INFO cinder.volume.drivers.quobyte [None req-68e79537-3996-4001-ada1-d48ab136b2bc None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a ... Sep 15 16:15:21 devstack cinder-volume[85441]: DEBUG oslo_concurrency.processutils [None req-68e79537-3996-4001-ada1-d48ab136b2bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb -c /etc/quobyte/client-cinder.cfg {{(pid=85441) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] QuobyteHD.goodness_function = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] QuobyteHD.iscsi_target_flags = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] QuobyteHD.iscsi_write_cache = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] QuobyteHD.iser_helper = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] QuobyteHD.iser_ip_address = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] QuobyteHD.iser_port = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] QuobyteHD.iser_target_prefix = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] QuobyteHD.nas_host = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] QuobyteHD.nas_login = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] QuobyteHD.nas_mount_options = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] QuobyteHD.nas_password = **** {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] QuobyteHD.nas_private_key = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] QuobyteHD.nas_share_path = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] QuobyteHD.nas_ssh_port = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] QuobyteHD.num_iser_scan_tries = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] QuobyteHD.num_shell_tries = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] QuobyteHD.nvmet_ns_id = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] QuobyteHD.nvmet_port_id = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] QuobyteHD.replication_device = **** {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] QuobyteHD.report_discard_supported = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] QuobyteHD.reserved_percentage = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] QuobyteHD.scst_target_driver = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] QuobyteHD.storage_protocol = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] QuobyteHD.target_helper = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] QuobyteHD.target_ip_address = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] QuobyteHD.target_port = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] QuobyteHD.target_prefix = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] QuobyteHD.target_protocol = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] QuobyteHD.trace_flags = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] QuobyteHD.unique_fqdn_network = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] QuobyteHD.use_chap_auth = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] QuobyteHD.volume_clear = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] QuobyteHD.volume_clear_ionice = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] QuobyteHD.volume_clear_size = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] QuobyteHD.volume_dd_blocksize = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] QuobyteHD.volumes_dir = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack sudo[85447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb -c /etc/quobyte/client-cinder.cfg Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack sudo[85447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] oslo_messaging_rabbit.ssl = False {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] oslo_messaging_rabbit.ssl_version = {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] oslo_messaging_notifications.driver = [] {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] oslo_messaging_notifications.retry = -1 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] oslo_messaging_notifications.transport_url = **** {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] key_manager.fixed_key = **** {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] barbican.barbican_api_version = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] barbican.barbican_endpoint = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] barbican.barbican_endpoint_type = public {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] barbican.barbican_region_name = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] barbican.cafile = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] barbican.certfile = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] barbican.collect_timing = False {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] barbican.insecure = False {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] barbican.keyfile = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] barbican.number_of_retries = 60 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] barbican.retry_delay = 1 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] barbican.send_service_user_token = False {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] barbican.split_loggers = False {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] barbican.timeout = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] barbican.tls_ciphers = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] barbican.tls_min_version = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] barbican.verify_ssl = True {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] barbican.verify_ssl_path = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] barbican_service_user.auth_section = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] barbican_service_user.auth_type = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] barbican_service_user.cafile = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] barbican_service_user.certfile = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] barbican_service_user.collect_timing = False {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] barbican_service_user.insecure = False {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] barbican_service_user.keyfile = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:21 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] barbican_service_user.split_loggers = False {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:22 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] barbican_service_user.timeout = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:22 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] barbican_service_user.tls_ciphers = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:22 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] barbican_service_user.tls_min_version = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:22 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] vault.approle_role_id = **** {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:22 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] vault.approle_secret_id = **** {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:22 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] vault.auth_method = approle {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:22 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] vault.auth_path = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:22 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] vault.kv_mountpoint = secret {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:22 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] vault.kv_path = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:22 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] vault.kv_version = 2 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:22 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] vault.namespace = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:22 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] vault.root_token_id = **** {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:22 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] vault.ssl_ca_crt_file = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:22 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] vault.timeout = 60.0 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:22 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] vault.token_file = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:22 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] vault.token_role = None {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:22 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] vault.use_ssl = False {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:22 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:22 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] ******************************************************************************** {{(pid=85224) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 15 16:15:22 devstack sudo[85447]: pam_unix(sudo:session): session closed for user root Sep 15 16:15:22 devstack cinder-volume[85441]: DEBUG oslo_concurrency.processutils [None req-68e79537-3996-4001-ada1-d48ab136b2bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.413s {{(pid=85441) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:15:22 devstack cinder-volume[85441]: INFO cinder.volume.drivers.quobyte [None req-68e79537-3996-4001-ada1-d48ab136b2bc None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a succeeded Sep 15 16:15:22 devstack cinder-volume[85441]: DEBUG cinder.volume.drivers.quobyte [None req-68e79537-3996-4001-ada1-d48ab136b2bc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=85441) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:15:22 devstack cinder-volume[85441]: DEBUG oslo_concurrency.lockutils [None req-68e79537-3996-4001-ada1-d48ab136b2bc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.430s {{(pid=85441) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:15:22 devstack cinder-volume[85441]: DEBUG oslo_concurrency.processutils [None req-68e79537-3996-4001-ada1-d48ab136b2bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=85441) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:15:22 devstack sudo[85546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:15:22 devstack sudo[85546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:15:22 devstack sudo[85546]: pam_unix(sudo:session): session closed for user root Sep 15 16:15:22 devstack cinder-volume[85441]: DEBUG oslo_concurrency.processutils [None req-68e79537-3996-4001-ada1-d48ab136b2bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.259s {{(pid=85441) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:15:22 devstack cinder-volume[85441]: INFO cinder.volume.driver [None req-68e79537-3996-4001-ada1-d48ab136b2bc None None] Driver hasn't implemented _init_vendor_properties() Sep 15 16:15:22 devstack cinder-volume[85441]: DEBUG cinder.volume.driver [None req-68e79537-3996-4001-ada1-d48ab136b2bc None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.9663772583008, 'free_capacity_gb': 1775.9663772583008, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=85441) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 15 16:15:22 devstack cinder-volume[85441]: DEBUG oslo_db.sqlalchemy.engines [None req-68e79537-3996-4001-ada1-d48ab136b2bc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85441) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 15 16:15:22 devstack cinder-volume[85441]: DEBUG dbcounter [-] [85441] Writer thread running {{(pid=85441) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 15 16:15:22 devstack cinder-volume[85441]: DEBUG cinder.db.api [None req-68e79537-3996-4001-ada1-d48ab136b2bc None None] Building query based on filter {{(pid=85441) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 15 16:15:22 devstack cinder-volume[85441]: DEBUG cinder.image.image_utils [None req-68e79537-3996-4001-ada1-d48ab136b2bc None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=85441) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 15 16:15:22 devstack cinder-volume[85441]: INFO cinder.keymgr.migration [None req-77a7c573-0783-4616-9d5e-e4ed62f54ada None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 15 16:15:22 devstack cinder-volume[85441]: DEBUG oslo_concurrency.lockutils [None req-68e79537-3996-4001-ada1-d48ab136b2bc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85441) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:15:22 devstack cinder-volume[85441]: DEBUG oslo_concurrency.lockutils [None req-68e79537-3996-4001-ada1-d48ab136b2bc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85441) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:15:22 devstack cinder-volume[85441]: DEBUG cinder.volume.drivers.quobyte [None req-68e79537-3996-4001-ada1-d48ab136b2bc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=85441) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:15:22 devstack cinder-volume[85441]: DEBUG cinder.volume.drivers.quobyte [None req-68e79537-3996-4001-ada1-d48ab136b2bc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=85441) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:15:22 devstack cinder-volume[85441]: DEBUG oslo_concurrency.lockutils [None req-68e79537-3996-4001-ada1-d48ab136b2bc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85441) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:15:22 devstack cinder-volume[85441]: DEBUG oslo_concurrency.processutils [None req-68e79537-3996-4001-ada1-d48ab136b2bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=85441) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:15:22 devstack sudo[85549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:15:22 devstack sudo[85549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:15:22 devstack sudo[85549]: pam_unix(sudo:session): session closed for user root Sep 15 16:15:22 devstack cinder-volume[85441]: DEBUG oslo_concurrency.processutils [None req-68e79537-3996-4001-ada1-d48ab136b2bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.237s {{(pid=85441) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:15:23 devstack cinder-volume[85441]: DEBUG cinder.manager [None req-68e79537-3996-4001-ada1-d48ab136b2bc None None] Notifying Schedulers of capabilities ... {{(pid=85441) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:15:23 devstack cinder-volume[85441]: INFO cinder.volume.manager [None req-68e79537-3996-4001-ada1-d48ab136b2bc None None] Driver initialization completed successfully. Sep 15 16:15:23 devstack cinder-volume[85441]: INFO cinder.manager [None req-68e79537-3996-4001-ada1-d48ab136b2bc None None] Initiating service 3 cleanup Sep 15 16:15:23 devstack cinder-volume[85441]: INFO cinder.manager [None req-68e79537-3996-4001-ada1-d48ab136b2bc None None] Service 3 cleanup completed. Sep 15 16:15:23 devstack cinder-volume[85441]: DEBUG cinder.service [None req-68e79537-3996-4001-ada1-d48ab136b2bc None None] Creating RPC server for service cinder-volume {{(pid=85441) start /opt/stack/cinder/cinder/service.py:231}} Sep 15 16:15:23 devstack cinder-volume[85441]: DEBUG cinder.service [None req-68e79537-3996-4001-ada1-d48ab136b2bc None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=85441) start /opt/stack/cinder/cinder/service.py:237}} Sep 15 16:15:23 devstack cinder-volume[85441]: INFO cinder.volume.manager [None req-68e79537-3996-4001-ada1-d48ab136b2bc None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 15 16:15:23 devstack cinder-volume[85441]: DEBUG oslo_concurrency.lockutils [None req-68e79537-3996-4001-ada1-d48ab136b2bc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85441) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:15:23 devstack cinder-volume[85441]: DEBUG oslo_concurrency.lockutils [None req-68e79537-3996-4001-ada1-d48ab136b2bc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85441) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:15:23 devstack cinder-volume[85441]: DEBUG cinder.volume.drivers.quobyte [None req-68e79537-3996-4001-ada1-d48ab136b2bc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=85441) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:15:23 devstack cinder-volume[85441]: DEBUG cinder.volume.drivers.quobyte [None req-68e79537-3996-4001-ada1-d48ab136b2bc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=85441) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:15:23 devstack cinder-volume[85441]: DEBUG oslo_concurrency.lockutils [None req-68e79537-3996-4001-ada1-d48ab136b2bc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=85441) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:15:23 devstack cinder-volume[85441]: DEBUG oslo_concurrency.processutils [None req-68e79537-3996-4001-ada1-d48ab136b2bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=85441) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:15:23 devstack sudo[85552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:15:23 devstack sudo[85552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:15:23 devstack sudo[85552]: pam_unix(sudo:session): session closed for user root Sep 15 16:15:23 devstack cinder-volume[85441]: DEBUG oslo_concurrency.processutils [None req-68e79537-3996-4001-ada1-d48ab136b2bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.261s {{(pid=85441) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:15:23 devstack cinder-volume[85441]: INFO cinder.volume.manager [None req-68e79537-3996-4001-ada1-d48ab136b2bc None None] Driver post RPC initialization completed successfully. Sep 15 16:15:27 devstack cinder-volume[85441]: DEBUG oslo_concurrency.lockutils [None req-03a8dacc-5b6c-4bbc-9d04-afd22922a62d None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85441) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:15:27 devstack cinder-volume[85441]: DEBUG oslo_concurrency.lockutils [None req-03a8dacc-5b6c-4bbc-9d04-afd22922a62d None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85441) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:15:27 devstack cinder-volume[85441]: DEBUG cinder.volume.drivers.quobyte [None req-03a8dacc-5b6c-4bbc-9d04-afd22922a62d None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=85441) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:15:27 devstack cinder-volume[85441]: DEBUG cinder.volume.drivers.quobyte [None req-03a8dacc-5b6c-4bbc-9d04-afd22922a62d None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=85441) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:15:27 devstack cinder-volume[85441]: DEBUG oslo_concurrency.lockutils [None req-03a8dacc-5b6c-4bbc-9d04-afd22922a62d None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85441) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:15:27 devstack cinder-volume[85441]: DEBUG oslo_concurrency.processutils [None req-03a8dacc-5b6c-4bbc-9d04-afd22922a62d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=85441) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:15:27 devstack sudo[85673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:15:27 devstack sudo[85673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:15:28 devstack sudo[85673]: pam_unix(sudo:session): session closed for user root Sep 15 16:15:28 devstack cinder-volume[85441]: DEBUG oslo_concurrency.processutils [None req-03a8dacc-5b6c-4bbc-9d04-afd22922a62d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.232s {{(pid=85441) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:15:28 devstack cinder-volume[85441]: DEBUG cinder.manager [None req-03a8dacc-5b6c-4bbc-9d04-afd22922a62d None None] Notifying Schedulers of capabilities ... {{(pid=85441) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:15:31 devstack cinder-volume[85224]: INFO oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] Caught SIGTERM, stopping children Sep 15 16:15:31 devstack cinder-volume[85224]: DEBUG oslo_concurrency.lockutils [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] Acquiring lock "singleton_lock" {{(pid=85224) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 15 16:15:31 devstack cinder-volume[85224]: DEBUG oslo_concurrency.lockutils [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] Acquired lock "singleton_lock" {{(pid=85224) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 15 16:15:31 devstack cinder-volume[85224]: DEBUG oslo_concurrency.lockutils [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] Releasing lock "singleton_lock" {{(pid=85224) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 15 16:15:31 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] Stop services. {{(pid=85224) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 15 16:15:31 devstack cinder-volume[85224]: DEBUG oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] Killing children. {{(pid=85224) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 15 16:15:31 devstack cinder-volume[85224]: INFO oslo_service.backend._eventlet.service [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] Waiting on 1 children to exit Sep 15 16:15:33 devstack cinder-volume[85441]: DEBUG dbcounter [-] [85441] Writing DB stats cinder:SELECT=3 {{(pid=85441) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 16:15:33 devstack cinder-volume[85441]: DEBUG dbcounter [-] [85441] Writing DB stats cinder:SELECT=9,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=85441) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 16:15:36 devstack cinder-volume[85441]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Sep 15 16:15:36 devstack cinder-volume[85441]: DEBUG oslo_concurrency.lockutils [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] Acquiring lock "singleton_lock" {{(pid=85441) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 15 16:15:36 devstack cinder-volume[85441]: DEBUG oslo_concurrency.lockutils [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] Acquired lock "singleton_lock" {{(pid=85441) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 15 16:15:36 devstack cinder-volume[85441]: DEBUG oslo_concurrency.lockutils [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] Releasing lock "singleton_lock" {{(pid=85441) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 15 16:15:36 devstack cinder-volume[85441]: WARNING amqp [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 15 16:15:36 devstack cinder-volume[85441]: WARNING amqp [None req-4c12c42a-e6ed-41ca-b67f-20dbb02d7b5d None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 15 16:15:36 devstack cinder-volume[85789]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 15 16:15:36 devstack cinder-volume[85789]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 15 16:15:36 devstack cinder-volume[85789]: we strongly recommend against using it for new projects. Sep 15 16:15:36 devstack cinder-volume[85789]: If you are already using Eventlet, we recommend migrating to a different Sep 15 16:15:36 devstack cinder-volume[85789]: framework. For more detail see Sep 15 16:15:36 devstack cinder-volume[85789]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 15 16:15:36 devstack cinder-volume[85789]: import eventlet # noqa Sep 15 16:15:39 devstack cinder-volume[85789]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85789) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 15 16:15:39 devstack cinder-volume[85789]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85789) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 15 16:15:39 devstack cinder-volume[85789]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85789) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 15 16:15:39 devstack cinder-volume[85789]: INFO dbcounter [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] Registered counter for database cinder Sep 15 16:15:39 devstack cinder-volume[85789]: DEBUG oslo_db.sqlalchemy.engines [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85789) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG dbcounter [-] [85789] Writer thread running {{(pid=85789) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 15 16:15:40 devstack cinder-volume[85789]: INFO cinder.rpc [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 15 16:15:40 devstack cinder-volume[85789]: INFO cinder.rpc [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_db.sqlalchemy.engines [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85789) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 15 16:15:40 devstack cinder-volume[85789]: INFO cinder.volume.manager [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] Determined volume DB was empty at startup. Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG cinder.volume.manager [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85789) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 15 16:15:40 devstack cinder-volume[85789]: WARNING stevedore.named [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 15 16:15:40 devstack cinder-volume[85789]: WARNING castellan.key_manager [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 15 16:15:40 devstack cinder-volume[85789]: WARNING cinder.keymgr.conf_key_mgr [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 15 16:15:40 devstack cinder-volume[85789]: INFO cinder.volume.manager [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_db.sqlalchemy.engines [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85789) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 15 16:15:40 devstack cinder-volume[85789]: INFO oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] Starting 1 workers Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] Started child 86082 {{(pid=85789) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] Full set of CONF: {{(pid=85789) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] ******************************************************************************** {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] Configuration options gathered from: {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] ================================================================================ {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] allow_availability_zone_fallback = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] allow_compression_on_image_upload = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] allowed_direct_url_schemes = [] {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[86082]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] api_rate_limit = True {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] auth_strategy = keystone {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] backend_availability_zone = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] backend_host = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] backend_name = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] backend_stats_polling_interval = 60 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] backup_api_class = cinder.backup.api.API {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] backup_name_template = backup-%s {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] backup_use_same_host = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] backup_use_temp_snapshot = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] chap_password = **** {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] chap_username = {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] cinder_internal_tenant_project_id = bab006bd62bd4f3d8fe504a9633e7966 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] cinder_internal_tenant_user_id = 1b3ee3422beb43a49b7426d0c23aa86b {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] cluster = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] compression_format = gzip {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] compute_api_class = cinder.compute.nova.API {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] config_dir = [] {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] config_source = [] {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] control_exchange = openstack {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] debug = True {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] default_availability_zone = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] default_group_type = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] default_volume_type = QuobyteHD {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] disk_geometry = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] driver_client_cert = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] driver_client_cert_key = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] driver_data_namespace = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] driver_ssl_cert_path = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] driver_ssl_cert_verify = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] driver_use_ssl = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] enable_new_services = True {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] enable_unsupported_driver = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] enabled_backends = ['QuobyteHD'] {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] enforce_multipath_for_image_xfer = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] filter_function = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] glance_api_insecure = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] glance_api_servers = ['http://192.168.122.195/image'] {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] glance_api_ssl_compression = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] glance_ca_certificates_file = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] glance_catalog_info = image:glance:publicURL {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] glance_certfile = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] glance_keyfile = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] glance_num_retries = 3 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] glance_request_timeout = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] goodness_function = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] graceful_shutdown_timeout = 5 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] group_api_class = cinder.group.api.API {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] host = devstack {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] image_compress_on_upload = True {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] image_conversion_address_space_limit = 1 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] image_conversion_cpu_limit = 60 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] image_conversion_disable = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] image_introspection_address_space_limit = 1 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] image_introspection_cpu_limit = 60 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] image_upload_use_cinder_backend = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] image_upload_use_internal_tenant = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] image_volume_cache_enabled = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] image_volume_cache_max_count = 0 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] image_volume_cache_max_size_gb = 0 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] init_host_max_objects_retrieval = 0 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] instance_format = [instance: %(uuid)s] {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] iscsi_target_flags = {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] iscsi_write_cache = on {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] iser_helper = tgtadm {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] iser_ip_address = 192.168.122.195 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] iser_port = 3260 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] log_color = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] log_config_append = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] log_dir = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] log_file = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] log_options = True {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] log_rotate_interval = 1 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] log_rotate_interval_type = days {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] log_rotation_type = none {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] max_age = 0 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] max_logfile_count = 30 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] max_logfile_size_mb = 200 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] max_over_subscription_ratio = 20.0 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] message_reap_interval = 86400 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] message_ttl = 2592000 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] migration_create_volume_timeout_secs = 300 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] monkey_patch = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] monkey_patch_modules = [] {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] my_ip = 192.168.122.195 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] no_snapshot_gb_quota = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-4fb6901f-6638-4f98-9758-a3496f4c906e None None] Starting volume driver QuobyteDriver (1.2.1) Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] num_iser_scan_tries = 3 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-4fb6901f-6638-4f98-9758-a3496f4c906e None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86082) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] num_shell_tries = 3 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] num_volume_device_scan_tries = 3 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] nvmeof_conn_info_version = 1 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] nvmet_ns_id = 10 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] nvmet_port_id = 1 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] osapi_max_limit = 1000 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] osapi_volume_ext_list = [] {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] osapi_volume_listen = 0.0.0.0 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] osapi_volume_listen_port = 8776 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] osapi_volume_use_ssl = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] osapi_volume_workers = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] per_volume_size_limit = -1 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] periodic_fuzzy_delay = 60 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] periodic_interval = 60 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] project_id_regex = [0-9a-f\-]+ {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] public_endpoint = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] publish_errors = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] quota_backup_gigabytes = 1000 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] quota_backups = 10 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] quota_gigabytes = 1000 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] quota_groups = 10 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] quota_snapshots = 10 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] quota_volumes = 10 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] rate_limit_burst = 0 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] rate_limit_except_level = CRITICAL {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] rate_limit_interval = 0 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] reinit_driver_count = 3 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] replication_device = **** {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] report_discard_supported = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] report_interval = 120 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] reservation_clean_interval = 86400 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] reservation_expire = 86400 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] reserved_image_namespaces = [] {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] reserved_percentage = 0 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] rpc_response_timeout = 120 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] run_external_periodic_tasks = True {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] scst_target_driver = iscsi {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] scst_target_iqn_name = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] service_down_time = 720 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] shell_completion = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] snapshot_name_template = snapshot-%s {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] split_loggers = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] state_path = /opt/stack/data/cinder {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] storage_availability_zone = nova {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] storage_protocol = iSCSI {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] syslog_log_facility = LOG_USER {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] target_helper = lioadm {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] target_ip_address = 192.168.122.195 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] target_port = 3260 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] target_protocol = iscsi {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] target_secondary_ip_addresses = [] {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] trace_flags = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] transfer_api_class = cinder.transfer.api.API {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] transport_url = **** {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] until_refresh = 0 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] use_chap_auth = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] use_default_quota_class = True {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] use_journal = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] use_json = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] use_multipath_for_image_xfer = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] use_stderr = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] use_syslog = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] verify_glance_signatures = enabled {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] volume_api_class = cinder.volume.api.API {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] volume_backend_name = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] volume_clear = zero {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] volume_clear_ionice = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] volume_clear_size = 0 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] volume_copy_bps_limit = 0 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] volume_dd_blocksize = 1M {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] volume_name_template = volume-%s {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] volume_service_inithost_offload = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] volume_usage_audit_period = month {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] zoning_mode = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] oslo_concurrency.disable_process_locking = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] keystone_authtoken.auth_section = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] keystone_authtoken.auth_type = password {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] keystone_authtoken.auth_version = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] keystone_authtoken.cache = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] keystone_authtoken.certfile = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] keystone_authtoken.delay_auth_decision = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] keystone_authtoken.http_connect_timeout = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] keystone_authtoken.include_service_catalog = True {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] keystone_authtoken.insecure = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] keystone_authtoken.interface = public {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] keystone_authtoken.keyfile = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] keystone_authtoken.memcache_password = **** {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-4fb6901f-6638-4f98-9758-a3496f4c906e None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86082) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 15 16:15:40 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.quobyte [None req-4fb6901f-6638-4f98-9758-a3496f4c906e None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 15 16:15:40 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.quobyte [None req-4fb6901f-6638-4f98-9758-a3496f4c906e None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] keystone_authtoken.memcache_username = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] keystone_authtoken.region_name = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] keystone_authtoken.service_token_roles_required = True {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] keystone_authtoken.service_type = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] keystone_authtoken.token_cache_time = 300 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.195/identity {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] cache.backend = dogpile.cache.null {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4fb6901f-6638-4f98-9758-a3496f4c906e None None] Running cmd (subprocess): mount.quobyte {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] cache.backend_argument = **** {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] cache.backend_expiration_time = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] cache.config_prefix = cache.oslo {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] cache.debug_cache_backend = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] cache.enable_retry_client = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] cache.enable_socket_keepalive = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] cache.enabled = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] cache.expiration_time = 600 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] cache.hashclient_retry_attempts = 2 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] cache.memcache_dead_retry = 300 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] cache.memcache_pool_maxsize = 10 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] cache.memcache_sasl_enabled = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] cache.password = **** {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] cache.proxies = [] {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] cache.redis_db = 0 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] cache.redis_sentinel_service_name = mymaster {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] cache.redis_server = localhost:6379 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] cache.retry_attempts = 2 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] cache.retry_delay = 0.0 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] cache.socket_keepalive_count = 1 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] cache.socket_keepalive_idle = 1 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] cache.socket_keepalive_interval = 1 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] cache.socket_timeout = 1.0 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] cache.tls_allowed_ciphers = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] cache.tls_cafile = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] cache.tls_certfile = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] cache.tls_enabled = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] cache.tls_keyfile = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] cache.username = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] coordination.backend_url = **** {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] database.asyncio_connection = **** {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] database.asyncio_slave_connection = **** {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] database.backend = sqlalchemy {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] database.connection = **** {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] database.connection_debug = 0 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] database.connection_parameters = {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] database.connection_recycle_time = 3600 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] database.connection_trace = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] database.db_inc_retry_interval = True {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] database.db_max_retries = 20 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] database.db_max_retry_interval = 10 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] database.db_retry_interval = 1 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] database.max_overflow = 50 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] database.max_pool_size = 5 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] database.max_retries = 10 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] database.mysql_wsrep_sync_wait = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] database.pool_timeout = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] database.retry_interval = 10 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] database.slave_connection = **** {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] database.sqlite_synchronous = True {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] database.synchronous_reader = True {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] database.use_db_reconnect = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] oslo_messaging_tracing.insecure = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] profiler.connection_string = messaging:// {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] profiler.enabled = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] profiler.es_doc_type = notification {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] profiler.es_scroll_size = 10000 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] profiler.es_scroll_time = 2m {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] profiler.filter_error_trace = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] profiler.hmac_keys = **** {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] profiler.sentinel_service_name = mymaster {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] profiler.socket_timeout = 0.1 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] profiler.trace_requests = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] profiler.trace_sqlalchemy = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] profiler_jaeger.process_tags = {} {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] profiler_jaeger.service_name_prefix = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] profiler_otlp.service_name_prefix = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] oslo_policy.enforce_new_defaults = True {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] oslo_policy.policy_default_rule = default {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] oslo_policy.policy_file = policy.yaml {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] oslo_policy.remote_timeout = 60.0 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] privsep_osbrick.group = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] privsep_osbrick.helper_command = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] privsep_osbrick.user = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] cinder_sys_admin.group = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] cinder_sys_admin.helper_command = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] cinder_sys_admin.user = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] service_user.auth_section = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] service_user.auth_type = password {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] service_user.cafile = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] service_user.certfile = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] service_user.collect_timing = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] service_user.insecure = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] service_user.keyfile = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] service_user.send_service_user_token = True {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] service_user.split_loggers = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] service_user.timeout = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] service_user.tls_ciphers = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] service_user.tls_min_version = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] glance.auth_section = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] glance.auth_type = password {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] glance.certfile = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] glance.collect_timing = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] glance.insecure = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] glance.keyfile = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] glance.region_name = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] glance.split_loggers = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] glance.timeout = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] glance.tls_ciphers = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] glance.tls_min_version = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] backend_defaults.backend_availability_zone = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] backend_defaults.chap_password = **** {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] backend_defaults.chap_username = {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack quobyte-client[86091]: Reading configuration file: /etc/quobyte/client.cfg Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] backend_defaults.disk_geometry = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack quobyte-client[86091]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 15 16:15:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4fb6901f-6638-4f98-9758-a3496f4c906e None None] CMD "mount.quobyte" returned: 1 in 0.077s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] backend_defaults.driver_client_cert = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-4fb6901f-6638-4f98-9758-a3496f4c906e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] backend_defaults.driver_client_cert_key = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] backend_defaults.driver_data_namespace = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] backend_defaults.driver_use_ssl = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] backend_defaults.enable_unsupported_driver = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-4fb6901f-6638-4f98-9758-a3496f4c906e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] backend_defaults.extra_capabilities = {} {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-4fb6901f-6638-4f98-9758-a3496f4c906e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] backend_defaults.filter_function = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] backend_defaults.goodness_function = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] backend_defaults.iscsi_target_flags = {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] backend_defaults.iscsi_write_cache = on {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] backend_defaults.iser_helper = tgtadm {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] backend_defaults.iser_ip_address = 192.168.122.195 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] backend_defaults.iser_port = 3260 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] backend_defaults.nas_host = {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] backend_defaults.nas_login = admin {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] backend_defaults.nas_mount_options = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] backend_defaults.nas_password = **** {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] backend_defaults.nas_private_key = {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-4fb6901f-6638-4f98-9758-a3496f4c906e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] backend_defaults.nas_share_path = {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-4fb6901f-6638-4f98-9758-a3496f4c906e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] backend_defaults.nas_ssh_port = 22 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4fb6901f-6638-4f98-9758-a3496f4c906e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] backend_defaults.num_shell_tries = 3 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] backend_defaults.nvmet_port_id = 1 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] backend_defaults.quobyte_client_cfg = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] backend_defaults.quobyte_volume_url = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] backend_defaults.replication_device = **** {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] backend_defaults.report_discard_supported = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] backend_defaults.reserved_percentage = 0 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] backend_defaults.scst_target_driver = iscsi {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] backend_defaults.scst_target_iqn_name = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] backend_defaults.storage_protocol = iSCSI {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] backend_defaults.target_helper = tgtadm {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] backend_defaults.target_ip_address = 192.168.122.195 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] backend_defaults.target_port = 3260 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] backend_defaults.target_protocol = iscsi {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] backend_defaults.trace_flags = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] backend_defaults.unique_fqdn_network = True {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] backend_defaults.use_chap_auth = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] backend_defaults.volume_backend_name = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] backend_defaults.volume_clear = zero {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] backend_defaults.volume_clear_ionice = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] backend_defaults.volume_clear_size = 0 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] oslo_reports.file_event_handler = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] oslo_reports.log_dir = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] QuobyteHD.backend_availability_zone = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] QuobyteHD.backend_host = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] QuobyteHD.chap_password = **** {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] QuobyteHD.chap_username = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] QuobyteHD.chiscsi_conf = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] QuobyteHD.disk_geometry = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] QuobyteHD.driver_client_cert = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] QuobyteHD.driver_client_cert_key = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] QuobyteHD.driver_data_namespace = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] QuobyteHD.driver_use_ssl = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] QuobyteHD.extra_capabilities = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] QuobyteHD.filter_function = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] QuobyteHD.goodness_function = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack sudo[86095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] QuobyteHD.iscsi_target_flags = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] QuobyteHD.iscsi_write_cache = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack sudo[86095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] QuobyteHD.iser_helper = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] QuobyteHD.iser_ip_address = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] QuobyteHD.iser_port = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] QuobyteHD.iser_target_prefix = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] QuobyteHD.nas_host = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] QuobyteHD.nas_login = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] QuobyteHD.nas_mount_options = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] QuobyteHD.nas_password = **** {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] QuobyteHD.nas_private_key = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] QuobyteHD.nas_share_path = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] QuobyteHD.nas_ssh_port = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] QuobyteHD.num_shell_tries = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] QuobyteHD.nvmet_ns_id = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] QuobyteHD.nvmet_port_id = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] QuobyteHD.replication_device = **** {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] QuobyteHD.report_discard_supported = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] QuobyteHD.reserved_percentage = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] QuobyteHD.scst_target_driver = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] QuobyteHD.storage_protocol = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] QuobyteHD.target_helper = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] QuobyteHD.target_ip_address = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] QuobyteHD.target_port = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] QuobyteHD.target_prefix = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] QuobyteHD.target_protocol = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] QuobyteHD.trace_flags = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] QuobyteHD.unique_fqdn_network = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] QuobyteHD.use_chap_auth = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] QuobyteHD.volume_clear = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] QuobyteHD.volume_clear_ionice = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] QuobyteHD.volume_clear_size = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] QuobyteHD.volumes_dir = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] oslo_messaging_rabbit.ssl = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] oslo_messaging_rabbit.ssl_version = {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] oslo_messaging_notifications.driver = [] {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] oslo_messaging_notifications.retry = -1 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] oslo_messaging_notifications.transport_url = **** {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] key_manager.fixed_key = **** {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] barbican.barbican_api_version = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] barbican.barbican_endpoint = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] barbican.barbican_endpoint_type = public {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] barbican.barbican_region_name = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] barbican.cafile = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] barbican.certfile = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] barbican.collect_timing = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] barbican.insecure = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] barbican.keyfile = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] barbican.number_of_retries = 60 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] barbican.retry_delay = 1 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] barbican.send_service_user_token = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] barbican.split_loggers = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] barbican.timeout = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] barbican.tls_ciphers = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] barbican.tls_min_version = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] barbican.verify_ssl = True {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] barbican.verify_ssl_path = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] barbican_service_user.auth_section = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] barbican_service_user.auth_type = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] barbican_service_user.cafile = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] barbican_service_user.certfile = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] barbican_service_user.collect_timing = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] barbican_service_user.insecure = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] barbican_service_user.keyfile = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] barbican_service_user.split_loggers = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] barbican_service_user.timeout = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] barbican_service_user.tls_ciphers = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] barbican_service_user.tls_min_version = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] vault.approle_role_id = **** {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] vault.approle_secret_id = **** {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] vault.auth_method = approle {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] vault.auth_path = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] vault.kv_mountpoint = secret {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] vault.kv_path = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] vault.kv_version = 2 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] vault.namespace = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] vault.root_token_id = **** {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] vault.ssl_ca_crt_file = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] vault.timeout = 60.0 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] vault.token_file = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] vault.token_role = None {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] vault.use_ssl = False {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 15 16:15:40 devstack cinder-volume[85789]: DEBUG oslo_service.backend._eventlet.service [None req-9aeb9849-3fb9-46ec-abe9-996af2fb5e19 None None] ******************************************************************************** {{(pid=85789) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 15 16:15:40 devstack sudo[86095]: pam_unix(sudo:session): session closed for user root Sep 15 16:15:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4fb6901f-6638-4f98-9758-a3496f4c906e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.257s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:15:40 devstack cinder-volume[86082]: INFO cinder.volume.driver [None req-4fb6901f-6638-4f98-9758-a3496f4c906e None None] Driver hasn't implemented _init_vendor_properties() Sep 15 16:15:40 devstack cinder-volume[86082]: DEBUG cinder.volume.driver [None req-4fb6901f-6638-4f98-9758-a3496f4c906e None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.9663772583008, 'free_capacity_gb': 1775.9663772583008, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86082) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 15 16:15:41 devstack cinder-volume[86082]: DEBUG oslo_db.sqlalchemy.engines [None req-4fb6901f-6638-4f98-9758-a3496f4c906e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86082) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 15 16:15:41 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writer thread running {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 15 16:15:41 devstack cinder-volume[86082]: DEBUG cinder.db.api [None req-4fb6901f-6638-4f98-9758-a3496f4c906e None None] Building query based on filter {{(pid=86082) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 15 16:15:41 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-4fb6901f-6638-4f98-9758-a3496f4c906e None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86082) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 15 16:15:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-4fb6901f-6638-4f98-9758-a3496f4c906e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:15:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-4fb6901f-6638-4f98-9758-a3496f4c906e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:15:41 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-4fb6901f-6638-4f98-9758-a3496f4c906e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:15:41 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-4fb6901f-6638-4f98-9758-a3496f4c906e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:15:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-4fb6901f-6638-4f98-9758-a3496f4c906e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:15:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4fb6901f-6638-4f98-9758-a3496f4c906e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:15:41 devstack cinder-volume[86082]: INFO cinder.keymgr.migration [None req-83d386ba-2194-4798-b2f8-c9ace225bb12 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 15 16:15:41 devstack sudo[86106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:15:41 devstack sudo[86106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:15:41 devstack sudo[86106]: pam_unix(sudo:session): session closed for user root Sep 15 16:15:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4fb6901f-6638-4f98-9758-a3496f4c906e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.248s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:15:41 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-4fb6901f-6638-4f98-9758-a3496f4c906e None None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:15:41 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-4fb6901f-6638-4f98-9758-a3496f4c906e None None] Driver initialization completed successfully. Sep 15 16:15:41 devstack cinder-volume[86082]: INFO cinder.manager [None req-4fb6901f-6638-4f98-9758-a3496f4c906e None None] Initiating service 3 cleanup Sep 15 16:15:41 devstack cinder-volume[86082]: INFO cinder.manager [None req-4fb6901f-6638-4f98-9758-a3496f4c906e None None] Service 3 cleanup completed. Sep 15 16:15:41 devstack cinder-volume[86082]: DEBUG cinder.service [None req-4fb6901f-6638-4f98-9758-a3496f4c906e None None] Creating RPC server for service cinder-volume {{(pid=86082) start /opt/stack/cinder/cinder/service.py:231}} Sep 15 16:15:41 devstack cinder-volume[86082]: DEBUG cinder.service [None req-4fb6901f-6638-4f98-9758-a3496f4c906e None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86082) start /opt/stack/cinder/cinder/service.py:237}} Sep 15 16:15:41 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-4fb6901f-6638-4f98-9758-a3496f4c906e None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 15 16:15:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-4fb6901f-6638-4f98-9758-a3496f4c906e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:15:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-4fb6901f-6638-4f98-9758-a3496f4c906e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:15:41 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-4fb6901f-6638-4f98-9758-a3496f4c906e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:15:41 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-4fb6901f-6638-4f98-9758-a3496f4c906e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:15:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-4fb6901f-6638-4f98-9758-a3496f4c906e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:15:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4fb6901f-6638-4f98-9758-a3496f4c906e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:15:41 devstack sudo[86117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:15:41 devstack sudo[86117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:15:41 devstack sudo[86117]: pam_unix(sudo:session): session closed for user root Sep 15 16:15:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4fb6901f-6638-4f98-9758-a3496f4c906e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.246s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:15:41 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-4fb6901f-6638-4f98-9758-a3496f4c906e None None] Driver post RPC initialization completed successfully. Sep 15 16:15:50 devstack cinder-volume[85789]: DEBUG dbcounter [-] [85789] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=85789) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 16:15:51 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:SELECT=2 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 16:15:51 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 16:15:59 devstack cinder-volume[86082]: DEBUG oslo_service.periodic_task [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Running periodic task VolumeManager._thread_info {{(pid=86082) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 15 16:15:59 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] thread count: 6 {{(pid=86082) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 15 16:15:59 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] thread info: [<_MainThread(MainThread, started 124875935469696)>, , , , , ] {{(pid=86082) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 15 16:16:54 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-579f4a5b-790a-4cab-af2e-45c83756a4bc tempest-DeleteServersTestJSON-940325187 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:16:54 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-579f4a5b-790a-4cab-af2e-45c83756a4bc tempest-DeleteServersTestJSON-940325187 None] Flow 'volume_create_manager' (b26f1f62-e4d4-4ae1-91ae-b91f9ba450a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:16:54 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-579f4a5b-790a-4cab-af2e-45c83756a4bc tempest-DeleteServersTestJSON-940325187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4105328b-60cb-4b18-bbee-641671692554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:16:55 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-579f4a5b-790a-4cab-af2e-45c83756a4bc tempest-DeleteServersTestJSON-940325187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4105328b-60cb-4b18-bbee-641671692554) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:16:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-49367257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21fb528a-cdcf-419e-b97e-3735f260fe3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a23da5dc708a4cdaba3c9476ce2a7fe4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:16:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:16:54Z,use_quota=True,user_id='6431d9aab4104772ac986a50ecff5593',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:16:55 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-579f4a5b-790a-4cab-af2e-45c83756a4bc tempest-DeleteServersTestJSON-940325187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (202cc222-030f-457d-a7b0-b33e08fb39be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:16:55 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-579f4a5b-790a-4cab-af2e-45c83756a4bc tempest-DeleteServersTestJSON-940325187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (202cc222-030f-457d-a7b0-b33e08fb39be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:16:55 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-579f4a5b-790a-4cab-af2e-45c83756a4bc tempest-DeleteServersTestJSON-940325187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a3091c9-17c6-4bd1-bd38-7c7e64acb99c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:16:55 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-579f4a5b-790a-4cab-af2e-45c83756a4bc tempest-DeleteServersTestJSON-940325187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a3091c9-17c6-4bd1-bd38-7c7e64acb99c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21fb528a-cdcf-419e-b97e-3735f260fe3e', 'volume_name': 'volume-21fb528a-cdcf-419e-b97e-3735f260fe3e', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:16:55 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-579f4a5b-790a-4cab-af2e-45c83756a4bc tempest-DeleteServersTestJSON-940325187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e28d205-e2e3-4ff9-a0c4-7c044171622f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:16:55 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-579f4a5b-790a-4cab-af2e-45c83756a4bc tempest-DeleteServersTestJSON-940325187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e28d205-e2e3-4ff9-a0c4-7c044171622f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:16:55 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-579f4a5b-790a-4cab-af2e-45c83756a4bc tempest-DeleteServersTestJSON-940325187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1474baec-40ac-4ea8-ba84-48e717fda5aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:16:55 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-579f4a5b-790a-4cab-af2e-45c83756a4bc tempest-DeleteServersTestJSON-940325187 None] Volume 21fb528a-cdcf-419e-b97e-3735f260fe3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21fb528a-cdcf-419e-b97e-3735f260fe3e', 'volume_size': 1} Sep 15 16:16:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-579f4a5b-790a-4cab-af2e-45c83756a4bc tempest-DeleteServersTestJSON-940325187 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:16:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-579f4a5b-790a-4cab-af2e-45c83756a4bc tempest-DeleteServersTestJSON-940325187 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:16:55 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-579f4a5b-790a-4cab-af2e-45c83756a4bc tempest-DeleteServersTestJSON-940325187 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:16:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-49367257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21fb528a-cdcf-419e-b97e-3735f260fe3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a23da5dc708a4cdaba3c9476ce2a7fe4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:16:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:16:54Z,use_quota=True,user_id='6431d9aab4104772ac986a50ecff5593',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:16:55 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-579f4a5b-790a-4cab-af2e-45c83756a4bc tempest-DeleteServersTestJSON-940325187 None] Creating volume 21fb528a-cdcf-419e-b97e-3735f260fe3e {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:16:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-579f4a5b-790a-4cab-af2e-45c83756a4bc tempest-DeleteServersTestJSON-940325187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:16:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-579f4a5b-790a-4cab-af2e-45c83756a4bc tempest-DeleteServersTestJSON-940325187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:16:55 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-579f4a5b-790a-4cab-af2e-45c83756a4bc tempest-DeleteServersTestJSON-940325187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:16:55 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-579f4a5b-790a-4cab-af2e-45c83756a4bc tempest-DeleteServersTestJSON-940325187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:16:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-579f4a5b-790a-4cab-af2e-45c83756a4bc tempest-DeleteServersTestJSON-940325187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:16:55 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-579f4a5b-790a-4cab-af2e-45c83756a4bc tempest-DeleteServersTestJSON-940325187 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:16:55 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-579f4a5b-790a-4cab-af2e-45c83756a4bc tempest-DeleteServersTestJSON-940325187 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:16:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-579f4a5b-790a-4cab-af2e-45c83756a4bc tempest-DeleteServersTestJSON-940325187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-21fb528a-cdcf-419e-b97e-3735f260fe3e 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:16:55 devstack sudo[86775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-21fb528a-cdcf-419e-b97e-3735f260fe3e 1073741824 Sep 15 16:16:55 devstack sudo[86775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:16:56 devstack sudo[86775]: pam_unix(sudo:session): session closed for user root Sep 15 16:16:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-579f4a5b-790a-4cab-af2e-45c83756a4bc tempest-DeleteServersTestJSON-940325187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-21fb528a-cdcf-419e-b97e-3735f260fe3e 1073741824" returned: 0 in 1.473s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:16:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-579f4a5b-790a-4cab-af2e-45c83756a4bc tempest-DeleteServersTestJSON-940325187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-21fb528a-cdcf-419e-b97e-3735f260fe3e {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:16:56 devstack sudo[87105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-21fb528a-cdcf-419e-b97e-3735f260fe3e Sep 15 16:16:56 devstack sudo[87105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:16:57 devstack sudo[87105]: pam_unix(sudo:session): session closed for user root Sep 15 16:16:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-579f4a5b-790a-4cab-af2e-45c83756a4bc tempest-DeleteServersTestJSON-940325187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-21fb528a-cdcf-419e-b97e-3735f260fe3e" returned: 0 in 0.627s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:16:57 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-579f4a5b-790a-4cab-af2e-45c83756a4bc tempest-DeleteServersTestJSON-940325187 None] <== create_volume: return (2310ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:16:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-579f4a5b-790a-4cab-af2e-45c83756a4bc tempest-DeleteServersTestJSON-940325187 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.315s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:16:57 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-579f4a5b-790a-4cab-af2e-45c83756a4bc tempest-DeleteServersTestJSON-940325187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1474baec-40ac-4ea8-ba84-48e717fda5aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21fb528a-cdcf-419e-b97e-3735f260fe3e', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:16:57 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-579f4a5b-790a-4cab-af2e-45c83756a4bc tempest-DeleteServersTestJSON-940325187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13250032-e04f-4904-b243-218b40cc652b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:16:57 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-579f4a5b-790a-4cab-af2e-45c83756a4bc tempest-DeleteServersTestJSON-940325187 None] Volume volume-21fb528a-cdcf-419e-b97e-3735f260fe3e (21fb528a-cdcf-419e-b97e-3735f260fe3e): created successfully Sep 15 16:16:57 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-579f4a5b-790a-4cab-af2e-45c83756a4bc tempest-DeleteServersTestJSON-940325187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13250032-e04f-4904-b243-218b40cc652b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:16:57 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-579f4a5b-790a-4cab-af2e-45c83756a4bc tempest-DeleteServersTestJSON-940325187 None] Flow 'volume_create_manager' (b26f1f62-e4d4-4ae1-91ae-b91f9ba450a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:16:57 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-579f4a5b-790a-4cab-af2e-45c83756a4bc tempest-DeleteServersTestJSON-940325187 None] Created volume successfully. Sep 15 16:16:59 devstack cinder-volume[86082]: DEBUG oslo_service.periodic_task [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86082) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 15 16:16:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:16:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:16:59 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:16:59 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:16:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:16:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:16:59 devstack sudo[87159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:16:59 devstack sudo[87159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:17:00 devstack sudo[87159]: pam_unix(sudo:session): session closed for user root Sep 15 16:17:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.498s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:17:00 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:17:00 devstack cinder-volume[86082]: DEBUG oslo_service.periodic_task [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Running periodic task VolumeManager._thread_info {{(pid=86082) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 15 16:17:00 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] thread count: 6 {{(pid=86082) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 15 16:17:00 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] thread info: [<_MainThread(MainThread, started 124875935469696)>, , , , , ] {{(pid=86082) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 15 16:17:02 devstack cinder-volume[86082]: WARNING py.warnings [req-7154eb34-5f99-4bcb-9484-d343d8a6c262 req-8ecf5990-a7c6-48e7-b0d0-6c02bb2a36d9 tempest-DeleteServersTestJSON-940325187 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Sep 15 16:17:02 devstack cinder-volume[86082]: .first() Sep 15 16:17:02 devstack cinder-volume[86082]: Sep 15 16:17:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-7154eb34-5f99-4bcb-9484-d343d8a6c262 req-8ecf5990-a7c6-48e7-b0d0-6c02bb2a36d9 tempest-DeleteServersTestJSON-940325187 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:17:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-7154eb34-5f99-4bcb-9484-d343d8a6c262 req-8ecf5990-a7c6-48e7-b0d0-6c02bb2a36d9 tempest-DeleteServersTestJSON-940325187 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:17:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-7154eb34-5f99-4bcb-9484-d343d8a6c262 req-8ecf5990-a7c6-48e7-b0d0-6c02bb2a36d9 tempest-DeleteServersTestJSON-940325187 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:17:03 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-7154eb34-5f99-4bcb-9484-d343d8a6c262 req-8ecf5990-a7c6-48e7-b0d0-6c02bb2a36d9 tempest-DeleteServersTestJSON-940325187 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a', 'name': 'volume-21fb528a-cdcf-419e-b97e-3735f260fe3e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '622b2cec-4e7e-4aee-a9fa-295fb5659c2a', 'enforce_multipath': True} {{(pid=86082) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 15 16:17:03 devstack cinder-volume[86082]: INFO cinder.volume.manager [req-7154eb34-5f99-4bcb-9484-d343d8a6c262 req-8ecf5990-a7c6-48e7-b0d0-6c02bb2a36d9 tempest-DeleteServersTestJSON-940325187 None] attachment_update completed successfully. Sep 15 16:17:08 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fc68871-e4d9-40e6-b721-1e02c3581442 tempest-VolumesAdminNegativeTest-569011591 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:17:08 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4fc68871-e4d9-40e6-b721-1e02c3581442 tempest-VolumesAdminNegativeTest-569011591 None] Flow 'volume_create_manager' (5cffc5fc-b0bf-47a3-88a2-8730c5391990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:17:08 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4fc68871-e4d9-40e6-b721-1e02c3581442 tempest-VolumesAdminNegativeTest-569011591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfdbf8ea-7d0e-443f-b31f-d62f56572805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:17:08 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4fc68871-e4d9-40e6-b721-1e02c3581442 tempest-VolumesAdminNegativeTest-569011591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfdbf8ea-7d0e-443f-b31f-d62f56572805) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:17:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-443272201',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae2a53e1-9115-47a9-8c76-e572e9ecb64c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78e97eda15624e3c94893cd6d89e1894',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:17:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:17:08Z,use_quota=True,user_id='bc223c9ce43b48e08e2e007e42de72d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:17:08 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4fc68871-e4d9-40e6-b721-1e02c3581442 tempest-VolumesAdminNegativeTest-569011591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12801b41-497c-4cf2-a5ee-034206742541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:17:08 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4fc68871-e4d9-40e6-b721-1e02c3581442 tempest-VolumesAdminNegativeTest-569011591 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12801b41-497c-4cf2-a5ee-034206742541) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:17:08 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4fc68871-e4d9-40e6-b721-1e02c3581442 tempest-VolumesAdminNegativeTest-569011591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f7b3476-1735-464c-966f-8d6a06de9f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:17:08 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4fc68871-e4d9-40e6-b721-1e02c3581442 tempest-VolumesAdminNegativeTest-569011591 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f7b3476-1735-464c-966f-8d6a06de9f9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae2a53e1-9115-47a9-8c76-e572e9ecb64c', 'volume_name': 'volume-ae2a53e1-9115-47a9-8c76-e572e9ecb64c', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:17:08 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4fc68871-e4d9-40e6-b721-1e02c3581442 tempest-VolumesAdminNegativeTest-569011591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (379d2cca-9724-4e52-9e28-6442b416c9f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:17:08 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4fc68871-e4d9-40e6-b721-1e02c3581442 tempest-VolumesAdminNegativeTest-569011591 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (379d2cca-9724-4e52-9e28-6442b416c9f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:17:08 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4fc68871-e4d9-40e6-b721-1e02c3581442 tempest-VolumesAdminNegativeTest-569011591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f100741-f1f4-473e-9a04-826466f07438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:17:08 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-4fc68871-e4d9-40e6-b721-1e02c3581442 tempest-VolumesAdminNegativeTest-569011591 None] Volume ae2a53e1-9115-47a9-8c76-e572e9ecb64c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae2a53e1-9115-47a9-8c76-e572e9ecb64c', 'volume_size': 1} Sep 15 16:17:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-4fc68871-e4d9-40e6-b721-1e02c3581442 tempest-VolumesAdminNegativeTest-569011591 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:17:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-4fc68871-e4d9-40e6-b721-1e02c3581442 tempest-VolumesAdminNegativeTest-569011591 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:17:08 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-4fc68871-e4d9-40e6-b721-1e02c3581442 tempest-VolumesAdminNegativeTest-569011591 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:17:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-443272201',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae2a53e1-9115-47a9-8c76-e572e9ecb64c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78e97eda15624e3c94893cd6d89e1894',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:17:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:17:08Z,use_quota=True,user_id='bc223c9ce43b48e08e2e007e42de72d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:17:08 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-4fc68871-e4d9-40e6-b721-1e02c3581442 tempest-VolumesAdminNegativeTest-569011591 None] Creating volume ae2a53e1-9115-47a9-8c76-e572e9ecb64c {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:17:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-4fc68871-e4d9-40e6-b721-1e02c3581442 tempest-VolumesAdminNegativeTest-569011591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:17:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-4fc68871-e4d9-40e6-b721-1e02c3581442 tempest-VolumesAdminNegativeTest-569011591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:17:08 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-4fc68871-e4d9-40e6-b721-1e02c3581442 tempest-VolumesAdminNegativeTest-569011591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:17:08 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-4fc68871-e4d9-40e6-b721-1e02c3581442 tempest-VolumesAdminNegativeTest-569011591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:17:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-4fc68871-e4d9-40e6-b721-1e02c3581442 tempest-VolumesAdminNegativeTest-569011591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:17:08 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-4fc68871-e4d9-40e6-b721-1e02c3581442 tempest-VolumesAdminNegativeTest-569011591 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:17:08 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-4fc68871-e4d9-40e6-b721-1e02c3581442 tempest-VolumesAdminNegativeTest-569011591 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:17:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4fc68871-e4d9-40e6-b721-1e02c3581442 tempest-VolumesAdminNegativeTest-569011591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ae2a53e1-9115-47a9-8c76-e572e9ecb64c 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:17:08 devstack sudo[87737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ae2a53e1-9115-47a9-8c76-e572e9ecb64c 1073741824 Sep 15 16:17:08 devstack sudo[87737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:17:09 devstack sudo[87737]: pam_unix(sudo:session): session closed for user root Sep 15 16:17:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4fc68871-e4d9-40e6-b721-1e02c3581442 tempest-VolumesAdminNegativeTest-569011591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ae2a53e1-9115-47a9-8c76-e572e9ecb64c 1073741824" returned: 0 in 1.076s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:17:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4fc68871-e4d9-40e6-b721-1e02c3581442 tempest-VolumesAdminNegativeTest-569011591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ae2a53e1-9115-47a9-8c76-e572e9ecb64c {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:17:09 devstack sudo[87787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ae2a53e1-9115-47a9-8c76-e572e9ecb64c Sep 15 16:17:09 devstack sudo[87787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:17:10 devstack sudo[87787]: pam_unix(sudo:session): session closed for user root Sep 15 16:17:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4fc68871-e4d9-40e6-b721-1e02c3581442 tempest-VolumesAdminNegativeTest-569011591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ae2a53e1-9115-47a9-8c76-e572e9ecb64c" returned: 0 in 0.501s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:17:10 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-4fc68871-e4d9-40e6-b721-1e02c3581442 tempest-VolumesAdminNegativeTest-569011591 None] <== create_volume: return (1680ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:17:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-4fc68871-e4d9-40e6-b721-1e02c3581442 tempest-VolumesAdminNegativeTest-569011591 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.693s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:17:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4fc68871-e4d9-40e6-b721-1e02c3581442 tempest-VolumesAdminNegativeTest-569011591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f100741-f1f4-473e-9a04-826466f07438) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae2a53e1-9115-47a9-8c76-e572e9ecb64c', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:17:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4fc68871-e4d9-40e6-b721-1e02c3581442 tempest-VolumesAdminNegativeTest-569011591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61010a3f-6a8f-473a-8bf3-744ca26e9e86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:17:10 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-4fc68871-e4d9-40e6-b721-1e02c3581442 tempest-VolumesAdminNegativeTest-569011591 None] Volume volume-ae2a53e1-9115-47a9-8c76-e572e9ecb64c (ae2a53e1-9115-47a9-8c76-e572e9ecb64c): created successfully Sep 15 16:17:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4fc68871-e4d9-40e6-b721-1e02c3581442 tempest-VolumesAdminNegativeTest-569011591 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61010a3f-6a8f-473a-8bf3-744ca26e9e86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:17:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4fc68871-e4d9-40e6-b721-1e02c3581442 tempest-VolumesAdminNegativeTest-569011591 None] Flow 'volume_create_manager' (5cffc5fc-b0bf-47a3-88a2-8730c5391990) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:17:10 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-4fc68871-e4d9-40e6-b721-1e02c3581442 tempest-VolumesAdminNegativeTest-569011591 None] Created volume successfully. Sep 15 16:17:10 devstack cinder-volume[86082]: INFO cinder.volume.manager [req-56c951b1-8a4f-45ad-94a4-5cad8289c4a3 req-2c16dbad-037d-4841-bfe8-e13853b1105c tempest-DeleteServersTestJSON-940325187 None] Terminate volume connection completed successfully. Sep 15 16:17:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-56c951b1-8a4f-45ad-94a4-5cad8289c4a3 req-2c16dbad-037d-4841-bfe8-e13853b1105c tempest-DeleteServersTestJSON-940325187 None] Deleting attachment 622b2cec-4e7e-4aee-a9fa-295fb5659c2a. {{(pid=86082) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 15 16:17:11 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-964d26a9-5269-409e-8574-47d69dc9dfc6 tempest-DeleteServersTestJSON-940325187 None] Acquiring lock "cinder-21fb528a-cdcf-419e-b97e-3735f260fe3e-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:17:11 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-964d26a9-5269-409e-8574-47d69dc9dfc6 tempest-DeleteServersTestJSON-940325187 None] Lock "cinder-21fb528a-cdcf-419e-b97e-3735f260fe3e-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:17:11 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-964d26a9-5269-409e-8574-47d69dc9dfc6 tempest-DeleteServersTestJSON-940325187 None] Acquiring lock "cinder-quobyte-21fb528a-cdcf-419e-b97e-3735f260fe3e" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:17:11 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-964d26a9-5269-409e-8574-47d69dc9dfc6 tempest-DeleteServersTestJSON-940325187 None] Lock "cinder-quobyte-21fb528a-cdcf-419e-b97e-3735f260fe3e" acquired by "delete_volume" :: waited 0.027s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:17:11 devstack cinder-volume[86082]: INFO oslo.privsep.daemon [None req-964d26a9-5269-409e-8574-47d69dc9dfc6 tempest-DeleteServersTestJSON-940325187 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp009zbeov/privsep.sock'] Sep 15 16:17:11 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-eed1934d-c509-4959-bcd0-87ea6eb7573f tempest-VolumesAdminNegativeTest-569011591 None] Acquiring lock "cinder-ae2a53e1-9115-47a9-8c76-e572e9ecb64c-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:17:11 devstack sudo[87798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp009zbeov/privsep.sock Sep 15 16:17:11 devstack sudo[87798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:17:11 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-eed1934d-c509-4959-bcd0-87ea6eb7573f tempest-VolumesAdminNegativeTest-569011591 None] Lock "cinder-ae2a53e1-9115-47a9-8c76-e572e9ecb64c-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:17:11 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-eed1934d-c509-4959-bcd0-87ea6eb7573f tempest-VolumesAdminNegativeTest-569011591 None] Acquiring lock "cinder-quobyte-ae2a53e1-9115-47a9-8c76-e572e9ecb64c" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:17:11 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-eed1934d-c509-4959-bcd0-87ea6eb7573f tempest-VolumesAdminNegativeTest-569011591 None] Lock "cinder-quobyte-ae2a53e1-9115-47a9-8c76-e572e9ecb64c" acquired by "delete_volume" :: waited 0.024s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:17:12 devstack cinder-volume[86082]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 15 16:17:12 devstack cinder-volume[86082]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 15 16:17:12 devstack cinder-volume[86082]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 15 16:17:12 devstack cinder-volume[86082]: WARNING oslo.privsep.daemon [-] privsep log: Sep 15 16:17:12 devstack cinder-volume[86082]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 15 16:17:12 devstack cinder-volume[86082]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 15 16:17:12 devstack cinder-volume[86082]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 15 16:17:12 devstack cinder-volume[86082]: WARNING oslo.privsep.daemon [-] privsep log: Sep 15 16:17:12 devstack cinder-volume[86082]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 15 16:17:12 devstack sudo[87798]: pam_unix(sudo:session): session closed for user root Sep 15 16:17:12 devstack cinder-volume[86082]: INFO oslo.privsep.daemon [None req-964d26a9-5269-409e-8574-47d69dc9dfc6 tempest-DeleteServersTestJSON-940325187 None] Spawned new privsep daemon via rootwrap Sep 15 16:17:12 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [None req-964d26a9-5269-409e-8574-47d69dc9dfc6 tempest-DeleteServersTestJSON-940325187 None] Accepted privsep connection to /tmp/tmp009zbeov/privsep.sock {{(pid=86082) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 15 16:17:12 devstack cinder-volume[86082]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 15 16:17:12 devstack cinder-volume[86082]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 15 16:17:12 devstack cinder-volume[86082]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 15 16:17:12 devstack cinder-volume[86082]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 87801 Sep 15 16:17:12 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb493469-a2cb-4d58-8125-2e3dbc503d74]: (2,) {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:17:12 devstack cinder-volume[86082]: WARNING oslo_privsep.priv_context [None req-eed1934d-c509-4959-bcd0-87ea6eb7573f tempest-VolumesAdminNegativeTest-569011591 None] privsep daemon already running Sep 15 16:17:12 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bde7ebe-3ddd-4267-ad48-a6da72c1e3dc]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:17:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-eed1934d-c509-4959-bcd0-87ea6eb7573f tempest-VolumesAdminNegativeTest-569011591 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ae2a53e1-9115-47a9-8c76-e572e9ecb64c {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:17:12 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[8064a0ea-fc4f-4893-8a41-9ae684a37424]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:17:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-964d26a9-5269-409e-8574-47d69dc9dfc6 tempest-DeleteServersTestJSON-940325187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-21fb528a-cdcf-419e-b97e-3735f260fe3e {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:17:13 devstack sudo[87804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ae2a53e1-9115-47a9-8c76-e572e9ecb64c Sep 15 16:17:13 devstack sudo[87804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:17:13 devstack sudo[87805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-21fb528a-cdcf-419e-b97e-3735f260fe3e Sep 15 16:17:13 devstack sudo[87805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:17:13 devstack sudo[87804]: pam_unix(sudo:session): session closed for user root Sep 15 16:17:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-eed1934d-c509-4959-bcd0-87ea6eb7573f tempest-VolumesAdminNegativeTest-569011591 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ae2a53e1-9115-47a9-8c76-e572e9ecb64c" returned: 0 in 0.383s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:17:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-eed1934d-c509-4959-bcd0-87ea6eb7573f tempest-VolumesAdminNegativeTest-569011591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ae2a53e1-9115-47a9-8c76-e572e9ecb64c {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:17:13 devstack sudo[87815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ae2a53e1-9115-47a9-8c76-e572e9ecb64c Sep 15 16:17:13 devstack sudo[87815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:17:13 devstack sudo[87805]: pam_unix(sudo:session): session closed for user root Sep 15 16:17:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-964d26a9-5269-409e-8574-47d69dc9dfc6 tempest-DeleteServersTestJSON-940325187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-21fb528a-cdcf-419e-b97e-3735f260fe3e" returned: 0 in 0.421s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:17:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-964d26a9-5269-409e-8574-47d69dc9dfc6 tempest-DeleteServersTestJSON-940325187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-21fb528a-cdcf-419e-b97e-3735f260fe3e {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:17:13 devstack sudo[87817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-21fb528a-cdcf-419e-b97e-3735f260fe3e Sep 15 16:17:13 devstack sudo[87817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:17:13 devstack sudo[87815]: pam_unix(sudo:session): session closed for user root Sep 15 16:17:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-eed1934d-c509-4959-bcd0-87ea6eb7573f tempest-VolumesAdminNegativeTest-569011591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ae2a53e1-9115-47a9-8c76-e572e9ecb64c" returned: 0 in 0.431s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:17:13 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-eed1934d-c509-4959-bcd0-87ea6eb7573f tempest-VolumesAdminNegativeTest-569011591 None] Lock "cinder-quobyte-ae2a53e1-9115-47a9-8c76-e572e9ecb64c" released by "delete_volume" :: held 1.911s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:17:13 devstack cinder-volume[86082]: WARNING cinder.quota [None req-eed1934d-c509-4959-bcd0-87ea6eb7573f tempest-VolumesAdminNegativeTest-569011591 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 15 16:17:13 devstack cinder-volume[86082]: WARNING cinder.quota [None req-eed1934d-c509-4959-bcd0-87ea6eb7573f tempest-VolumesAdminNegativeTest-569011591 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 15 16:17:13 devstack sudo[87817]: pam_unix(sudo:session): session closed for user root Sep 15 16:17:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-964d26a9-5269-409e-8574-47d69dc9dfc6 tempest-DeleteServersTestJSON-940325187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-21fb528a-cdcf-419e-b97e-3735f260fe3e" returned: 0 in 0.537s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:17:13 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-eed1934d-c509-4959-bcd0-87ea6eb7573f tempest-VolumesAdminNegativeTest-569011591 None] Created reservations ['68f4591e-9925-4140-9bde-8c8e56150ae4', 'c3905884-bbaa-4adc-bec7-8ad4c697ee4e', 'd309359d-a4ee-411b-8e08-8ef581c92874', '0a6fcf19-f47e-4f10-bc31-25de68c4195f'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:17:13 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-964d26a9-5269-409e-8574-47d69dc9dfc6 tempest-DeleteServersTestJSON-940325187 None] Lock "cinder-quobyte-21fb528a-cdcf-419e-b97e-3735f260fe3e" released by "delete_volume" :: held 2.236s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:17:14 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-964d26a9-5269-409e-8574-47d69dc9dfc6 tempest-DeleteServersTestJSON-940325187 None] Created reservations ['d3ea39ba-2423-428e-aa8c-891c24bb08c9', '25caa9e5-7b39-41da-8428-9bb03c24209b', '1647ea66-3521-4e2c-8b48-b75f0ded081e', 'a7b25758-9021-47b3-9dfc-24ddc12c90b9'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:17:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-eed1934d-c509-4959-bcd0-87ea6eb7573f tempest-VolumesAdminNegativeTest-569011591 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:17:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-eed1934d-c509-4959-bcd0-87ea6eb7573f tempest-VolumesAdminNegativeTest-569011591 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:17:14 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-eed1934d-c509-4959-bcd0-87ea6eb7573f tempest-VolumesAdminNegativeTest-569011591 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:17:14 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-eed1934d-c509-4959-bcd0-87ea6eb7573f tempest-VolumesAdminNegativeTest-569011591 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:17:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-eed1934d-c509-4959-bcd0-87ea6eb7573f tempest-VolumesAdminNegativeTest-569011591 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:17:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-eed1934d-c509-4959-bcd0-87ea6eb7573f tempest-VolumesAdminNegativeTest-569011591 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:17:14 devstack sudo[87821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:17:14 devstack sudo[87821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:17:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-964d26a9-5269-409e-8574-47d69dc9dfc6 tempest-DeleteServersTestJSON-940325187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:17:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-964d26a9-5269-409e-8574-47d69dc9dfc6 tempest-DeleteServersTestJSON-940325187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:17:14 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-964d26a9-5269-409e-8574-47d69dc9dfc6 tempest-DeleteServersTestJSON-940325187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:17:14 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-964d26a9-5269-409e-8574-47d69dc9dfc6 tempest-DeleteServersTestJSON-940325187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:17:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-964d26a9-5269-409e-8574-47d69dc9dfc6 tempest-DeleteServersTestJSON-940325187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:17:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-964d26a9-5269-409e-8574-47d69dc9dfc6 tempest-DeleteServersTestJSON-940325187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:17:14 devstack sudo[87823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:17:14 devstack sudo[87823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:17:14 devstack sudo[87821]: pam_unix(sudo:session): session closed for user root Sep 15 16:17:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-eed1934d-c509-4959-bcd0-87ea6eb7573f tempest-VolumesAdminNegativeTest-569011591 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.322s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:17:14 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-eed1934d-c509-4959-bcd0-87ea6eb7573f tempest-VolumesAdminNegativeTest-569011591 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:17:14 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-eed1934d-c509-4959-bcd0-87ea6eb7573f tempest-VolumesAdminNegativeTest-569011591 None] Deleted volume successfully. Sep 15 16:17:14 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-eed1934d-c509-4959-bcd0-87ea6eb7573f tempest-VolumesAdminNegativeTest-569011591 None] Lock "cinder-ae2a53e1-9115-47a9-8c76-e572e9ecb64c-delete_volume" released by "delete_volume" :: held 2.682s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:17:14 devstack sudo[87823]: pam_unix(sudo:session): session closed for user root Sep 15 16:17:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-964d26a9-5269-409e-8574-47d69dc9dfc6 tempest-DeleteServersTestJSON-940325187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.302s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:17:14 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-964d26a9-5269-409e-8574-47d69dc9dfc6 tempest-DeleteServersTestJSON-940325187 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:17:14 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-964d26a9-5269-409e-8574-47d69dc9dfc6 tempest-DeleteServersTestJSON-940325187 None] Deleted volume successfully. Sep 15 16:17:14 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-964d26a9-5269-409e-8574-47d69dc9dfc6 tempest-DeleteServersTestJSON-940325187 None] Lock "cinder-21fb528a-cdcf-419e-b97e-3735f260fe3e-delete_volume" released by "delete_volume" :: held 2.897s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:17:22 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3b2d10e-f94f-489f-b069-6a7a17d7c784 tempest-ServerActionsTestOtherA-844381334 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:17:22 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c3b2d10e-f94f-489f-b069-6a7a17d7c784 tempest-ServerActionsTestOtherA-844381334 None] Flow 'volume_create_manager' (0693bad4-9c2d-4a45-af68-4c344385abf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:17:22 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c3b2d10e-f94f-489f-b069-6a7a17d7c784 tempest-ServerActionsTestOtherA-844381334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (636a581a-22d6-4e03-bae9-832e059a46a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:17:22 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c3b2d10e-f94f-489f-b069-6a7a17d7c784 tempest-ServerActionsTestOtherA-844381334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (636a581a-22d6-4e03-bae9-832e059a46a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:17:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1775667739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79c0dbae-ff1b-47d0-8c9a-8ab2c09eaca8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc54975820cf40a19e4f67d584f7b780',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:17:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:17:22Z,use_quota=True,user_id='cb78901227b84ba691b3c2032af50923',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:17:22 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c3b2d10e-f94f-489f-b069-6a7a17d7c784 tempest-ServerActionsTestOtherA-844381334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03a6967f-5b03-43ef-8097-8f3f5c138967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:17:22 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c3b2d10e-f94f-489f-b069-6a7a17d7c784 tempest-ServerActionsTestOtherA-844381334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03a6967f-5b03-43ef-8097-8f3f5c138967) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:17:22 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c3b2d10e-f94f-489f-b069-6a7a17d7c784 tempest-ServerActionsTestOtherA-844381334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d44437a-35d7-4ffe-99c9-5d1f408cb613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:17:22 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c3b2d10e-f94f-489f-b069-6a7a17d7c784 tempest-ServerActionsTestOtherA-844381334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d44437a-35d7-4ffe-99c9-5d1f408cb613) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79c0dbae-ff1b-47d0-8c9a-8ab2c09eaca8', 'volume_name': 'volume-79c0dbae-ff1b-47d0-8c9a-8ab2c09eaca8', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:17:22 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c3b2d10e-f94f-489f-b069-6a7a17d7c784 tempest-ServerActionsTestOtherA-844381334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8ff2e41-c113-4019-aa69-f16e4e713bb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:17:22 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c3b2d10e-f94f-489f-b069-6a7a17d7c784 tempest-ServerActionsTestOtherA-844381334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8ff2e41-c113-4019-aa69-f16e4e713bb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:17:22 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c3b2d10e-f94f-489f-b069-6a7a17d7c784 tempest-ServerActionsTestOtherA-844381334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c3021a5-9257-49e4-adda-154a3684d273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:17:22 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-c3b2d10e-f94f-489f-b069-6a7a17d7c784 tempest-ServerActionsTestOtherA-844381334 None] Volume 79c0dbae-ff1b-47d0-8c9a-8ab2c09eaca8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79c0dbae-ff1b-47d0-8c9a-8ab2c09eaca8', 'volume_size': 1} Sep 15 16:17:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c3b2d10e-f94f-489f-b069-6a7a17d7c784 tempest-ServerActionsTestOtherA-844381334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:17:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c3b2d10e-f94f-489f-b069-6a7a17d7c784 tempest-ServerActionsTestOtherA-844381334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:17:22 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c3b2d10e-f94f-489f-b069-6a7a17d7c784 tempest-ServerActionsTestOtherA-844381334 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:17:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1775667739',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79c0dbae-ff1b-47d0-8c9a-8ab2c09eaca8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc54975820cf40a19e4f67d584f7b780',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:17:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:17:22Z,use_quota=True,user_id='cb78901227b84ba691b3c2032af50923',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:17:22 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-c3b2d10e-f94f-489f-b069-6a7a17d7c784 tempest-ServerActionsTestOtherA-844381334 None] Creating volume 79c0dbae-ff1b-47d0-8c9a-8ab2c09eaca8 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:17:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c3b2d10e-f94f-489f-b069-6a7a17d7c784 tempest-ServerActionsTestOtherA-844381334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:17:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c3b2d10e-f94f-489f-b069-6a7a17d7c784 tempest-ServerActionsTestOtherA-844381334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:17:22 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c3b2d10e-f94f-489f-b069-6a7a17d7c784 tempest-ServerActionsTestOtherA-844381334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:17:22 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c3b2d10e-f94f-489f-b069-6a7a17d7c784 tempest-ServerActionsTestOtherA-844381334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:17:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c3b2d10e-f94f-489f-b069-6a7a17d7c784 tempest-ServerActionsTestOtherA-844381334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:17:22 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c3b2d10e-f94f-489f-b069-6a7a17d7c784 tempest-ServerActionsTestOtherA-844381334 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:17:22 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-c3b2d10e-f94f-489f-b069-6a7a17d7c784 tempest-ServerActionsTestOtherA-844381334 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:17:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c3b2d10e-f94f-489f-b069-6a7a17d7c784 tempest-ServerActionsTestOtherA-844381334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-79c0dbae-ff1b-47d0-8c9a-8ab2c09eaca8 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:17:22 devstack sudo[87861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-79c0dbae-ff1b-47d0-8c9a-8ab2c09eaca8 1073741824 Sep 15 16:17:22 devstack sudo[87861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:17:23 devstack sudo[87861]: pam_unix(sudo:session): session closed for user root Sep 15 16:17:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c3b2d10e-f94f-489f-b069-6a7a17d7c784 tempest-ServerActionsTestOtherA-844381334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-79c0dbae-ff1b-47d0-8c9a-8ab2c09eaca8 1073741824" returned: 0 in 0.576s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:17:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c3b2d10e-f94f-489f-b069-6a7a17d7c784 tempest-ServerActionsTestOtherA-844381334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-79c0dbae-ff1b-47d0-8c9a-8ab2c09eaca8 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:17:23 devstack sudo[87867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-79c0dbae-ff1b-47d0-8c9a-8ab2c09eaca8 Sep 15 16:17:23 devstack sudo[87867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:17:23 devstack sudo[87867]: pam_unix(sudo:session): session closed for user root Sep 15 16:17:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c3b2d10e-f94f-489f-b069-6a7a17d7c784 tempest-ServerActionsTestOtherA-844381334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-79c0dbae-ff1b-47d0-8c9a-8ab2c09eaca8" returned: 0 in 0.287s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:17:23 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c3b2d10e-f94f-489f-b069-6a7a17d7c784 tempest-ServerActionsTestOtherA-844381334 None] <== create_volume: return (916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:17:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c3b2d10e-f94f-489f-b069-6a7a17d7c784 tempest-ServerActionsTestOtherA-844381334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.919s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:17:23 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c3b2d10e-f94f-489f-b069-6a7a17d7c784 tempest-ServerActionsTestOtherA-844381334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c3021a5-9257-49e4-adda-154a3684d273) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79c0dbae-ff1b-47d0-8c9a-8ab2c09eaca8', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:17:23 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c3b2d10e-f94f-489f-b069-6a7a17d7c784 tempest-ServerActionsTestOtherA-844381334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4a2de9f-ac8c-4646-92b2-63167b5c89a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:17:23 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-c3b2d10e-f94f-489f-b069-6a7a17d7c784 tempest-ServerActionsTestOtherA-844381334 None] Volume volume-79c0dbae-ff1b-47d0-8c9a-8ab2c09eaca8 (79c0dbae-ff1b-47d0-8c9a-8ab2c09eaca8): created successfully Sep 15 16:17:23 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c3b2d10e-f94f-489f-b069-6a7a17d7c784 tempest-ServerActionsTestOtherA-844381334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4a2de9f-ac8c-4646-92b2-63167b5c89a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:17:23 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c3b2d10e-f94f-489f-b069-6a7a17d7c784 tempest-ServerActionsTestOtherA-844381334 None] Flow 'volume_create_manager' (0693bad4-9c2d-4a45-af68-4c344385abf8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:17:23 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-c3b2d10e-f94f-489f-b069-6a7a17d7c784 tempest-ServerActionsTestOtherA-844381334 None] Created volume successfully. Sep 15 16:17:33 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:UPDATE=26,cinder:SELECT=23,cinder:INSERT=8,cinder:DELETE=2 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 16:17:33 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:SELECT=24,cinder:UPDATE=27,cinder:DELETE=3,cinder:INSERT=3 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 16:17:51 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:SELECT=1 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 16:17:51 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:UPDATE=1 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 16:17:59 devstack cinder-volume[86082]: DEBUG oslo_service.periodic_task [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86082) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 15 16:17:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:17:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:17:59 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:17:59 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:17:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:17:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:17:59 devstack sudo[88079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:17:59 devstack sudo[88079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:18:00 devstack sudo[88079]: pam_unix(sudo:session): session closed for user root Sep 15 16:18:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.812s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:18:00 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:18:00 devstack cinder-volume[86082]: DEBUG oslo_service.periodic_task [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Running periodic task VolumeManager._thread_info {{(pid=86082) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 15 16:18:00 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] thread count: 8 {{(pid=86082) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 15 16:18:00 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] thread info: [<_MainThread(MainThread, started 124875935469696)>, , , , , , , ] {{(pid=86082) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 15 16:18:08 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7dc1a75-e5a1-4fb3-810a-03aecbbaf696 tempest-TaggedAttachmentsTest-475158163 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:18:08 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f7dc1a75-e5a1-4fb3-810a-03aecbbaf696 tempest-TaggedAttachmentsTest-475158163 None] Flow 'volume_create_manager' (04f36083-07b8-4830-8cb6-8ff79d25ccd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:18:08 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f7dc1a75-e5a1-4fb3-810a-03aecbbaf696 tempest-TaggedAttachmentsTest-475158163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b7d563d-3b00-4447-8678-2be0506fc272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:18:08 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f7dc1a75-e5a1-4fb3-810a-03aecbbaf696 tempest-TaggedAttachmentsTest-475158163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b7d563d-3b00-4447-8678-2be0506fc272) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:18:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1974371526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6825a2c9-5c9c-45e5-a4a9-ee61297ead2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='deb80a7e0ce24662ab49fe095682692f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:18:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:18:09Z,use_quota=True,user_id='4357b278d27848328549c20bc63727c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:18:08 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f7dc1a75-e5a1-4fb3-810a-03aecbbaf696 tempest-TaggedAttachmentsTest-475158163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7241e19-c293-4ab4-b49f-147edff010d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:18:08 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f7dc1a75-e5a1-4fb3-810a-03aecbbaf696 tempest-TaggedAttachmentsTest-475158163 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7241e19-c293-4ab4-b49f-147edff010d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:18:08 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f7dc1a75-e5a1-4fb3-810a-03aecbbaf696 tempest-TaggedAttachmentsTest-475158163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (724f9a60-3031-479e-9861-7a67bc3cf0ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:18:08 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f7dc1a75-e5a1-4fb3-810a-03aecbbaf696 tempest-TaggedAttachmentsTest-475158163 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (724f9a60-3031-479e-9861-7a67bc3cf0ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6825a2c9-5c9c-45e5-a4a9-ee61297ead2e', 'volume_name': 'volume-6825a2c9-5c9c-45e5-a4a9-ee61297ead2e', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:18:08 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f7dc1a75-e5a1-4fb3-810a-03aecbbaf696 tempest-TaggedAttachmentsTest-475158163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca4d1e8a-3ffa-4bd0-b073-09a617213fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:18:08 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f7dc1a75-e5a1-4fb3-810a-03aecbbaf696 tempest-TaggedAttachmentsTest-475158163 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca4d1e8a-3ffa-4bd0-b073-09a617213fc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:18:08 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f7dc1a75-e5a1-4fb3-810a-03aecbbaf696 tempest-TaggedAttachmentsTest-475158163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da13a4df-957e-47a7-b764-9b9f767647ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:18:08 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-f7dc1a75-e5a1-4fb3-810a-03aecbbaf696 tempest-TaggedAttachmentsTest-475158163 None] Volume 6825a2c9-5c9c-45e5-a4a9-ee61297ead2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6825a2c9-5c9c-45e5-a4a9-ee61297ead2e', 'volume_size': 1} Sep 15 16:18:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f7dc1a75-e5a1-4fb3-810a-03aecbbaf696 tempest-TaggedAttachmentsTest-475158163 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:18:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f7dc1a75-e5a1-4fb3-810a-03aecbbaf696 tempest-TaggedAttachmentsTest-475158163 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:18:08 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-f7dc1a75-e5a1-4fb3-810a-03aecbbaf696 tempest-TaggedAttachmentsTest-475158163 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:18:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1974371526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6825a2c9-5c9c-45e5-a4a9-ee61297ead2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='deb80a7e0ce24662ab49fe095682692f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:18:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:18:09Z,use_quota=True,user_id='4357b278d27848328549c20bc63727c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:18:08 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-f7dc1a75-e5a1-4fb3-810a-03aecbbaf696 tempest-TaggedAttachmentsTest-475158163 None] Creating volume 6825a2c9-5c9c-45e5-a4a9-ee61297ead2e {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:18:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f7dc1a75-e5a1-4fb3-810a-03aecbbaf696 tempest-TaggedAttachmentsTest-475158163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:18:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f7dc1a75-e5a1-4fb3-810a-03aecbbaf696 tempest-TaggedAttachmentsTest-475158163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:18:08 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-f7dc1a75-e5a1-4fb3-810a-03aecbbaf696 tempest-TaggedAttachmentsTest-475158163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:18:08 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-f7dc1a75-e5a1-4fb3-810a-03aecbbaf696 tempest-TaggedAttachmentsTest-475158163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:18:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f7dc1a75-e5a1-4fb3-810a-03aecbbaf696 tempest-TaggedAttachmentsTest-475158163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:18:08 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-f7dc1a75-e5a1-4fb3-810a-03aecbbaf696 tempest-TaggedAttachmentsTest-475158163 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:18:08 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-f7dc1a75-e5a1-4fb3-810a-03aecbbaf696 tempest-TaggedAttachmentsTest-475158163 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:18:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f7dc1a75-e5a1-4fb3-810a-03aecbbaf696 tempest-TaggedAttachmentsTest-475158163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6825a2c9-5c9c-45e5-a4a9-ee61297ead2e 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:18:08 devstack sudo[88162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6825a2c9-5c9c-45e5-a4a9-ee61297ead2e 1073741824 Sep 15 16:18:08 devstack sudo[88162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:18:09 devstack sudo[88162]: pam_unix(sudo:session): session closed for user root Sep 15 16:18:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f7dc1a75-e5a1-4fb3-810a-03aecbbaf696 tempest-TaggedAttachmentsTest-475158163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6825a2c9-5c9c-45e5-a4a9-ee61297ead2e 1073741824" returned: 0 in 0.842s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:18:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f7dc1a75-e5a1-4fb3-810a-03aecbbaf696 tempest-TaggedAttachmentsTest-475158163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6825a2c9-5c9c-45e5-a4a9-ee61297ead2e {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:18:09 devstack sudo[88189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6825a2c9-5c9c-45e5-a4a9-ee61297ead2e Sep 15 16:18:09 devstack sudo[88189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:18:09 devstack sudo[88189]: pam_unix(sudo:session): session closed for user root Sep 15 16:18:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f7dc1a75-e5a1-4fb3-810a-03aecbbaf696 tempest-TaggedAttachmentsTest-475158163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6825a2c9-5c9c-45e5-a4a9-ee61297ead2e" returned: 0 in 0.281s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:18:09 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-f7dc1a75-e5a1-4fb3-810a-03aecbbaf696 tempest-TaggedAttachmentsTest-475158163 None] <== create_volume: return (1189ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:18:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f7dc1a75-e5a1-4fb3-810a-03aecbbaf696 tempest-TaggedAttachmentsTest-475158163 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.193s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:18:09 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f7dc1a75-e5a1-4fb3-810a-03aecbbaf696 tempest-TaggedAttachmentsTest-475158163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da13a4df-957e-47a7-b764-9b9f767647ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6825a2c9-5c9c-45e5-a4a9-ee61297ead2e', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:18:09 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f7dc1a75-e5a1-4fb3-810a-03aecbbaf696 tempest-TaggedAttachmentsTest-475158163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (104f2b1a-e036-4b48-a454-1b1c7564e831) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:18:09 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-f7dc1a75-e5a1-4fb3-810a-03aecbbaf696 tempest-TaggedAttachmentsTest-475158163 None] Volume volume-6825a2c9-5c9c-45e5-a4a9-ee61297ead2e (6825a2c9-5c9c-45e5-a4a9-ee61297ead2e): created successfully Sep 15 16:18:09 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f7dc1a75-e5a1-4fb3-810a-03aecbbaf696 tempest-TaggedAttachmentsTest-475158163 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (104f2b1a-e036-4b48-a454-1b1c7564e831) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:18:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f7dc1a75-e5a1-4fb3-810a-03aecbbaf696 tempest-TaggedAttachmentsTest-475158163 None] Flow 'volume_create_manager' (04f36083-07b8-4830-8cb6-8ff79d25ccd5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:18:10 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-f7dc1a75-e5a1-4fb3-810a-03aecbbaf696 tempest-TaggedAttachmentsTest-475158163 None] Created volume successfully. Sep 15 16:18:20 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:SELECT=2,cinder:UPDATE=5,cinder:INSERT=1 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 16:18:20 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1,cinder:DELETE=1 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 16:18:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-db7aa249-9cb4-46b6-97c6-b5a68bb975b3 req-858a704b-25eb-41ac-9da3-3c66d9870279 tempest-ServerActionsTestOtherA-844381334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:18:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-db7aa249-9cb4-46b6-97c6-b5a68bb975b3 req-858a704b-25eb-41ac-9da3-3c66d9870279 tempest-ServerActionsTestOtherA-844381334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:18:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-db7aa249-9cb4-46b6-97c6-b5a68bb975b3 req-858a704b-25eb-41ac-9da3-3c66d9870279 tempest-ServerActionsTestOtherA-844381334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.041s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:18:25 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-db7aa249-9cb4-46b6-97c6-b5a68bb975b3 req-858a704b-25eb-41ac-9da3-3c66d9870279 tempest-ServerActionsTestOtherA-844381334 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a', 'name': 'volume-79c0dbae-ff1b-47d0-8c9a-8ab2c09eaca8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '154437db-7f15-4150-87c8-7930f5a9158c', 'enforce_multipath': True} {{(pid=86082) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 15 16:18:25 devstack cinder-volume[86082]: INFO cinder.volume.manager [req-db7aa249-9cb4-46b6-97c6-b5a68bb975b3 req-858a704b-25eb-41ac-9da3-3c66d9870279 tempest-ServerActionsTestOtherA-844381334 None] attachment_update completed successfully. Sep 15 16:18:26 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7223d7e-aa11-4e71-995b-4036b94434e7 tempest-ServersNegativeTestJSON-1124666082 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:18:26 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-d7223d7e-aa11-4e71-995b-4036b94434e7 tempest-ServersNegativeTestJSON-1124666082 None] Flow 'volume_create_manager' (1411a491-7975-4aa9-a42a-c214b0e07b3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:18:26 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-d7223d7e-aa11-4e71-995b-4036b94434e7 tempest-ServersNegativeTestJSON-1124666082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43d789bb-896d-4c37-ad30-14fc163dcc9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:18:26 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-d7223d7e-aa11-4e71-995b-4036b94434e7 tempest-ServersNegativeTestJSON-1124666082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43d789bb-896d-4c37-ad30-14fc163dcc9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:18:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1711952807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=259a1cb7-578f-49dc-8ccc-269906346254,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8f31822416e4c6085dc41226dca51d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:18:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:18:27Z,use_quota=True,user_id='9763a50a893f4bb4803d3df2ef38f7e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:18:26 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-d7223d7e-aa11-4e71-995b-4036b94434e7 tempest-ServersNegativeTestJSON-1124666082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (735a1d0b-f1bb-48e1-9033-52c5d4fe1182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:18:26 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-d7223d7e-aa11-4e71-995b-4036b94434e7 tempest-ServersNegativeTestJSON-1124666082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (735a1d0b-f1bb-48e1-9033-52c5d4fe1182) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:18:26 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-d7223d7e-aa11-4e71-995b-4036b94434e7 tempest-ServersNegativeTestJSON-1124666082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27f5a421-1f62-42a5-a938-22286c81f1d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:18:26 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-d7223d7e-aa11-4e71-995b-4036b94434e7 tempest-ServersNegativeTestJSON-1124666082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27f5a421-1f62-42a5-a938-22286c81f1d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '259a1cb7-578f-49dc-8ccc-269906346254', 'volume_name': 'volume-259a1cb7-578f-49dc-8ccc-269906346254', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:18:26 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-d7223d7e-aa11-4e71-995b-4036b94434e7 tempest-ServersNegativeTestJSON-1124666082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e533989-91ed-4c14-9362-9eb991af4a81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:18:26 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-d7223d7e-aa11-4e71-995b-4036b94434e7 tempest-ServersNegativeTestJSON-1124666082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e533989-91ed-4c14-9362-9eb991af4a81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:18:26 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-d7223d7e-aa11-4e71-995b-4036b94434e7 tempest-ServersNegativeTestJSON-1124666082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d874af19-573b-4d70-a5d2-ba3b1a825529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:18:26 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-d7223d7e-aa11-4e71-995b-4036b94434e7 tempest-ServersNegativeTestJSON-1124666082 None] Volume 259a1cb7-578f-49dc-8ccc-269906346254: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-259a1cb7-578f-49dc-8ccc-269906346254', 'volume_size': 1} Sep 15 16:18:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-d7223d7e-aa11-4e71-995b-4036b94434e7 tempest-ServersNegativeTestJSON-1124666082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:18:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-d7223d7e-aa11-4e71-995b-4036b94434e7 tempest-ServersNegativeTestJSON-1124666082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:18:26 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-d7223d7e-aa11-4e71-995b-4036b94434e7 tempest-ServersNegativeTestJSON-1124666082 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:18:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1711952807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=259a1cb7-578f-49dc-8ccc-269906346254,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8f31822416e4c6085dc41226dca51d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:18:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:18:27Z,use_quota=True,user_id='9763a50a893f4bb4803d3df2ef38f7e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:18:26 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-d7223d7e-aa11-4e71-995b-4036b94434e7 tempest-ServersNegativeTestJSON-1124666082 None] Creating volume 259a1cb7-578f-49dc-8ccc-269906346254 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:18:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-d7223d7e-aa11-4e71-995b-4036b94434e7 tempest-ServersNegativeTestJSON-1124666082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:18:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-d7223d7e-aa11-4e71-995b-4036b94434e7 tempest-ServersNegativeTestJSON-1124666082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:18:26 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-d7223d7e-aa11-4e71-995b-4036b94434e7 tempest-ServersNegativeTestJSON-1124666082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:18:26 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-d7223d7e-aa11-4e71-995b-4036b94434e7 tempest-ServersNegativeTestJSON-1124666082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:18:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-d7223d7e-aa11-4e71-995b-4036b94434e7 tempest-ServersNegativeTestJSON-1124666082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:18:26 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-d7223d7e-aa11-4e71-995b-4036b94434e7 tempest-ServersNegativeTestJSON-1124666082 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:18:26 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-d7223d7e-aa11-4e71-995b-4036b94434e7 tempest-ServersNegativeTestJSON-1124666082 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:18:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d7223d7e-aa11-4e71-995b-4036b94434e7 tempest-ServersNegativeTestJSON-1124666082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-259a1cb7-578f-49dc-8ccc-269906346254 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:18:26 devstack sudo[88899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-259a1cb7-578f-49dc-8ccc-269906346254 1073741824 Sep 15 16:18:26 devstack sudo[88899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:18:27 devstack sudo[88899]: pam_unix(sudo:session): session closed for user root Sep 15 16:18:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d7223d7e-aa11-4e71-995b-4036b94434e7 tempest-ServersNegativeTestJSON-1124666082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-259a1cb7-578f-49dc-8ccc-269906346254 1073741824" returned: 0 in 1.020s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:18:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d7223d7e-aa11-4e71-995b-4036b94434e7 tempest-ServersNegativeTestJSON-1124666082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-259a1cb7-578f-49dc-8ccc-269906346254 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:18:28 devstack sudo[88910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-259a1cb7-578f-49dc-8ccc-269906346254 Sep 15 16:18:28 devstack sudo[88910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:18:28 devstack sudo[88910]: pam_unix(sudo:session): session closed for user root Sep 15 16:18:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d7223d7e-aa11-4e71-995b-4036b94434e7 tempest-ServersNegativeTestJSON-1124666082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-259a1cb7-578f-49dc-8ccc-269906346254" returned: 0 in 0.331s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:18:28 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-d7223d7e-aa11-4e71-995b-4036b94434e7 tempest-ServersNegativeTestJSON-1124666082 None] <== create_volume: return (1466ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:18:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-d7223d7e-aa11-4e71-995b-4036b94434e7 tempest-ServersNegativeTestJSON-1124666082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.470s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:18:28 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-d7223d7e-aa11-4e71-995b-4036b94434e7 tempest-ServersNegativeTestJSON-1124666082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d874af19-573b-4d70-a5d2-ba3b1a825529) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-259a1cb7-578f-49dc-8ccc-269906346254', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:18:28 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-d7223d7e-aa11-4e71-995b-4036b94434e7 tempest-ServersNegativeTestJSON-1124666082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (095d1b76-6b84-48a9-9edf-5380d269e237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:18:28 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-d7223d7e-aa11-4e71-995b-4036b94434e7 tempest-ServersNegativeTestJSON-1124666082 None] Volume volume-259a1cb7-578f-49dc-8ccc-269906346254 (259a1cb7-578f-49dc-8ccc-269906346254): created successfully Sep 15 16:18:28 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-d7223d7e-aa11-4e71-995b-4036b94434e7 tempest-ServersNegativeTestJSON-1124666082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (095d1b76-6b84-48a9-9edf-5380d269e237) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:18:28 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-d7223d7e-aa11-4e71-995b-4036b94434e7 tempest-ServersNegativeTestJSON-1124666082 None] Flow 'volume_create_manager' (1411a491-7975-4aa9-a42a-c214b0e07b3d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:18:28 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-d7223d7e-aa11-4e71-995b-4036b94434e7 tempest-ServersNegativeTestJSON-1124666082 None] Created volume successfully. Sep 15 16:18:31 devstack cinder-volume[86082]: INFO cinder.volume.manager [req-205833ec-14cb-4c56-9ffb-d3f657b61904 req-d407b1ba-6626-440c-aa14-b383bcfc98f6 tempest-ServerActionsTestOtherA-844381334 None] Terminate volume connection completed successfully. Sep 15 16:18:31 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-205833ec-14cb-4c56-9ffb-d3f657b61904 req-d407b1ba-6626-440c-aa14-b383bcfc98f6 tempest-ServerActionsTestOtherA-844381334 None] Deleting attachment 154437db-7f15-4150-87c8-7930f5a9158c. {{(pid=86082) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 15 16:18:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-205833ec-14cb-4c56-9ffb-d3f657b61904 req-ed4120af-68fb-47f8-b992-745616a6808d tempest-ServerActionsTestOtherA-844381334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:18:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-205833ec-14cb-4c56-9ffb-d3f657b61904 req-ed4120af-68fb-47f8-b992-745616a6808d tempest-ServerActionsTestOtherA-844381334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:18:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-205833ec-14cb-4c56-9ffb-d3f657b61904 req-ed4120af-68fb-47f8-b992-745616a6808d tempest-ServerActionsTestOtherA-844381334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.049s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:18:33 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-205833ec-14cb-4c56-9ffb-d3f657b61904 req-ed4120af-68fb-47f8-b992-745616a6808d tempest-ServerActionsTestOtherA-844381334 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a', 'name': 'volume-79c0dbae-ff1b-47d0-8c9a-8ab2c09eaca8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b6c23fda-32b6-4b88-82f9-e460f5ce500c', 'enforce_multipath': True} {{(pid=86082) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 15 16:18:33 devstack cinder-volume[86082]: INFO cinder.volume.manager [req-205833ec-14cb-4c56-9ffb-d3f657b61904 req-ed4120af-68fb-47f8-b992-745616a6808d tempest-ServerActionsTestOtherA-844381334 None] attachment_update completed successfully. Sep 15 16:18:34 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e179ca4-f996-4944-b2bb-f9d0e7a90e5f tempest-ServersNegativeTestJSON-1124666082 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:18:34 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8e179ca4-f996-4944-b2bb-f9d0e7a90e5f tempest-ServersNegativeTestJSON-1124666082 None] Flow 'volume_create_manager' (f7a516e0-569c-4414-9aac-69df0a24d44e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:18:34 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8e179ca4-f996-4944-b2bb-f9d0e7a90e5f tempest-ServersNegativeTestJSON-1124666082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63d8ca5a-d4df-4764-adaf-8842a415220e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:18:34 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8e179ca4-f996-4944-b2bb-f9d0e7a90e5f tempest-ServersNegativeTestJSON-1124666082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63d8ca5a-d4df-4764-adaf-8842a415220e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:18:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1612686512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1802ae16-bbf7-4f24-be47-586c5f7cdd1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8f31822416e4c6085dc41226dca51d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:18:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:18:34Z,use_quota=True,user_id='9763a50a893f4bb4803d3df2ef38f7e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:18:34 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8e179ca4-f996-4944-b2bb-f9d0e7a90e5f tempest-ServersNegativeTestJSON-1124666082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7e607e5-51da-4c66-8907-d0918785f550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:18:34 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8e179ca4-f996-4944-b2bb-f9d0e7a90e5f tempest-ServersNegativeTestJSON-1124666082 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7e607e5-51da-4c66-8907-d0918785f550) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:18:34 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8e179ca4-f996-4944-b2bb-f9d0e7a90e5f tempest-ServersNegativeTestJSON-1124666082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (150bdbfb-590f-4652-9940-b8ae460434d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:18:34 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8e179ca4-f996-4944-b2bb-f9d0e7a90e5f tempest-ServersNegativeTestJSON-1124666082 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (150bdbfb-590f-4652-9940-b8ae460434d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1802ae16-bbf7-4f24-be47-586c5f7cdd1a', 'volume_name': 'volume-1802ae16-bbf7-4f24-be47-586c5f7cdd1a', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:18:34 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8e179ca4-f996-4944-b2bb-f9d0e7a90e5f tempest-ServersNegativeTestJSON-1124666082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b2dcadd-fd03-4b28-aaab-903fb1796337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:18:34 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8e179ca4-f996-4944-b2bb-f9d0e7a90e5f tempest-ServersNegativeTestJSON-1124666082 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b2dcadd-fd03-4b28-aaab-903fb1796337) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:18:34 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8e179ca4-f996-4944-b2bb-f9d0e7a90e5f tempest-ServersNegativeTestJSON-1124666082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92315a67-6e7a-4fa3-9458-949581565c9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:18:34 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-8e179ca4-f996-4944-b2bb-f9d0e7a90e5f tempest-ServersNegativeTestJSON-1124666082 None] Volume 1802ae16-bbf7-4f24-be47-586c5f7cdd1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1802ae16-bbf7-4f24-be47-586c5f7cdd1a', 'volume_size': 1} Sep 15 16:18:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-8e179ca4-f996-4944-b2bb-f9d0e7a90e5f tempest-ServersNegativeTestJSON-1124666082 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:18:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-8e179ca4-f996-4944-b2bb-f9d0e7a90e5f tempest-ServersNegativeTestJSON-1124666082 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:18:34 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-8e179ca4-f996-4944-b2bb-f9d0e7a90e5f tempest-ServersNegativeTestJSON-1124666082 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:18:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1612686512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1802ae16-bbf7-4f24-be47-586c5f7cdd1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8f31822416e4c6085dc41226dca51d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:18:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:18:34Z,use_quota=True,user_id='9763a50a893f4bb4803d3df2ef38f7e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:18:34 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-8e179ca4-f996-4944-b2bb-f9d0e7a90e5f tempest-ServersNegativeTestJSON-1124666082 None] Creating volume 1802ae16-bbf7-4f24-be47-586c5f7cdd1a {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:18:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-8e179ca4-f996-4944-b2bb-f9d0e7a90e5f tempest-ServersNegativeTestJSON-1124666082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:18:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-8e179ca4-f996-4944-b2bb-f9d0e7a90e5f tempest-ServersNegativeTestJSON-1124666082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:18:34 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-8e179ca4-f996-4944-b2bb-f9d0e7a90e5f tempest-ServersNegativeTestJSON-1124666082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:18:34 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-8e179ca4-f996-4944-b2bb-f9d0e7a90e5f tempest-ServersNegativeTestJSON-1124666082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:18:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-8e179ca4-f996-4944-b2bb-f9d0e7a90e5f tempest-ServersNegativeTestJSON-1124666082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:18:34 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-8e179ca4-f996-4944-b2bb-f9d0e7a90e5f tempest-ServersNegativeTestJSON-1124666082 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:18:34 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-8e179ca4-f996-4944-b2bb-f9d0e7a90e5f tempest-ServersNegativeTestJSON-1124666082 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:18:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8e179ca4-f996-4944-b2bb-f9d0e7a90e5f tempest-ServersNegativeTestJSON-1124666082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1802ae16-bbf7-4f24-be47-586c5f7cdd1a 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:18:34 devstack sudo[88994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1802ae16-bbf7-4f24-be47-586c5f7cdd1a 1073741824 Sep 15 16:18:34 devstack sudo[88994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:18:34 devstack sudo[88994]: pam_unix(sudo:session): session closed for user root Sep 15 16:18:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8e179ca4-f996-4944-b2bb-f9d0e7a90e5f tempest-ServersNegativeTestJSON-1124666082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1802ae16-bbf7-4f24-be47-586c5f7cdd1a 1073741824" returned: 0 in 0.607s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:18:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8e179ca4-f996-4944-b2bb-f9d0e7a90e5f tempest-ServersNegativeTestJSON-1124666082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1802ae16-bbf7-4f24-be47-586c5f7cdd1a {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:18:35 devstack sudo[89013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1802ae16-bbf7-4f24-be47-586c5f7cdd1a Sep 15 16:18:35 devstack sudo[89013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:18:35 devstack sudo[89013]: pam_unix(sudo:session): session closed for user root Sep 15 16:18:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8e179ca4-f996-4944-b2bb-f9d0e7a90e5f tempest-ServersNegativeTestJSON-1124666082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1802ae16-bbf7-4f24-be47-586c5f7cdd1a" returned: 0 in 0.344s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:18:35 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-8e179ca4-f996-4944-b2bb-f9d0e7a90e5f tempest-ServersNegativeTestJSON-1124666082 None] <== create_volume: return (1020ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:18:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-8e179ca4-f996-4944-b2bb-f9d0e7a90e5f tempest-ServersNegativeTestJSON-1124666082 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.023s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:18:35 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8e179ca4-f996-4944-b2bb-f9d0e7a90e5f tempest-ServersNegativeTestJSON-1124666082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92315a67-6e7a-4fa3-9458-949581565c9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1802ae16-bbf7-4f24-be47-586c5f7cdd1a', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:18:35 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8e179ca4-f996-4944-b2bb-f9d0e7a90e5f tempest-ServersNegativeTestJSON-1124666082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a509e6d-96a9-4715-8bc2-96a43d74255a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:18:35 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-8e179ca4-f996-4944-b2bb-f9d0e7a90e5f tempest-ServersNegativeTestJSON-1124666082 None] Volume volume-1802ae16-bbf7-4f24-be47-586c5f7cdd1a (1802ae16-bbf7-4f24-be47-586c5f7cdd1a): created successfully Sep 15 16:18:35 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8e179ca4-f996-4944-b2bb-f9d0e7a90e5f tempest-ServersNegativeTestJSON-1124666082 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a509e6d-96a9-4715-8bc2-96a43d74255a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:18:35 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8e179ca4-f996-4944-b2bb-f9d0e7a90e5f tempest-ServersNegativeTestJSON-1124666082 None] Flow 'volume_create_manager' (f7a516e0-569c-4414-9aac-69df0a24d44e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:18:35 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-8e179ca4-f996-4944-b2bb-f9d0e7a90e5f tempest-ServersNegativeTestJSON-1124666082 None] Created volume successfully. Sep 15 16:18:37 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-41810cc3-623d-4904-a566-f1dfdc7b6c8a tempest-ServersNegativeTestJSON-1124666082 None] Acquiring lock "cinder-1802ae16-bbf7-4f24-be47-586c5f7cdd1a-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:18:37 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-41810cc3-623d-4904-a566-f1dfdc7b6c8a tempest-ServersNegativeTestJSON-1124666082 None] Lock "cinder-1802ae16-bbf7-4f24-be47-586c5f7cdd1a-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:18:37 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-41810cc3-623d-4904-a566-f1dfdc7b6c8a tempest-ServersNegativeTestJSON-1124666082 None] Acquiring lock "cinder-quobyte-1802ae16-bbf7-4f24-be47-586c5f7cdd1a" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:18:37 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-41810cc3-623d-4904-a566-f1dfdc7b6c8a tempest-ServersNegativeTestJSON-1124666082 None] Lock "cinder-quobyte-1802ae16-bbf7-4f24-be47-586c5f7cdd1a" acquired by "delete_volume" :: waited 0.044s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:18:37 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f5c3aa3-5cc2-4de8-979b-a9f328faab39]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:18:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-41810cc3-623d-4904-a566-f1dfdc7b6c8a tempest-ServersNegativeTestJSON-1124666082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1802ae16-bbf7-4f24-be47-586c5f7cdd1a {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:18:37 devstack sudo[89471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1802ae16-bbf7-4f24-be47-586c5f7cdd1a Sep 15 16:18:37 devstack sudo[89471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:18:38 devstack sudo[89471]: pam_unix(sudo:session): session closed for user root Sep 15 16:18:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-41810cc3-623d-4904-a566-f1dfdc7b6c8a tempest-ServersNegativeTestJSON-1124666082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1802ae16-bbf7-4f24-be47-586c5f7cdd1a" returned: 0 in 0.594s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:18:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-41810cc3-623d-4904-a566-f1dfdc7b6c8a tempest-ServersNegativeTestJSON-1124666082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1802ae16-bbf7-4f24-be47-586c5f7cdd1a {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:18:38 devstack sudo[89482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1802ae16-bbf7-4f24-be47-586c5f7cdd1a Sep 15 16:18:38 devstack sudo[89482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:18:38 devstack sudo[89482]: pam_unix(sudo:session): session closed for user root Sep 15 16:18:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-41810cc3-623d-4904-a566-f1dfdc7b6c8a tempest-ServersNegativeTestJSON-1124666082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1802ae16-bbf7-4f24-be47-586c5f7cdd1a" returned: 0 in 0.411s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:18:38 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-41810cc3-623d-4904-a566-f1dfdc7b6c8a tempest-ServersNegativeTestJSON-1124666082 None] Lock "cinder-quobyte-1802ae16-bbf7-4f24-be47-586c5f7cdd1a" released by "delete_volume" :: held 1.116s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:18:38 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-41810cc3-623d-4904-a566-f1dfdc7b6c8a tempest-ServersNegativeTestJSON-1124666082 None] Created reservations ['027a88f6-c5de-425b-a3b0-beae136cec9f', 'fb9c4ac8-a630-447a-8462-0ac99d731054', 'c2be6994-1df1-4a27-8b55-80aeba53a356', '3f777de0-a1a0-4ec2-bd2a-e61b60a58e36'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:18:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-41810cc3-623d-4904-a566-f1dfdc7b6c8a tempest-ServersNegativeTestJSON-1124666082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:18:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-41810cc3-623d-4904-a566-f1dfdc7b6c8a tempest-ServersNegativeTestJSON-1124666082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:18:39 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-41810cc3-623d-4904-a566-f1dfdc7b6c8a tempest-ServersNegativeTestJSON-1124666082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:18:39 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-41810cc3-623d-4904-a566-f1dfdc7b6c8a tempest-ServersNegativeTestJSON-1124666082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:18:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-41810cc3-623d-4904-a566-f1dfdc7b6c8a tempest-ServersNegativeTestJSON-1124666082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:18:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-41810cc3-623d-4904-a566-f1dfdc7b6c8a tempest-ServersNegativeTestJSON-1124666082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:18:39 devstack sudo[89497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:18:39 devstack sudo[89497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:18:39 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-85d26d66-522e-4f78-9f89-098895ef16e9 tempest-ServersNegativeTestJSON-1124666082 None] Acquiring lock "cinder-259a1cb7-578f-49dc-8ccc-269906346254-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:18:39 devstack sudo[89497]: pam_unix(sudo:session): session closed for user root Sep 15 16:18:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-41810cc3-623d-4904-a566-f1dfdc7b6c8a tempest-ServersNegativeTestJSON-1124666082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.710s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:18:39 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-41810cc3-623d-4904-a566-f1dfdc7b6c8a tempest-ServersNegativeTestJSON-1124666082 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:18:39 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-41810cc3-623d-4904-a566-f1dfdc7b6c8a tempest-ServersNegativeTestJSON-1124666082 None] Deleted volume successfully. Sep 15 16:18:39 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-85d26d66-522e-4f78-9f89-098895ef16e9 tempest-ServersNegativeTestJSON-1124666082 None] Lock "cinder-259a1cb7-578f-49dc-8ccc-269906346254-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:18:39 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-41810cc3-623d-4904-a566-f1dfdc7b6c8a tempest-ServersNegativeTestJSON-1124666082 None] Lock "cinder-1802ae16-bbf7-4f24-be47-586c5f7cdd1a-delete_volume" released by "delete_volume" :: held 2.554s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:18:39 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-85d26d66-522e-4f78-9f89-098895ef16e9 tempest-ServersNegativeTestJSON-1124666082 None] Acquiring lock "cinder-quobyte-259a1cb7-578f-49dc-8ccc-269906346254" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:18:40 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-85d26d66-522e-4f78-9f89-098895ef16e9 tempest-ServersNegativeTestJSON-1124666082 None] Lock "cinder-quobyte-259a1cb7-578f-49dc-8ccc-269906346254" acquired by "delete_volume" :: waited 0.032s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:18:40 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[58f9ef84-8d6d-4234-bcca-ac3863e836f8]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:18:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-85d26d66-522e-4f78-9f89-098895ef16e9 tempest-ServersNegativeTestJSON-1124666082 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-259a1cb7-578f-49dc-8ccc-269906346254 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:18:40 devstack sudo[89509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-259a1cb7-578f-49dc-8ccc-269906346254 Sep 15 16:18:40 devstack sudo[89509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:18:40 devstack sudo[89509]: pam_unix(sudo:session): session closed for user root Sep 15 16:18:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-85d26d66-522e-4f78-9f89-098895ef16e9 tempest-ServersNegativeTestJSON-1124666082 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-259a1cb7-578f-49dc-8ccc-269906346254" returned: 0 in 0.842s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:18:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-85d26d66-522e-4f78-9f89-098895ef16e9 tempest-ServersNegativeTestJSON-1124666082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-259a1cb7-578f-49dc-8ccc-269906346254 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:18:40 devstack sudo[89525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-259a1cb7-578f-49dc-8ccc-269906346254 Sep 15 16:18:40 devstack sudo[89525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:18:41 devstack sudo[89525]: pam_unix(sudo:session): session closed for user root Sep 15 16:18:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-85d26d66-522e-4f78-9f89-098895ef16e9 tempest-ServersNegativeTestJSON-1124666082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-259a1cb7-578f-49dc-8ccc-269906346254" returned: 0 in 0.396s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:18:41 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-85d26d66-522e-4f78-9f89-098895ef16e9 tempest-ServersNegativeTestJSON-1124666082 None] Lock "cinder-quobyte-259a1cb7-578f-49dc-8ccc-269906346254" released by "delete_volume" :: held 1.351s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:18:41 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-85d26d66-522e-4f78-9f89-098895ef16e9 tempest-ServersNegativeTestJSON-1124666082 None] Created reservations ['1ed76f2a-38c4-4492-84bd-09ede0ade1d3', '23093616-c98f-45de-a1d1-06ac42486a51', 'ed5792ca-ccb5-40b5-9e61-3537b58f3b8d', '91c7f9f3-6d47-4600-8dab-f94dbfbfc5c0'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:18:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-85d26d66-522e-4f78-9f89-098895ef16e9 tempest-ServersNegativeTestJSON-1124666082 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:18:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-85d26d66-522e-4f78-9f89-098895ef16e9 tempest-ServersNegativeTestJSON-1124666082 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:18:41 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-85d26d66-522e-4f78-9f89-098895ef16e9 tempest-ServersNegativeTestJSON-1124666082 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:18:41 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-85d26d66-522e-4f78-9f89-098895ef16e9 tempest-ServersNegativeTestJSON-1124666082 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:18:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-85d26d66-522e-4f78-9f89-098895ef16e9 tempest-ServersNegativeTestJSON-1124666082 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:18:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-85d26d66-522e-4f78-9f89-098895ef16e9 tempest-ServersNegativeTestJSON-1124666082 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:18:41 devstack sudo[89532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:18:41 devstack sudo[89532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:18:42 devstack sudo[89532]: pam_unix(sudo:session): session closed for user root Sep 15 16:18:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-85d26d66-522e-4f78-9f89-098895ef16e9 tempest-ServersNegativeTestJSON-1124666082 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.438s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:18:42 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-85d26d66-522e-4f78-9f89-098895ef16e9 tempest-ServersNegativeTestJSON-1124666082 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:18:42 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-85d26d66-522e-4f78-9f89-098895ef16e9 tempest-ServersNegativeTestJSON-1124666082 None] Deleted volume successfully. Sep 15 16:18:42 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-85d26d66-522e-4f78-9f89-098895ef16e9 tempest-ServersNegativeTestJSON-1124666082 None] Lock "cinder-259a1cb7-578f-49dc-8ccc-269906346254-delete_volume" released by "delete_volume" :: held 2.136s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:18:51 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:SELECT=27,cinder:UPDATE=24,cinder:INSERT=4 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 16:18:52 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:SELECT=29,cinder:UPDATE=26,cinder:INSERT=6,cinder:DELETE=4 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 16:18:53 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe498eb7-5d4d-4847-b0d1-0a0d094b61bb tempest-AttachVolumeShelveTestJSON-944692299 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:18:53 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-fe498eb7-5d4d-4847-b0d1-0a0d094b61bb tempest-AttachVolumeShelveTestJSON-944692299 None] Flow 'volume_create_manager' (8c8c64e2-09d8-4b5a-939f-c57dacac4687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:18:53 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-fe498eb7-5d4d-4847-b0d1-0a0d094b61bb tempest-AttachVolumeShelveTestJSON-944692299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (956ea163-eee0-449f-9a78-6d8a106feba7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:18:53 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-fe498eb7-5d4d-4847-b0d1-0a0d094b61bb tempest-AttachVolumeShelveTestJSON-944692299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (956ea163-eee0-449f-9a78-6d8a106feba7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:18:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1756003076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c97cf5ee-fa69-430c-b583-dc8bfb7fdab7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cafa04417f824265a863fa0a836ded2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:18:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:18:54Z,use_quota=True,user_id='39cb2b6b62154332b405b4619afb8a53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:18:53 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-fe498eb7-5d4d-4847-b0d1-0a0d094b61bb tempest-AttachVolumeShelveTestJSON-944692299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1120314e-eafa-4c1d-863d-ad1b186bac19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:18:53 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-fe498eb7-5d4d-4847-b0d1-0a0d094b61bb tempest-AttachVolumeShelveTestJSON-944692299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1120314e-eafa-4c1d-863d-ad1b186bac19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:18:53 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-fe498eb7-5d4d-4847-b0d1-0a0d094b61bb tempest-AttachVolumeShelveTestJSON-944692299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5f3088e-ee5e-408e-99b1-18f08801798d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:18:53 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-fe498eb7-5d4d-4847-b0d1-0a0d094b61bb tempest-AttachVolumeShelveTestJSON-944692299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5f3088e-ee5e-408e-99b1-18f08801798d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c97cf5ee-fa69-430c-b583-dc8bfb7fdab7', 'volume_name': 'volume-c97cf5ee-fa69-430c-b583-dc8bfb7fdab7', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:18:53 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-fe498eb7-5d4d-4847-b0d1-0a0d094b61bb tempest-AttachVolumeShelveTestJSON-944692299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7007700c-70c6-4179-92e3-63ad25dd9c84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:18:53 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-fe498eb7-5d4d-4847-b0d1-0a0d094b61bb tempest-AttachVolumeShelveTestJSON-944692299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7007700c-70c6-4179-92e3-63ad25dd9c84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:18:53 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-fe498eb7-5d4d-4847-b0d1-0a0d094b61bb tempest-AttachVolumeShelveTestJSON-944692299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4adc1ec-a922-400f-b1c3-202f552807a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:18:53 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-fe498eb7-5d4d-4847-b0d1-0a0d094b61bb tempest-AttachVolumeShelveTestJSON-944692299 None] Volume c97cf5ee-fa69-430c-b583-dc8bfb7fdab7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c97cf5ee-fa69-430c-b583-dc8bfb7fdab7', 'volume_size': 1} Sep 15 16:18:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-fe498eb7-5d4d-4847-b0d1-0a0d094b61bb tempest-AttachVolumeShelveTestJSON-944692299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:18:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-fe498eb7-5d4d-4847-b0d1-0a0d094b61bb tempest-AttachVolumeShelveTestJSON-944692299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:18:53 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-fe498eb7-5d4d-4847-b0d1-0a0d094b61bb tempest-AttachVolumeShelveTestJSON-944692299 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:18:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1756003076',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c97cf5ee-fa69-430c-b583-dc8bfb7fdab7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cafa04417f824265a863fa0a836ded2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:18:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:18:54Z,use_quota=True,user_id='39cb2b6b62154332b405b4619afb8a53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:18:53 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-fe498eb7-5d4d-4847-b0d1-0a0d094b61bb tempest-AttachVolumeShelveTestJSON-944692299 None] Creating volume c97cf5ee-fa69-430c-b583-dc8bfb7fdab7 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:18:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-fe498eb7-5d4d-4847-b0d1-0a0d094b61bb tempest-AttachVolumeShelveTestJSON-944692299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:18:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-fe498eb7-5d4d-4847-b0d1-0a0d094b61bb tempest-AttachVolumeShelveTestJSON-944692299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:18:53 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-fe498eb7-5d4d-4847-b0d1-0a0d094b61bb tempest-AttachVolumeShelveTestJSON-944692299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:18:53 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-fe498eb7-5d4d-4847-b0d1-0a0d094b61bb tempest-AttachVolumeShelveTestJSON-944692299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:18:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-fe498eb7-5d4d-4847-b0d1-0a0d094b61bb tempest-AttachVolumeShelveTestJSON-944692299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:18:53 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-fe498eb7-5d4d-4847-b0d1-0a0d094b61bb tempest-AttachVolumeShelveTestJSON-944692299 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:18:53 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-fe498eb7-5d4d-4847-b0d1-0a0d094b61bb tempest-AttachVolumeShelveTestJSON-944692299 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:18:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-fe498eb7-5d4d-4847-b0d1-0a0d094b61bb tempest-AttachVolumeShelveTestJSON-944692299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c97cf5ee-fa69-430c-b583-dc8bfb7fdab7 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:18:53 devstack sudo[89609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c97cf5ee-fa69-430c-b583-dc8bfb7fdab7 1073741824 Sep 15 16:18:53 devstack sudo[89609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:18:54 devstack sudo[89609]: pam_unix(sudo:session): session closed for user root Sep 15 16:18:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-fe498eb7-5d4d-4847-b0d1-0a0d094b61bb tempest-AttachVolumeShelveTestJSON-944692299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c97cf5ee-fa69-430c-b583-dc8bfb7fdab7 1073741824" returned: 0 in 0.698s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:18:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-fe498eb7-5d4d-4847-b0d1-0a0d094b61bb tempest-AttachVolumeShelveTestJSON-944692299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c97cf5ee-fa69-430c-b583-dc8bfb7fdab7 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:18:54 devstack sudo[89623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c97cf5ee-fa69-430c-b583-dc8bfb7fdab7 Sep 15 16:18:54 devstack sudo[89623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:18:54 devstack sudo[89623]: pam_unix(sudo:session): session closed for user root Sep 15 16:18:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-fe498eb7-5d4d-4847-b0d1-0a0d094b61bb tempest-AttachVolumeShelveTestJSON-944692299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c97cf5ee-fa69-430c-b583-dc8bfb7fdab7" returned: 0 in 0.359s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:18:54 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-fe498eb7-5d4d-4847-b0d1-0a0d094b61bb tempest-AttachVolumeShelveTestJSON-944692299 None] <== create_volume: return (1118ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:18:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-fe498eb7-5d4d-4847-b0d1-0a0d094b61bb tempest-AttachVolumeShelveTestJSON-944692299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.120s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:18:54 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-fe498eb7-5d4d-4847-b0d1-0a0d094b61bb tempest-AttachVolumeShelveTestJSON-944692299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4adc1ec-a922-400f-b1c3-202f552807a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c97cf5ee-fa69-430c-b583-dc8bfb7fdab7', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:18:55 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-fe498eb7-5d4d-4847-b0d1-0a0d094b61bb tempest-AttachVolumeShelveTestJSON-944692299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af569cc2-fb77-44ee-bf7f-eb64f499be2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:18:55 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-fe498eb7-5d4d-4847-b0d1-0a0d094b61bb tempest-AttachVolumeShelveTestJSON-944692299 None] Volume volume-c97cf5ee-fa69-430c-b583-dc8bfb7fdab7 (c97cf5ee-fa69-430c-b583-dc8bfb7fdab7): created successfully Sep 15 16:18:55 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-fe498eb7-5d4d-4847-b0d1-0a0d094b61bb tempest-AttachVolumeShelveTestJSON-944692299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af569cc2-fb77-44ee-bf7f-eb64f499be2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:18:55 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-fe498eb7-5d4d-4847-b0d1-0a0d094b61bb tempest-AttachVolumeShelveTestJSON-944692299 None] Flow 'volume_create_manager' (8c8c64e2-09d8-4b5a-939f-c57dacac4687) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:18:55 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-fe498eb7-5d4d-4847-b0d1-0a0d094b61bb tempest-AttachVolumeShelveTestJSON-944692299 None] Created volume successfully. Sep 15 16:18:55 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-bc8bd832-21f4-4476-85ae-086b9ce5e5f9 tempest-GroupSnapshotsV319Test-1110091459 None] Group tempest-GroupSnapshotsV319Test-Group-443713697: creating Sep 15 16:18:55 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-bc8bd832-21f4-4476-85ae-086b9ce5e5f9 tempest-GroupSnapshotsV319Test-1110091459 None] Group tempest-GroupSnapshotsV319Test-Group-443713697: created successfully Sep 15 16:18:55 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-bc8bd832-21f4-4476-85ae-086b9ce5e5f9 tempest-GroupSnapshotsV319Test-1110091459 None] Create group completed successfully. Sep 15 16:18:57 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9d34bb8-e7ea-44cc-89d4-3991ff6329bd tempest-GroupSnapshotsV319Test-1110091459 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:18:57 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-a9d34bb8-e7ea-44cc-89d4-3991ff6329bd tempest-GroupSnapshotsV319Test-1110091459 None] Flow 'volume_create_manager' (10e5382e-eca1-4c77-8add-fe7406f92e21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:18:57 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-a9d34bb8-e7ea-44cc-89d4-3991ff6329bd tempest-GroupSnapshotsV319Test-1110091459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdea42c4-b76c-41a5-ac6a-13839d8c3322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:18:57 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-a9d34bb8-e7ea-44cc-89d4-3991ff6329bd tempest-GroupSnapshotsV319Test-1110091459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdea42c4-b76c-41a5-ac6a-13839d8c3322) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:18:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-527117051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=04474d1f-2df3-4156-8856-b65eb4615bb0,host='devstack@QuobyteHD#QuobyteHD',id=31147b80-bf46-4d17-85c4-ef278e6e0651,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='926ae4e1b1754776af24c1b012a01a59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:18:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:18:57Z,use_quota=True,user_id='ff962cc2d90b45f6af999bfc378dfb9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bdcd9e7a-af4f-48a8-bb9a-dc9cc668793d),volume_type_id=bdcd9e7a-af4f-48a8-bb9a-dc9cc668793d)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:18:57 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-a9d34bb8-e7ea-44cc-89d4-3991ff6329bd tempest-GroupSnapshotsV319Test-1110091459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0931c3db-3c5b-4c19-8c1d-623bc1ea7ff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:18:57 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-a9d34bb8-e7ea-44cc-89d4-3991ff6329bd tempest-GroupSnapshotsV319Test-1110091459 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0931c3db-3c5b-4c19-8c1d-623bc1ea7ff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:18:57 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-a9d34bb8-e7ea-44cc-89d4-3991ff6329bd tempest-GroupSnapshotsV319Test-1110091459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d062d8cb-3a2a-4923-9201-8058f02548a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:18:57 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-a9d34bb8-e7ea-44cc-89d4-3991ff6329bd tempest-GroupSnapshotsV319Test-1110091459 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d062d8cb-3a2a-4923-9201-8058f02548a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31147b80-bf46-4d17-85c4-ef278e6e0651', 'volume_name': 'volume-31147b80-bf46-4d17-85c4-ef278e6e0651', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:18:57 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-a9d34bb8-e7ea-44cc-89d4-3991ff6329bd tempest-GroupSnapshotsV319Test-1110091459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae6fedcb-8143-44e1-a042-b9c3587b4e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:18:57 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-a9d34bb8-e7ea-44cc-89d4-3991ff6329bd tempest-GroupSnapshotsV319Test-1110091459 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae6fedcb-8143-44e1-a042-b9c3587b4e25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:18:57 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-a9d34bb8-e7ea-44cc-89d4-3991ff6329bd tempest-GroupSnapshotsV319Test-1110091459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4caeaef-b233-40d4-8a71-385520281273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:18:57 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-a9d34bb8-e7ea-44cc-89d4-3991ff6329bd tempest-GroupSnapshotsV319Test-1110091459 None] Volume 31147b80-bf46-4d17-85c4-ef278e6e0651: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31147b80-bf46-4d17-85c4-ef278e6e0651', 'volume_size': 1} Sep 15 16:18:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-a9d34bb8-e7ea-44cc-89d4-3991ff6329bd tempest-GroupSnapshotsV319Test-1110091459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:18:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-a9d34bb8-e7ea-44cc-89d4-3991ff6329bd tempest-GroupSnapshotsV319Test-1110091459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:18:57 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-a9d34bb8-e7ea-44cc-89d4-3991ff6329bd tempest-GroupSnapshotsV319Test-1110091459 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=04474d1f-2df3-4156-8856-b65eb4615bb0,created_at=2026-09-15T14:18:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-527117051',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=04474d1f-2df3-4156-8856-b65eb4615bb0,host='devstack@QuobyteHD#QuobyteHD',id=31147b80-bf46-4d17-85c4-ef278e6e0651,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='926ae4e1b1754776af24c1b012a01a59',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:18:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:18:57Z,use_quota=True,user_id='ff962cc2d90b45f6af999bfc378dfb9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bdcd9e7a-af4f-48a8-bb9a-dc9cc668793d),volume_type_id=bdcd9e7a-af4f-48a8-bb9a-dc9cc668793d)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:18:57 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-a9d34bb8-e7ea-44cc-89d4-3991ff6329bd tempest-GroupSnapshotsV319Test-1110091459 None] Creating volume 31147b80-bf46-4d17-85c4-ef278e6e0651 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:18:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-a9d34bb8-e7ea-44cc-89d4-3991ff6329bd tempest-GroupSnapshotsV319Test-1110091459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:18:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-a9d34bb8-e7ea-44cc-89d4-3991ff6329bd tempest-GroupSnapshotsV319Test-1110091459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:18:57 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-a9d34bb8-e7ea-44cc-89d4-3991ff6329bd tempest-GroupSnapshotsV319Test-1110091459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:18:57 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-a9d34bb8-e7ea-44cc-89d4-3991ff6329bd tempest-GroupSnapshotsV319Test-1110091459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:18:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-a9d34bb8-e7ea-44cc-89d4-3991ff6329bd tempest-GroupSnapshotsV319Test-1110091459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:18:57 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-a9d34bb8-e7ea-44cc-89d4-3991ff6329bd tempest-GroupSnapshotsV319Test-1110091459 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:18:57 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-a9d34bb8-e7ea-44cc-89d4-3991ff6329bd tempest-GroupSnapshotsV319Test-1110091459 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:18:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a9d34bb8-e7ea-44cc-89d4-3991ff6329bd tempest-GroupSnapshotsV319Test-1110091459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-31147b80-bf46-4d17-85c4-ef278e6e0651 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:18:57 devstack sudo[89678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-31147b80-bf46-4d17-85c4-ef278e6e0651 1073741824 Sep 15 16:18:57 devstack sudo[89678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:18:58 devstack sudo[89678]: pam_unix(sudo:session): session closed for user root Sep 15 16:18:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a9d34bb8-e7ea-44cc-89d4-3991ff6329bd tempest-GroupSnapshotsV319Test-1110091459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-31147b80-bf46-4d17-85c4-ef278e6e0651 1073741824" returned: 0 in 0.683s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:18:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a9d34bb8-e7ea-44cc-89d4-3991ff6329bd tempest-GroupSnapshotsV319Test-1110091459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-31147b80-bf46-4d17-85c4-ef278e6e0651 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:18:58 devstack sudo[89703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-31147b80-bf46-4d17-85c4-ef278e6e0651 Sep 15 16:18:58 devstack sudo[89703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:18:58 devstack sudo[89703]: pam_unix(sudo:session): session closed for user root Sep 15 16:18:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a9d34bb8-e7ea-44cc-89d4-3991ff6329bd tempest-GroupSnapshotsV319Test-1110091459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-31147b80-bf46-4d17-85c4-ef278e6e0651" returned: 0 in 0.466s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:18:58 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-a9d34bb8-e7ea-44cc-89d4-3991ff6329bd tempest-GroupSnapshotsV319Test-1110091459 None] <== create_volume: return (1276ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:18:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-a9d34bb8-e7ea-44cc-89d4-3991ff6329bd tempest-GroupSnapshotsV319Test-1110091459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.282s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:18:58 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-a9d34bb8-e7ea-44cc-89d4-3991ff6329bd tempest-GroupSnapshotsV319Test-1110091459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4caeaef-b233-40d4-8a71-385520281273) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31147b80-bf46-4d17-85c4-ef278e6e0651', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:18:58 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-a9d34bb8-e7ea-44cc-89d4-3991ff6329bd tempest-GroupSnapshotsV319Test-1110091459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f31c7c7e-551b-471f-b86b-6f5a7390b463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:18:58 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-a9d34bb8-e7ea-44cc-89d4-3991ff6329bd tempest-GroupSnapshotsV319Test-1110091459 None] Volume volume-31147b80-bf46-4d17-85c4-ef278e6e0651 (31147b80-bf46-4d17-85c4-ef278e6e0651): created successfully Sep 15 16:18:58 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-a9d34bb8-e7ea-44cc-89d4-3991ff6329bd tempest-GroupSnapshotsV319Test-1110091459 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f31c7c7e-551b-471f-b86b-6f5a7390b463) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:18:58 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-a9d34bb8-e7ea-44cc-89d4-3991ff6329bd tempest-GroupSnapshotsV319Test-1110091459 None] Flow 'volume_create_manager' (10e5382e-eca1-4c77-8add-fe7406f92e21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:18:58 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-a9d34bb8-e7ea-44cc-89d4-3991ff6329bd tempest-GroupSnapshotsV319Test-1110091459 None] Created volume successfully. Sep 15 16:18:59 devstack cinder-volume[86082]: DEBUG oslo_service.periodic_task [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86082) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 15 16:18:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:18:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:18:59 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:18:59 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:18:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:18:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:18:59 devstack sudo[89758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:18:59 devstack sudo[89758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:18:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-8591e722-5dd0-41b8-b2ce-ecc745ac666f req-e2c8627e-9080-4d83-b2fa-27b516208b16 tempest-TaggedAttachmentsTest-475158163 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:18:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-8591e722-5dd0-41b8-b2ce-ecc745ac666f req-e2c8627e-9080-4d83-b2fa-27b516208b16 tempest-TaggedAttachmentsTest-475158163 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:18:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-8591e722-5dd0-41b8-b2ce-ecc745ac666f req-e2c8627e-9080-4d83-b2fa-27b516208b16 tempest-TaggedAttachmentsTest-475158163 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:19:00 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-8591e722-5dd0-41b8-b2ce-ecc745ac666f req-e2c8627e-9080-4d83-b2fa-27b516208b16 tempest-TaggedAttachmentsTest-475158163 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a', 'name': 'volume-6825a2c9-5c9c-45e5-a4a9-ee61297ead2e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8cece00c-ed72-4fdb-8d2d-1fb7d881fe44', 'enforce_multipath': True} {{(pid=86082) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 15 16:19:00 devstack sudo[89758]: pam_unix(sudo:session): session closed for user root Sep 15 16:19:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.323s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:19:00 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:19:00 devstack cinder-volume[86082]: INFO cinder.volume.manager [req-8591e722-5dd0-41b8-b2ce-ecc745ac666f req-e2c8627e-9080-4d83-b2fa-27b516208b16 tempest-TaggedAttachmentsTest-475158163 None] attachment_update completed successfully. Sep 15 16:19:00 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-baab301a-c9d0-471a-8523-2fb4936a0e71 tempest-GroupSnapshotsV319Test-1110091459 None] GroupSnapshot 16b1c1bd-1181-42a5-a14e-ddeed18c88c4: creating. Sep 15 16:19:00 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-baab301a-c9d0-471a-8523-2fb4936a0e71 tempest-GroupSnapshotsV319Test-1110091459 None] Group snapshot 16b1c1bd-1181-42a5-a14e-ddeed18c88c4: creating. {{(pid=86082) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 15 16:19:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-baab301a-c9d0-471a-8523-2fb4936a0e71 tempest-GroupSnapshotsV319Test-1110091459 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:19:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-baab301a-c9d0-471a-8523-2fb4936a0e71 tempest-GroupSnapshotsV319Test-1110091459 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:19:00 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-baab301a-c9d0-471a-8523-2fb4936a0e71 tempest-GroupSnapshotsV319Test-1110091459 None] Creating offline snapshot b61b371f-4345-491c-aacb-922c384f118c of volume 31147b80-bf46-4d17-85c4-ef278e6e0651 {{(pid=86082) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 15 16:19:00 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[a908b596-3512-4c90-a2b2-c662d7a24593]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:19:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-baab301a-c9d0-471a-8523-2fb4936a0e71 tempest-GroupSnapshotsV319Test-1110091459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-31147b80-bf46-4d17-85c4-ef278e6e0651 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:19:00 devstack sudo[89765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-31147b80-bf46-4d17-85c4-ef278e6e0651 Sep 15 16:19:00 devstack sudo[89765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:19:01 devstack sudo[89765]: pam_unix(sudo:session): session closed for user root Sep 15 16:19:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-baab301a-c9d0-471a-8523-2fb4936a0e71 tempest-GroupSnapshotsV319Test-1110091459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-31147b80-bf46-4d17-85c4-ef278e6e0651" returned: 0 in 0.541s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:19:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-baab301a-c9d0-471a-8523-2fb4936a0e71 tempest-GroupSnapshotsV319Test-1110091459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-31147b80-bf46-4d17-85c4-ef278e6e0651,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-31147b80-bf46-4d17-85c4-ef278e6e0651.b61b371f-4345-491c-aacb-922c384f118c 1G {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:19:01 devstack sudo[89770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-31147b80-bf46-4d17-85c4-ef278e6e0651,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-31147b80-bf46-4d17-85c4-ef278e6e0651.b61b371f-4345-491c-aacb-922c384f118c 1G Sep 15 16:19:01 devstack sudo[89770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:19:01 devstack sudo[89770]: pam_unix(sudo:session): session closed for user root Sep 15 16:19:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-baab301a-c9d0-471a-8523-2fb4936a0e71 tempest-GroupSnapshotsV319Test-1110091459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-31147b80-bf46-4d17-85c4-ef278e6e0651,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-31147b80-bf46-4d17-85c4-ef278e6e0651.b61b371f-4345-491c-aacb-922c384f118c 1G" returned: 0 in 0.591s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:19:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-baab301a-c9d0-471a-8523-2fb4936a0e71 tempest-GroupSnapshotsV319Test-1110091459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31147b80-bf46-4d17-85c4-ef278e6e0651 -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-31147b80-bf46-4d17-85c4-ef278e6e0651.b61b371f-4345-491c-aacb-922c384f118c {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:19:01 devstack sudo[89777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31147b80-bf46-4d17-85c4-ef278e6e0651 -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-31147b80-bf46-4d17-85c4-ef278e6e0651.b61b371f-4345-491c-aacb-922c384f118c Sep 15 16:19:01 devstack sudo[89777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:19:02 devstack sudo[89777]: pam_unix(sudo:session): session closed for user root Sep 15 16:19:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-baab301a-c9d0-471a-8523-2fb4936a0e71 tempest-GroupSnapshotsV319Test-1110091459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-31147b80-bf46-4d17-85c4-ef278e6e0651 -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-31147b80-bf46-4d17-85c4-ef278e6e0651.b61b371f-4345-491c-aacb-922c384f118c" returned: 0 in 0.528s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:19:02 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-baab301a-c9d0-471a-8523-2fb4936a0e71 tempest-GroupSnapshotsV319Test-1110091459 None] /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-31147b80-bf46-4d17-85c4-ef278e6e0651.b61b371f-4345-491c-aacb-922c384f118c is being set with open permissions: ugo+rw: NotImplementedError Sep 15 16:19:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-baab301a-c9d0-471a-8523-2fb4936a0e71 tempest-GroupSnapshotsV319Test-1110091459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-31147b80-bf46-4d17-85c4-ef278e6e0651.b61b371f-4345-491c-aacb-922c384f118c {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:19:02 devstack sudo[89787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-31147b80-bf46-4d17-85c4-ef278e6e0651.b61b371f-4345-491c-aacb-922c384f118c Sep 15 16:19:02 devstack sudo[89787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:19:02 devstack sudo[89787]: pam_unix(sudo:session): session closed for user root Sep 15 16:19:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-baab301a-c9d0-471a-8523-2fb4936a0e71 tempest-GroupSnapshotsV319Test-1110091459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-31147b80-bf46-4d17-85c4-ef278e6e0651.b61b371f-4345-491c-aacb-922c384f118c" returned: 0 in 0.391s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:19:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-baab301a-c9d0-471a-8523-2fb4936a0e71 tempest-GroupSnapshotsV319Test-1110091459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-31147b80-bf46-4d17-85c4-ef278e6e0651.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:19:02 devstack sudo[89790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-31147b80-bf46-4d17-85c4-ef278e6e0651.info Sep 15 16:19:02 devstack sudo[89790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:19:03 devstack sudo[89790]: pam_unix(sudo:session): session closed for user root Sep 15 16:19:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-baab301a-c9d0-471a-8523-2fb4936a0e71 tempest-GroupSnapshotsV319Test-1110091459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-31147b80-bf46-4d17-85c4-ef278e6e0651.info" returned: 0 in 0.303s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:19:03 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-baab301a-c9d0-471a-8523-2fb4936a0e71 tempest-GroupSnapshotsV319Test-1110091459 None] /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-31147b80-bf46-4d17-85c4-ef278e6e0651.info is being set with open permissions: ugo+rw: NotImplementedError Sep 15 16:19:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-baab301a-c9d0-471a-8523-2fb4936a0e71 tempest-GroupSnapshotsV319Test-1110091459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-31147b80-bf46-4d17-85c4-ef278e6e0651.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:19:03 devstack sudo[89793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-31147b80-bf46-4d17-85c4-ef278e6e0651.info Sep 15 16:19:03 devstack sudo[89793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:19:03 devstack sudo[89793]: pam_unix(sudo:session): session closed for user root Sep 15 16:19:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-baab301a-c9d0-471a-8523-2fb4936a0e71 tempest-GroupSnapshotsV319Test-1110091459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-31147b80-bf46-4d17-85c4-ef278e6e0651.info" returned: 0 in 0.332s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:19:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-baab301a-c9d0-471a-8523-2fb4936a0e71 tempest-GroupSnapshotsV319Test-1110091459 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.854s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:19:03 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-baab301a-c9d0-471a-8523-2fb4936a0e71 tempest-GroupSnapshotsV319Test-1110091459 None] group_snapshot 16b1c1bd-1181-42a5-a14e-ddeed18c88c4: created successfully Sep 15 16:19:03 devstack cinder-volume[86082]: INFO cinder.volume.manager [req-8ac1009c-209a-4dc2-bcdc-3562515f6a0e req-def06c19-23ed-4f21-a73a-6fe46d1eb0be tempest-TaggedAttachmentsTest-475158163 None] Terminate volume connection completed successfully. Sep 15 16:19:03 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-8ac1009c-209a-4dc2-bcdc-3562515f6a0e req-def06c19-23ed-4f21-a73a-6fe46d1eb0be tempest-TaggedAttachmentsTest-475158163 None] Deleting attachment 8cece00c-ed72-4fdb-8d2d-1fb7d881fe44. {{(pid=86082) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 15 16:19:04 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-114f9e25-c883-4373-ba9e-15c2bd95b3fd tempest-GroupSnapshotsV319Test-1110091459 None] group_snapshot 16b1c1bd-1181-42a5-a14e-ddeed18c88c4: deleting Sep 15 16:19:04 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-114f9e25-c883-4373-ba9e-15c2bd95b3fd tempest-GroupSnapshotsV319Test-1110091459 None] group_snapshot 16b1c1bd-1181-42a5-a14e-ddeed18c88c4: deleting {{(pid=86082) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 15 16:19:04 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-114f9e25-c883-4373-ba9e-15c2bd95b3fd tempest-GroupSnapshotsV319Test-1110091459 None] Acquiring lock "cinder-quobyte-31147b80-bf46-4d17-85c4-ef278e6e0651" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:19:04 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-114f9e25-c883-4373-ba9e-15c2bd95b3fd tempest-GroupSnapshotsV319Test-1110091459 None] Lock "cinder-quobyte-31147b80-bf46-4d17-85c4-ef278e6e0651" acquired by "delete_snapshot" :: waited 0.041s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:19:04 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-114f9e25-c883-4373-ba9e-15c2bd95b3fd tempest-GroupSnapshotsV319Test-1110091459 None] Acquiring lock "cinder-quobyte-b61b371f-4345-491c-aacb-922c384f118c" by "_delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:19:04 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-114f9e25-c883-4373-ba9e-15c2bd95b3fd tempest-GroupSnapshotsV319Test-1110091459 None] Lock "cinder-quobyte-b61b371f-4345-491c-aacb-922c384f118c" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:19:04 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-114f9e25-c883-4373-ba9e-15c2bd95b3fd tempest-GroupSnapshotsV319Test-1110091459 None] Deleting offline snapshot b61b371f-4345-491c-aacb-922c384f118c of volume 31147b80-bf46-4d17-85c4-ef278e6e0651 {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 15 16:19:04 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-114f9e25-c883-4373-ba9e-15c2bd95b3fd tempest-GroupSnapshotsV319Test-1110091459 None] snapshot_file for this snap is: volume-31147b80-bf46-4d17-85c4-ef278e6e0651.b61b371f-4345-491c-aacb-922c384f118c {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 15 16:19:04 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[1346b5dd-94fa-4a88-905c-72ff8117ada0]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:19:04 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-114f9e25-c883-4373-ba9e-15c2bd95b3fd tempest-GroupSnapshotsV319Test-1110091459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-31147b80-bf46-4d17-85c4-ef278e6e0651.b61b371f-4345-491c-aacb-922c384f118c {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:19:04 devstack sudo[89804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-31147b80-bf46-4d17-85c4-ef278e6e0651.b61b371f-4345-491c-aacb-922c384f118c Sep 15 16:19:04 devstack sudo[89804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:19:05 devstack cinder-volume[86082]: INFO cinder.volume.manager [req-405d33c6-6524-4506-8899-2cd9e5ab5f28 req-d8b6a7c5-bf14-472d-af4c-1a1bbfc52fa7 tempest-ServerActionsTestOtherA-844381334 None] Terminate volume connection completed successfully. Sep 15 16:19:05 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-405d33c6-6524-4506-8899-2cd9e5ab5f28 req-d8b6a7c5-bf14-472d-af4c-1a1bbfc52fa7 tempest-ServerActionsTestOtherA-844381334 None] Deleting attachment b6c23fda-32b6-4b88-82f9-e460f5ce500c. {{(pid=86082) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 15 16:19:05 devstack sudo[89804]: pam_unix(sudo:session): session closed for user root Sep 15 16:19:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-114f9e25-c883-4373-ba9e-15c2bd95b3fd tempest-GroupSnapshotsV319Test-1110091459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-31147b80-bf46-4d17-85c4-ef278e6e0651.b61b371f-4345-491c-aacb-922c384f118c" returned: 0 in 0.886s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:19:05 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-114f9e25-c883-4373-ba9e-15c2bd95b3fd tempest-GroupSnapshotsV319Test-1110091459 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-31147b80-bf46-4d17-85c4-ef278e6e0651(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 16:19:05 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[a88e5480-6308-4e93-8a66-0fb619c62260]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:19:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-114f9e25-c883-4373-ba9e-15c2bd95b3fd tempest-GroupSnapshotsV319Test-1110091459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-31147b80-bf46-4d17-85c4-ef278e6e0651 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:19:05 devstack sudo[89841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-31147b80-bf46-4d17-85c4-ef278e6e0651 Sep 15 16:19:05 devstack sudo[89841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:19:06 devstack sudo[89841]: pam_unix(sudo:session): session closed for user root Sep 15 16:19:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-114f9e25-c883-4373-ba9e-15c2bd95b3fd tempest-GroupSnapshotsV319Test-1110091459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-31147b80-bf46-4d17-85c4-ef278e6e0651" returned: 0 in 0.632s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:19:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-114f9e25-c883-4373-ba9e-15c2bd95b3fd tempest-GroupSnapshotsV319Test-1110091459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-31147b80-bf46-4d17-85c4-ef278e6e0651.b61b371f-4345-491c-aacb-922c384f118c {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:19:06 devstack sudo[89855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-31147b80-bf46-4d17-85c4-ef278e6e0651.b61b371f-4345-491c-aacb-922c384f118c Sep 15 16:19:06 devstack sudo[89855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:19:07 devstack sudo[89855]: pam_unix(sudo:session): session closed for user root Sep 15 16:19:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-114f9e25-c883-4373-ba9e-15c2bd95b3fd tempest-GroupSnapshotsV319Test-1110091459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-31147b80-bf46-4d17-85c4-ef278e6e0651.b61b371f-4345-491c-aacb-922c384f118c" returned: 0 in 0.799s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:19:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-114f9e25-c883-4373-ba9e-15c2bd95b3fd tempest-GroupSnapshotsV319Test-1110091459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-31147b80-bf46-4d17-85c4-ef278e6e0651.b61b371f-4345-491c-aacb-922c384f118c {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:19:07 devstack sudo[89910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-31147b80-bf46-4d17-85c4-ef278e6e0651.b61b371f-4345-491c-aacb-922c384f118c Sep 15 16:19:07 devstack sudo[89910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:19:07 devstack sudo[89910]: pam_unix(sudo:session): session closed for user root Sep 15 16:19:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-114f9e25-c883-4373-ba9e-15c2bd95b3fd tempest-GroupSnapshotsV319Test-1110091459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-31147b80-bf46-4d17-85c4-ef278e6e0651.b61b371f-4345-491c-aacb-922c384f118c" returned: 0 in 0.444s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:19:07 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-114f9e25-c883-4373-ba9e-15c2bd95b3fd tempest-GroupSnapshotsV319Test-1110091459 None] Lock "cinder-quobyte-b61b371f-4345-491c-aacb-922c384f118c" released by "_delete_snapshot" :: held 3.001s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:19:07 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-114f9e25-c883-4373-ba9e-15c2bd95b3fd tempest-GroupSnapshotsV319Test-1110091459 None] Lock "cinder-quobyte-31147b80-bf46-4d17-85c4-ef278e6e0651" released by "delete_snapshot" :: held 3.042s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:19:07 devstack cinder-volume[86082]: WARNING cinder.quota [None req-114f9e25-c883-4373-ba9e-15c2bd95b3fd tempest-GroupSnapshotsV319Test-1110091459 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1516259006 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1516259006, it is now deprecated. Please use the default quota class for default quota. Sep 15 16:19:07 devstack cinder-volume[86082]: WARNING cinder.quota [None req-114f9e25-c883-4373-ba9e-15c2bd95b3fd tempest-GroupSnapshotsV319Test-1110091459 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1516259006 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1516259006, it is now deprecated. Please use the default quota class for default quota. Sep 15 16:19:07 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-114f9e25-c883-4373-ba9e-15c2bd95b3fd tempest-GroupSnapshotsV319Test-1110091459 None] Created reservations ['1493d4f0-b054-4d62-a04a-f666f7deefd3', '35eb7ade-b6f3-44aa-a043-a5f61346ab69', '6ae60965-465a-4474-a270-b427dc72539d', 'a08d7030-be1e-4229-a7bd-6536bc8bc265'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:19:07 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-114f9e25-c883-4373-ba9e-15c2bd95b3fd tempest-GroupSnapshotsV319Test-1110091459 None] group_snapshot 16b1c1bd-1181-42a5-a14e-ddeed18c88c4: deleted successfully Sep 15 16:19:08 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-43bc2e27-cc9b-4883-9535-7e5cd0b8deba tempest-GroupSnapshotsV319Test-1110091459 None] Acquiring lock "cinder-quobyte-31147b80-bf46-4d17-85c4-ef278e6e0651" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:19:08 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-43bc2e27-cc9b-4883-9535-7e5cd0b8deba tempest-GroupSnapshotsV319Test-1110091459 None] Lock "cinder-quobyte-31147b80-bf46-4d17-85c4-ef278e6e0651" acquired by "delete_volume" :: waited 0.028s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:19:08 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[05e6eccf-fe0d-4431-b9ce-baec3d7a6a90]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:19:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-43bc2e27-cc9b-4883-9535-7e5cd0b8deba tempest-GroupSnapshotsV319Test-1110091459 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-31147b80-bf46-4d17-85c4-ef278e6e0651 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:19:08 devstack sudo[89925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-31147b80-bf46-4d17-85c4-ef278e6e0651 Sep 15 16:19:08 devstack sudo[89925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:19:09 devstack sudo[89925]: pam_unix(sudo:session): session closed for user root Sep 15 16:19:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-43bc2e27-cc9b-4883-9535-7e5cd0b8deba tempest-GroupSnapshotsV319Test-1110091459 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-31147b80-bf46-4d17-85c4-ef278e6e0651" returned: 0 in 0.536s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:19:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-43bc2e27-cc9b-4883-9535-7e5cd0b8deba tempest-GroupSnapshotsV319Test-1110091459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-31147b80-bf46-4d17-85c4-ef278e6e0651 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:19:09 devstack sudo[89931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-31147b80-bf46-4d17-85c4-ef278e6e0651 Sep 15 16:19:09 devstack sudo[89931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:19:09 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-88dfb87c-f34f-4868-82b1-b99714f03df0 req-7f6d98b6-c833-42d0-8357-e359dddd6033 tempest-AttachVolumeShelveTestJSON-944692299 None] No connector for attachment b0b2b290-957c-4786-adc1-776a0c431ad2; skipping storage backend terminate_connection call. {{(pid=86082) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 15 16:19:09 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-88dfb87c-f34f-4868-82b1-b99714f03df0 req-7f6d98b6-c833-42d0-8357-e359dddd6033 tempest-AttachVolumeShelveTestJSON-944692299 None] Deleting attachment b0b2b290-957c-4786-adc1-776a0c431ad2. {{(pid=86082) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 15 16:19:09 devstack sudo[89931]: pam_unix(sudo:session): session closed for user root Sep 15 16:19:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-43bc2e27-cc9b-4883-9535-7e5cd0b8deba tempest-GroupSnapshotsV319Test-1110091459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-31147b80-bf46-4d17-85c4-ef278e6e0651" returned: 0 in 0.493s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:19:09 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-43bc2e27-cc9b-4883-9535-7e5cd0b8deba tempest-GroupSnapshotsV319Test-1110091459 None] Lock "cinder-quobyte-31147b80-bf46-4d17-85c4-ef278e6e0651" released by "delete_volume" :: held 1.203s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:19:10 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-43bc2e27-cc9b-4883-9535-7e5cd0b8deba tempest-GroupSnapshotsV319Test-1110091459 None] Created reservations ['4579d1b4-f643-4893-b1f2-05a6699c713f'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:19:10 devstack cinder-volume[86082]: WARNING cinder.quota [None req-43bc2e27-cc9b-4883-9535-7e5cd0b8deba tempest-GroupSnapshotsV319Test-1110091459 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1516259006 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1516259006, it is now deprecated. Please use the default quota class for default quota. Sep 15 16:19:10 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-43bc2e27-cc9b-4883-9535-7e5cd0b8deba tempest-GroupSnapshotsV319Test-1110091459 None] Created reservations ['cda95010-9108-4736-ba68-1cab5166ca05', 'd588a411-cacf-4121-9bf9-dfa8695d4747', 'b482b2cd-542f-44ed-a35f-72e07d1d26f4', '4b445d6e-9c0d-45d5-b23b-9403d3ce1d09'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:19:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-43bc2e27-cc9b-4883-9535-7e5cd0b8deba tempest-GroupSnapshotsV319Test-1110091459 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:19:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-43bc2e27-cc9b-4883-9535-7e5cd0b8deba tempest-GroupSnapshotsV319Test-1110091459 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:19:10 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-43bc2e27-cc9b-4883-9535-7e5cd0b8deba tempest-GroupSnapshotsV319Test-1110091459 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:19:10 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-43bc2e27-cc9b-4883-9535-7e5cd0b8deba tempest-GroupSnapshotsV319Test-1110091459 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:19:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-43bc2e27-cc9b-4883-9535-7e5cd0b8deba tempest-GroupSnapshotsV319Test-1110091459 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:19:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-43bc2e27-cc9b-4883-9535-7e5cd0b8deba tempest-GroupSnapshotsV319Test-1110091459 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:19:10 devstack sudo[89956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:19:10 devstack sudo[89956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:19:10 devstack sudo[89956]: pam_unix(sudo:session): session closed for user root Sep 15 16:19:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-43bc2e27-cc9b-4883-9535-7e5cd0b8deba tempest-GroupSnapshotsV319Test-1110091459 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.531s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:19:10 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-43bc2e27-cc9b-4883-9535-7e5cd0b8deba tempest-GroupSnapshotsV319Test-1110091459 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:19:10 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-43bc2e27-cc9b-4883-9535-7e5cd0b8deba tempest-GroupSnapshotsV319Test-1110091459 None] Delete group completed successfully. Sep 15 16:19:15 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-28c2e173-c2de-4168-8313-3e85bf69c281 tempest-ServerActionsTestOtherA-844381334 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:19:15 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-28c2e173-c2de-4168-8313-3e85bf69c281 tempest-ServerActionsTestOtherA-844381334 None] Flow 'volume_create_manager' (5522154a-c5dc-4a52-bd35-04216a7a4d4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:19:15 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-28c2e173-c2de-4168-8313-3e85bf69c281 tempest-ServerActionsTestOtherA-844381334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c20c901-4f1e-457f-8666-49bffb8c40aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:19:15 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-28c2e173-c2de-4168-8313-3e85bf69c281 tempest-ServerActionsTestOtherA-844381334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c20c901-4f1e-457f-8666-49bffb8c40aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:19:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-424858483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65c6e635-b755-47cf-8c51-e55007e80e16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc54975820cf40a19e4f67d584f7b780',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:19:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:19:16Z,use_quota=True,user_id='cb78901227b84ba691b3c2032af50923',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:19:16 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-28c2e173-c2de-4168-8313-3e85bf69c281 tempest-ServerActionsTestOtherA-844381334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad86ca43-5f2b-4bf3-a8ea-50a46ed9472b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:19:16 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-28c2e173-c2de-4168-8313-3e85bf69c281 tempest-ServerActionsTestOtherA-844381334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad86ca43-5f2b-4bf3-a8ea-50a46ed9472b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:19:16 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-28c2e173-c2de-4168-8313-3e85bf69c281 tempest-ServerActionsTestOtherA-844381334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c45b609a-a59c-4b95-9a99-4584c24dac14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:19:16 devstack cinder-volume[86082]: DEBUG cinder.image.glance [None req-28c2e173-c2de-4168-8313-3e85bf69c281 tempest-ServerActionsTestOtherA-844381334 None] Creating Keystone auth plugin from conf {{(pid=86082) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 15 16:19:16 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-28c2e173-c2de-4168-8313-3e85bf69c281 tempest-ServerActionsTestOtherA-844381334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c45b609a-a59c-4b95-9a99-4584c24dac14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '65c6e635-b755-47cf-8c51-e55007e80e16', 'volume_name': 'volume-65c6e635-b755-47cf-8c51-e55007e80e16', 'volume_size': 1, 'image_id': '0ea392d9-2af0-468e-bdc1-5e3f34bc52e6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0ea392d9-2af0-468e-bdc1-5e3f34bc52e6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e57b859e1a41428083b6d86ce51f5184', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0ea392d9-2af0-468e-bdc1-5e3f34bc52e6', 'created_at': datetime.datetime(2026, 9, 15, 14, 11, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 15, 14, 11, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0ea392d9-2af0-468e-bdc1-5e3f34bc52e6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:19:16 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-28c2e173-c2de-4168-8313-3e85bf69c281 tempest-ServerActionsTestOtherA-844381334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (023ca824-9f57-40eb-b5a4-ff897db09470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:19:16 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-28c2e173-c2de-4168-8313-3e85bf69c281 tempest-ServerActionsTestOtherA-844381334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (023ca824-9f57-40eb-b5a4-ff897db09470) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:19:16 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-28c2e173-c2de-4168-8313-3e85bf69c281 tempest-ServerActionsTestOtherA-844381334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60852a05-0dca-4664-9d2b-1b576c9af2d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:19:16 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-28c2e173-c2de-4168-8313-3e85bf69c281 tempest-ServerActionsTestOtherA-844381334 None] Volume 65c6e635-b755-47cf-8c51-e55007e80e16: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-65c6e635-b755-47cf-8c51-e55007e80e16', 'volume_size': 1, 'image_id': '0ea392d9-2af0-468e-bdc1-5e3f34bc52e6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0ea392d9-2af0-468e-bdc1-5e3f34bc52e6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e57b859e1a41428083b6d86ce51f5184', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0ea392d9-2af0-468e-bdc1-5e3f34bc52e6', 'created_at': datetime.datetime(2026, 9, 15, 14, 11, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 15, 14, 11, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0ea392d9-2af0-468e-bdc1-5e3f34bc52e6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 15 16:19:16 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-28c2e173-c2de-4168-8313-3e85bf69c281 tempest-ServerActionsTestOtherA-844381334 None] Trying to clone 65c6e635-b755-47cf-8c51-e55007e80e16 from image 0ea392d9-2af0-468e-bdc1-5e3f34bc52e6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/0ea392d9-2af0-468e-bdc1-5e3f34bc52e6', 'metadata': {}}]). {{(pid=86082) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 15 16:19:17 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-28c2e173-c2de-4168-8313-3e85bf69c281 tempest-ServerActionsTestOtherA-844381334 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0ea392d9-2af0-468e-bdc1-5e3f34bc52e6_lhz3vkmqdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86082) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 15 16:19:17 devstack cinder-volume[86082]: INFO cinder.image.image_utils [None req-28c2e173-c2de-4168-8313-3e85bf69c281 tempest-ServerActionsTestOtherA-844381334 None] Image download 20.69 MB at 20.69 MB/s Sep 15 16:19:17 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[41eab984-ebe6-4eac-9fea-aed5eb60ed98]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:19:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-28c2e173-c2de-4168-8313-3e85bf69c281 tempest-ServerActionsTestOtherA-844381334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ea392d9-2af0-468e-bdc1-5e3f34bc52e6_lhz3vkmqdevstack@QuobyteHD {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:19:17 devstack sudo[89994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ea392d9-2af0-468e-bdc1-5e3f34bc52e6_lhz3vkmqdevstack@QuobyteHD Sep 15 16:19:17 devstack sudo[89994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:19:17 devstack sudo[89994]: pam_unix(sudo:session): session closed for user root Sep 15 16:19:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-28c2e173-c2de-4168-8313-3e85bf69c281 tempest-ServerActionsTestOtherA-844381334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ea392d9-2af0-468e-bdc1-5e3f34bc52e6_lhz3vkmqdevstack@QuobyteHD" returned: 0 in 0.433s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:19:17 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-28c2e173-c2de-4168-8313-3e85bf69c281 tempest-ServerActionsTestOtherA-844381334 None] Temporary image 0ea392d9-2af0-468e-bdc1-5e3f34bc52e6 is fetched for user cb78901227b84ba691b3c2032af50923. {{(pid=86082) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 15 16:19:17 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[862654f0-72ba-443a-99f3-b6ec2cf2854d]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:19:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-28c2e173-c2de-4168-8313-3e85bf69c281 tempest-ServerActionsTestOtherA-844381334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ea392d9-2af0-468e-bdc1-5e3f34bc52e6_lhz3vkmqdevstack@QuobyteHD {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:19:18 devstack sudo[90001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ea392d9-2af0-468e-bdc1-5e3f34bc52e6_lhz3vkmqdevstack@QuobyteHD Sep 15 16:19:18 devstack sudo[90001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:19:18 devstack sudo[90001]: pam_unix(sudo:session): session closed for user root Sep 15 16:19:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-28c2e173-c2de-4168-8313-3e85bf69c281 tempest-ServerActionsTestOtherA-844381334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ea392d9-2af0-468e-bdc1-5e3f34bc52e6_lhz3vkmqdevstack@QuobyteHD" returned: 0 in 0.514s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:19:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-28c2e173-c2de-4168-8313-3e85bf69c281 tempest-ServerActionsTestOtherA-844381334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:19:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-28c2e173-c2de-4168-8313-3e85bf69c281 tempest-ServerActionsTestOtherA-844381334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:19:18 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-28c2e173-c2de-4168-8313-3e85bf69c281 tempest-ServerActionsTestOtherA-844381334 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:19:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-424858483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65c6e635-b755-47cf-8c51-e55007e80e16,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc54975820cf40a19e4f67d584f7b780',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:19:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:19:16Z,use_quota=True,user_id='cb78901227b84ba691b3c2032af50923',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:19:18 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-28c2e173-c2de-4168-8313-3e85bf69c281 tempest-ServerActionsTestOtherA-844381334 None] Creating volume 65c6e635-b755-47cf-8c51-e55007e80e16 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:19:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-28c2e173-c2de-4168-8313-3e85bf69c281 tempest-ServerActionsTestOtherA-844381334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:19:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-28c2e173-c2de-4168-8313-3e85bf69c281 tempest-ServerActionsTestOtherA-844381334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:19:18 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-28c2e173-c2de-4168-8313-3e85bf69c281 tempest-ServerActionsTestOtherA-844381334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:19:18 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-28c2e173-c2de-4168-8313-3e85bf69c281 tempest-ServerActionsTestOtherA-844381334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:19:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-28c2e173-c2de-4168-8313-3e85bf69c281 tempest-ServerActionsTestOtherA-844381334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:19:18 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-28c2e173-c2de-4168-8313-3e85bf69c281 tempest-ServerActionsTestOtherA-844381334 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:19:18 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-28c2e173-c2de-4168-8313-3e85bf69c281 tempest-ServerActionsTestOtherA-844381334 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:19:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-28c2e173-c2de-4168-8313-3e85bf69c281 tempest-ServerActionsTestOtherA-844381334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-65c6e635-b755-47cf-8c51-e55007e80e16 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:19:18 devstack sudo[90008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-65c6e635-b755-47cf-8c51-e55007e80e16 1073741824 Sep 15 16:19:18 devstack sudo[90008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:19:18 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f3bb3cfc-98fd-4a95-b114-ee865ea80db9 tempest-TaggedAttachmentsTest-475158163 None] Acquiring lock "cinder-6825a2c9-5c9c-45e5-a4a9-ee61297ead2e-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:19:18 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f3bb3cfc-98fd-4a95-b114-ee865ea80db9 tempest-TaggedAttachmentsTest-475158163 None] Lock "cinder-6825a2c9-5c9c-45e5-a4a9-ee61297ead2e-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:19:18 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f3bb3cfc-98fd-4a95-b114-ee865ea80db9 tempest-TaggedAttachmentsTest-475158163 None] Acquiring lock "cinder-quobyte-6825a2c9-5c9c-45e5-a4a9-ee61297ead2e" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:19:18 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f3bb3cfc-98fd-4a95-b114-ee865ea80db9 tempest-TaggedAttachmentsTest-475158163 None] Lock "cinder-quobyte-6825a2c9-5c9c-45e5-a4a9-ee61297ead2e" acquired by "delete_volume" :: waited 0.048s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:19:18 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d0184dc-975c-4f45-8382-ffad70197ac4]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:19:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f3bb3cfc-98fd-4a95-b114-ee865ea80db9 tempest-TaggedAttachmentsTest-475158163 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6825a2c9-5c9c-45e5-a4a9-ee61297ead2e {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:19:18 devstack sudo[90013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6825a2c9-5c9c-45e5-a4a9-ee61297ead2e Sep 15 16:19:18 devstack sudo[90013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:19:19 devstack sudo[90008]: pam_unix(sudo:session): session closed for user root Sep 15 16:19:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-28c2e173-c2de-4168-8313-3e85bf69c281 tempest-ServerActionsTestOtherA-844381334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-65c6e635-b755-47cf-8c51-e55007e80e16 1073741824" returned: 0 in 0.799s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:19:19 devstack sudo[90013]: pam_unix(sudo:session): session closed for user root Sep 15 16:19:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f3bb3cfc-98fd-4a95-b114-ee865ea80db9 tempest-TaggedAttachmentsTest-475158163 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6825a2c9-5c9c-45e5-a4a9-ee61297ead2e" returned: 0 in 0.488s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:19:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f3bb3cfc-98fd-4a95-b114-ee865ea80db9 tempest-TaggedAttachmentsTest-475158163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6825a2c9-5c9c-45e5-a4a9-ee61297ead2e {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:19:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-28c2e173-c2de-4168-8313-3e85bf69c281 tempest-ServerActionsTestOtherA-844381334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-65c6e635-b755-47cf-8c51-e55007e80e16 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:19:19 devstack sudo[90018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6825a2c9-5c9c-45e5-a4a9-ee61297ead2e Sep 15 16:19:19 devstack sudo[90018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:19:19 devstack sudo[90020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-65c6e635-b755-47cf-8c51-e55007e80e16 Sep 15 16:19:19 devstack sudo[90020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:19:19 devstack sudo[90018]: pam_unix(sudo:session): session closed for user root Sep 15 16:19:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f3bb3cfc-98fd-4a95-b114-ee865ea80db9 tempest-TaggedAttachmentsTest-475158163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6825a2c9-5c9c-45e5-a4a9-ee61297ead2e" returned: 0 in 0.309s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:19:19 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f3bb3cfc-98fd-4a95-b114-ee865ea80db9 tempest-TaggedAttachmentsTest-475158163 None] Lock "cinder-quobyte-6825a2c9-5c9c-45e5-a4a9-ee61297ead2e" released by "delete_volume" :: held 0.850s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:19:19 devstack sudo[90020]: pam_unix(sudo:session): session closed for user root Sep 15 16:19:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-28c2e173-c2de-4168-8313-3e85bf69c281 tempest-ServerActionsTestOtherA-844381334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-65c6e635-b755-47cf-8c51-e55007e80e16" returned: 0 in 0.328s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:19:19 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-28c2e173-c2de-4168-8313-3e85bf69c281 tempest-ServerActionsTestOtherA-844381334 None] <== create_volume: return (1248ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:19:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-28c2e173-c2de-4168-8313-3e85bf69c281 tempest-ServerActionsTestOtherA-844381334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.251s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:19:19 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-f3bb3cfc-98fd-4a95-b114-ee865ea80db9 tempest-TaggedAttachmentsTest-475158163 None] Created reservations ['d9578b99-df2b-4e09-8cd0-3aa83cf0fdf0', 'ccec4578-95cc-4ce3-8f05-ab3f78cec638', '097a15e6-148a-4e85-9f2e-161f2c02ee00', '766f24a2-06ff-4d3d-a7b1-ab1cabbdd70a'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:19:19 devstack cinder-volume[86082]: DEBUG cinder.volume.volume_utils [None req-28c2e173-c2de-4168-8313-3e85bf69c281 tempest-ServerActionsTestOtherA-844381334 None] Attempting download of 0ea392d9-2af0-468e-bdc1-5e3f34bc52e6 ((None, [{'url': 'file:///opt/stack/data/glance/images/0ea392d9-2af0-468e-bdc1-5e3f34bc52e6', 'metadata': {}}])) to volume 65c6e635-b755-47cf-8c51-e55007e80e16. {{(pid=86082) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 15 16:19:19 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[93b2d60f-2964-438b-90ef-e22fbbb8f30d]: (4, 'raw') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:19:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-28c2e173-c2de-4168-8313-3e85bf69c281 tempest-ServerActionsTestOtherA-844381334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0ea392d9-2af0-468e-bdc1-5e3f34bc52e6_j_sysxtp {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:19:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f3bb3cfc-98fd-4a95-b114-ee865ea80db9 tempest-TaggedAttachmentsTest-475158163 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:19:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f3bb3cfc-98fd-4a95-b114-ee865ea80db9 tempest-TaggedAttachmentsTest-475158163 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:19:19 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-f3bb3cfc-98fd-4a95-b114-ee865ea80db9 tempest-TaggedAttachmentsTest-475158163 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:19:19 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-f3bb3cfc-98fd-4a95-b114-ee865ea80db9 tempest-TaggedAttachmentsTest-475158163 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:19:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f3bb3cfc-98fd-4a95-b114-ee865ea80db9 tempest-TaggedAttachmentsTest-475158163 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:19:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f3bb3cfc-98fd-4a95-b114-ee865ea80db9 tempest-TaggedAttachmentsTest-475158163 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:19:19 devstack sudo[90025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:19:19 devstack sudo[90025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:19:20 devstack sudo[90024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0ea392d9-2af0-468e-bdc1-5e3f34bc52e6_j_sysxtp Sep 15 16:19:20 devstack sudo[90024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:19:20 devstack sudo[90025]: pam_unix(sudo:session): session closed for user root Sep 15 16:19:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f3bb3cfc-98fd-4a95-b114-ee865ea80db9 tempest-TaggedAttachmentsTest-475158163 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.446s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:19:20 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-f3bb3cfc-98fd-4a95-b114-ee865ea80db9 tempest-TaggedAttachmentsTest-475158163 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:19:20 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-f3bb3cfc-98fd-4a95-b114-ee865ea80db9 tempest-TaggedAttachmentsTest-475158163 None] Deleted volume successfully. Sep 15 16:19:20 devstack sudo[90024]: pam_unix(sudo:session): session closed for user root Sep 15 16:19:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-28c2e173-c2de-4168-8313-3e85bf69c281 tempest-ServerActionsTestOtherA-844381334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0ea392d9-2af0-468e-bdc1-5e3f34bc52e6_j_sysxtp" returned: 0 in 0.554s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:19:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-28c2e173-c2de-4168-8313-3e85bf69c281 tempest-ServerActionsTestOtherA-844381334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0ea392d9-2af0-468e-bdc1-5e3f34bc52e6_j_sysxtp {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:19:20 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f3bb3cfc-98fd-4a95-b114-ee865ea80db9 tempest-TaggedAttachmentsTest-475158163 None] Lock "cinder-6825a2c9-5c9c-45e5-a4a9-ee61297ead2e-delete_volume" released by "delete_volume" :: held 1.704s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:19:20 devstack sudo[90031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0ea392d9-2af0-468e-bdc1-5e3f34bc52e6_j_sysxtp Sep 15 16:19:20 devstack sudo[90031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:19:20 devstack sudo[90031]: pam_unix(sudo:session): session closed for user root Sep 15 16:19:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-28c2e173-c2de-4168-8313-3e85bf69c281 tempest-ServerActionsTestOtherA-844381334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0ea392d9-2af0-468e-bdc1-5e3f34bc52e6_j_sysxtp" returned: 1 in 0.394s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:19:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-28c2e173-c2de-4168-8313-3e85bf69c281 tempest-ServerActionsTestOtherA-844381334 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0ea392d9-2af0-468e-bdc1-5e3f34bc52e6_j_sysxtp' failed. Not Retrying. {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 15 16:19:20 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a00ac49-dfbd-41a7-9cd1-366a30758869]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:19:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-28c2e173-c2de-4168-8313-3e85bf69c281 tempest-ServerActionsTestOtherA-844381334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ea392d9-2af0-468e-bdc1-5e3f34bc52e6_lhz3vkmqdevstack@QuobyteHD {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:19:20 devstack sudo[90044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ea392d9-2af0-468e-bdc1-5e3f34bc52e6_lhz3vkmqdevstack@QuobyteHD Sep 15 16:19:20 devstack sudo[90044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:19:21 devstack sudo[90044]: pam_unix(sudo:session): session closed for user root Sep 15 16:19:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-28c2e173-c2de-4168-8313-3e85bf69c281 tempest-ServerActionsTestOtherA-844381334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ea392d9-2af0-468e-bdc1-5e3f34bc52e6_lhz3vkmqdevstack@QuobyteHD" returned: 0 in 0.399s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:19:21 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-28c2e173-c2de-4168-8313-3e85bf69c281 tempest-ServerActionsTestOtherA-844381334 None] 0ea392d9-2af0-468e-bdc1-5e3f34bc52e6 was qcow2, converting to qcow2 {{(pid=86082) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 15 16:19:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-28c2e173-c2de-4168-8313-3e85bf69c281 tempest-ServerActionsTestOtherA-844381334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0ea392d9-2af0-468e-bdc1-5e3f34bc52e6_lhz3vkmqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-65c6e635-b755-47cf-8c51-e55007e80e16 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:19:21 devstack sudo[90056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0ea392d9-2af0-468e-bdc1-5e3f34bc52e6_lhz3vkmqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-65c6e635-b755-47cf-8c51-e55007e80e16 Sep 15 16:19:21 devstack sudo[90056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:19:21 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-a3a9c0c9-8c49-4974-9351-c6d149a17a8a tempest-GroupsV314Test-1769010214 None] Group tempest-GroupsV314Test-Group-1591688329: creating Sep 15 16:19:21 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-a3a9c0c9-8c49-4974-9351-c6d149a17a8a tempest-GroupsV314Test-1769010214 None] Group tempest-GroupsV314Test-Group-1591688329: created successfully Sep 15 16:19:21 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-a3a9c0c9-8c49-4974-9351-c6d149a17a8a tempest-GroupsV314Test-1769010214 None] Create group completed successfully. Sep 15 16:19:23 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-a648964a-9b3a-482b-97e8-c44d82e03e39 tempest-GroupsV314Test-1769010214 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:19:23 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-a648964a-9b3a-482b-97e8-c44d82e03e39 tempest-GroupsV314Test-1769010214 None] Flow 'volume_create_manager' (9b1c765a-c47d-4e9d-a81a-ec05d146dbcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:19:23 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-a648964a-9b3a-482b-97e8-c44d82e03e39 tempest-GroupsV314Test-1769010214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75415f86-74e5-45c7-b6b4-eac49b496bd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:19:23 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-a648964a-9b3a-482b-97e8-c44d82e03e39 tempest-GroupsV314Test-1769010214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75415f86-74e5-45c7-b6b4-eac49b496bd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:19:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-751017783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=120ae8e5-7f89-4034-a305-4f96398a5be7,host='devstack@QuobyteHD#QuobyteHD',id=fb51e856-a1b6-4322-ba72-3279bb42942e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4a0c85b541a4ecd8e806a3264ab8861',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:19:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:19:23Z,use_quota=True,user_id='5d06d0cd8ce44e9593b75202975a6345',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(668bbd25-f8d0-4a0e-90b6-66ab85b9d371),volume_type_id=668bbd25-f8d0-4a0e-90b6-66ab85b9d371)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:19:23 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-a648964a-9b3a-482b-97e8-c44d82e03e39 tempest-GroupsV314Test-1769010214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a093200b-5c13-4584-87a0-1e92b0112046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:19:23 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-a648964a-9b3a-482b-97e8-c44d82e03e39 tempest-GroupsV314Test-1769010214 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a093200b-5c13-4584-87a0-1e92b0112046) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:19:23 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-a648964a-9b3a-482b-97e8-c44d82e03e39 tempest-GroupsV314Test-1769010214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c7dbab1-6abb-4fad-82e6-2de54d627cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:19:23 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-a648964a-9b3a-482b-97e8-c44d82e03e39 tempest-GroupsV314Test-1769010214 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c7dbab1-6abb-4fad-82e6-2de54d627cb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb51e856-a1b6-4322-ba72-3279bb42942e', 'volume_name': 'volume-fb51e856-a1b6-4322-ba72-3279bb42942e', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:19:23 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-a648964a-9b3a-482b-97e8-c44d82e03e39 tempest-GroupsV314Test-1769010214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5320cff-d5b4-4d5b-8e22-9eae8c3bac9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:19:23 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-a648964a-9b3a-482b-97e8-c44d82e03e39 tempest-GroupsV314Test-1769010214 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5320cff-d5b4-4d5b-8e22-9eae8c3bac9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:19:23 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-a648964a-9b3a-482b-97e8-c44d82e03e39 tempest-GroupsV314Test-1769010214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24ebde63-20a7-4ab5-80b1-66703011f43b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:19:23 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-a648964a-9b3a-482b-97e8-c44d82e03e39 tempest-GroupsV314Test-1769010214 None] Volume fb51e856-a1b6-4322-ba72-3279bb42942e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb51e856-a1b6-4322-ba72-3279bb42942e', 'volume_size': 1} Sep 15 16:19:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-a648964a-9b3a-482b-97e8-c44d82e03e39 tempest-GroupsV314Test-1769010214 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:19:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-a648964a-9b3a-482b-97e8-c44d82e03e39 tempest-GroupsV314Test-1769010214 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:19:23 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-a648964a-9b3a-482b-97e8-c44d82e03e39 tempest-GroupsV314Test-1769010214 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=120ae8e5-7f89-4034-a305-4f96398a5be7,created_at=2026-09-15T14:19:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-751017783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=120ae8e5-7f89-4034-a305-4f96398a5be7,host='devstack@QuobyteHD#QuobyteHD',id=fb51e856-a1b6-4322-ba72-3279bb42942e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4a0c85b541a4ecd8e806a3264ab8861',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:19:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:19:23Z,use_quota=True,user_id='5d06d0cd8ce44e9593b75202975a6345',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(668bbd25-f8d0-4a0e-90b6-66ab85b9d371),volume_type_id=668bbd25-f8d0-4a0e-90b6-66ab85b9d371)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:19:23 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-a648964a-9b3a-482b-97e8-c44d82e03e39 tempest-GroupsV314Test-1769010214 None] Creating volume fb51e856-a1b6-4322-ba72-3279bb42942e {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:19:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-a648964a-9b3a-482b-97e8-c44d82e03e39 tempest-GroupsV314Test-1769010214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:19:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-a648964a-9b3a-482b-97e8-c44d82e03e39 tempest-GroupsV314Test-1769010214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:19:23 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-a648964a-9b3a-482b-97e8-c44d82e03e39 tempest-GroupsV314Test-1769010214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:19:23 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-a648964a-9b3a-482b-97e8-c44d82e03e39 tempest-GroupsV314Test-1769010214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:19:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-a648964a-9b3a-482b-97e8-c44d82e03e39 tempest-GroupsV314Test-1769010214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:19:23 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-a648964a-9b3a-482b-97e8-c44d82e03e39 tempest-GroupsV314Test-1769010214 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:19:23 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-a648964a-9b3a-482b-97e8-c44d82e03e39 tempest-GroupsV314Test-1769010214 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:19:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a648964a-9b3a-482b-97e8-c44d82e03e39 tempest-GroupsV314Test-1769010214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-fb51e856-a1b6-4322-ba72-3279bb42942e 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:19:23 devstack sudo[90086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-fb51e856-a1b6-4322-ba72-3279bb42942e 1073741824 Sep 15 16:19:23 devstack sudo[90086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:19:24 devstack sudo[90056]: pam_unix(sudo:session): session closed for user root Sep 15 16:19:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-28c2e173-c2de-4168-8313-3e85bf69c281 tempest-ServerActionsTestOtherA-844381334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0ea392d9-2af0-468e-bdc1-5e3f34bc52e6_lhz3vkmqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-65c6e635-b755-47cf-8c51-e55007e80e16" returned: 0 in 2.958s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:19:24 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-28c2e173-c2de-4168-8313-3e85bf69c281 tempest-ServerActionsTestOtherA-844381334 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0ea392d9-2af0-468e-bdc1-5e3f34bc52e6_lhz3vkmqdevstack@QuobyteHD, size 112.00 MB, duration 2.96 sec, destination /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-65c6e635-b755-47cf-8c51-e55007e80e16 {{(pid=86082) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 15 16:19:24 devstack cinder-volume[86082]: INFO cinder.image.image_utils [None req-28c2e173-c2de-4168-8313-3e85bf69c281 tempest-ServerActionsTestOtherA-844381334 None] Converted 112.00 MB image at 37.85 MB/s Sep 15 16:19:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-28c2e173-c2de-4168-8313-3e85bf69c281 tempest-ServerActionsTestOtherA-844381334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-65c6e635-b755-47cf-8c51-e55007e80e16 1G {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:19:24 devstack sudo[90103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-65c6e635-b755-47cf-8c51-e55007e80e16 1G Sep 15 16:19:24 devstack sudo[90103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:19:24 devstack sudo[90086]: pam_unix(sudo:session): session closed for user root Sep 15 16:19:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a648964a-9b3a-482b-97e8-c44d82e03e39 tempest-GroupsV314Test-1769010214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-fb51e856-a1b6-4322-ba72-3279bb42942e 1073741824" returned: 0 in 0.709s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:19:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a648964a-9b3a-482b-97e8-c44d82e03e39 tempest-GroupsV314Test-1769010214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-fb51e856-a1b6-4322-ba72-3279bb42942e {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:19:24 devstack sudo[90111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-fb51e856-a1b6-4322-ba72-3279bb42942e Sep 15 16:19:24 devstack sudo[90111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:19:24 devstack sudo[90103]: pam_unix(sudo:session): session closed for user root Sep 15 16:19:24 devstack sudo[90111]: pam_unix(sudo:session): session closed for user root Sep 15 16:19:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-28c2e173-c2de-4168-8313-3e85bf69c281 tempest-ServerActionsTestOtherA-844381334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-65c6e635-b755-47cf-8c51-e55007e80e16 1G" returned: 0 in 0.731s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:19:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a648964a-9b3a-482b-97e8-c44d82e03e39 tempest-GroupsV314Test-1769010214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-fb51e856-a1b6-4322-ba72-3279bb42942e" returned: 0 in 0.579s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:19:24 devstack cinder-volume[86082]: DEBUG cinder.volume.volume_utils [None req-28c2e173-c2de-4168-8313-3e85bf69c281 tempest-ServerActionsTestOtherA-844381334 None] Downloaded image 0ea392d9-2af0-468e-bdc1-5e3f34bc52e6 ((None, [{'url': 'file:///opt/stack/data/glance/images/0ea392d9-2af0-468e-bdc1-5e3f34bc52e6', 'metadata': {}}])) to volume 65c6e635-b755-47cf-8c51-e55007e80e16 successfully. {{(pid=86082) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 15 16:19:24 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-28c2e173-c2de-4168-8313-3e85bf69c281 tempest-ServerActionsTestOtherA-844381334 None] Temporary image 0ea392d9-2af0-468e-bdc1-5e3f34bc52e6 for user cb78901227b84ba691b3c2032af50923 is deleted. {{(pid=86082) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 15 16:19:24 devstack cinder-volume[86082]: DEBUG cinder.volume.volume_utils [None req-28c2e173-c2de-4168-8313-3e85bf69c281 tempest-ServerActionsTestOtherA-844381334 None] Marking volume 65c6e635-b755-47cf-8c51-e55007e80e16 as bootable. {{(pid=86082) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 15 16:19:24 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-a648964a-9b3a-482b-97e8-c44d82e03e39 tempest-GroupsV314Test-1769010214 None] <== create_volume: return (1375ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:19:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-a648964a-9b3a-482b-97e8-c44d82e03e39 tempest-GroupsV314Test-1769010214 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.378s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:19:24 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-a648964a-9b3a-482b-97e8-c44d82e03e39 tempest-GroupsV314Test-1769010214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24ebde63-20a7-4ab5-80b1-66703011f43b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb51e856-a1b6-4322-ba72-3279bb42942e', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:19:24 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-a648964a-9b3a-482b-97e8-c44d82e03e39 tempest-GroupsV314Test-1769010214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef80167c-b8e3-4a48-a071-99fc677ce266) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:19:24 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-28c2e173-c2de-4168-8313-3e85bf69c281 tempest-ServerActionsTestOtherA-844381334 None] Copying metadata from image 0ea392d9-2af0-468e-bdc1-5e3f34bc52e6 to 65c6e635-b755-47cf-8c51-e55007e80e16. {{(pid=86082) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 15 16:19:24 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-28c2e173-c2de-4168-8313-3e85bf69c281 tempest-ServerActionsTestOtherA-844381334 None] Creating volume glance metadata for volume 65c6e635-b755-47cf-8c51-e55007e80e16 backed by image 0ea392d9-2af0-468e-bdc1-5e3f34bc52e6 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '0ea392d9-2af0-468e-bdc1-5e3f34bc52e6', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86082) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 15 16:19:24 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-a648964a-9b3a-482b-97e8-c44d82e03e39 tempest-GroupsV314Test-1769010214 None] Volume volume-fb51e856-a1b6-4322-ba72-3279bb42942e (fb51e856-a1b6-4322-ba72-3279bb42942e): created successfully Sep 15 16:19:24 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-a648964a-9b3a-482b-97e8-c44d82e03e39 tempest-GroupsV314Test-1769010214 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef80167c-b8e3-4a48-a071-99fc677ce266) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:19:24 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-a648964a-9b3a-482b-97e8-c44d82e03e39 tempest-GroupsV314Test-1769010214 None] Flow 'volume_create_manager' (9b1c765a-c47d-4e9d-a81a-ec05d146dbcd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:19:25 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-a648964a-9b3a-482b-97e8-c44d82e03e39 tempest-GroupsV314Test-1769010214 None] Created volume successfully. Sep 15 16:19:25 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-28c2e173-c2de-4168-8313-3e85bf69c281 tempest-ServerActionsTestOtherA-844381334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (60852a05-0dca-4664-9d2b-1b576c9af2d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65c6e635-b755-47cf-8c51-e55007e80e16', 'volume_size': 1, 'image_id': '0ea392d9-2af0-468e-bdc1-5e3f34bc52e6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0ea392d9-2af0-468e-bdc1-5e3f34bc52e6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e57b859e1a41428083b6d86ce51f5184', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0ea392d9-2af0-468e-bdc1-5e3f34bc52e6', 'created_at': datetime.datetime(2026, 9, 15, 14, 11, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 15, 14, 11, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0ea392d9-2af0-468e-bdc1-5e3f34bc52e6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:19:25 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-28c2e173-c2de-4168-8313-3e85bf69c281 tempest-ServerActionsTestOtherA-844381334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbe84518-9e11-4a99-9467-c6245bbf5c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:19:25 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-28c2e173-c2de-4168-8313-3e85bf69c281 tempest-ServerActionsTestOtherA-844381334 None] Volume volume-65c6e635-b755-47cf-8c51-e55007e80e16 (65c6e635-b755-47cf-8c51-e55007e80e16): created successfully Sep 15 16:19:25 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-28c2e173-c2de-4168-8313-3e85bf69c281 tempest-ServerActionsTestOtherA-844381334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbe84518-9e11-4a99-9467-c6245bbf5c43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:19:25 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-28c2e173-c2de-4168-8313-3e85bf69c281 tempest-ServerActionsTestOtherA-844381334 None] Flow 'volume_create_manager' (5522154a-c5dc-4a52-bd35-04216a7a4d4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:19:25 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-28c2e173-c2de-4168-8313-3e85bf69c281 tempest-ServerActionsTestOtherA-844381334 None] Created volume successfully. Sep 15 16:19:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-3703369b-4fe9-40fb-9663-44d032f5f846 tempest-GroupsV314Test-1769010214 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:19:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-3703369b-4fe9-40fb-9663-44d032f5f846 tempest-GroupsV314Test-1769010214 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:19:27 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-3703369b-4fe9-40fb-9663-44d032f5f846 tempest-GroupsV314Test-1769010214 None] Cloning volume fb51e856-a1b6-4322-ba72-3279bb42942e to volume 24c933e2-7a61-494c-8835-f4c31ffbfaf3 Sep 15 16:19:27 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-3703369b-4fe9-40fb-9663-44d032f5f846 tempest-GroupsV314Test-1769010214 None] Creating offline snapshot 251bba6b-0e62-42f4-bb55-6e7c8b9692a0 of volume fb51e856-a1b6-4322-ba72-3279bb42942e {{(pid=86082) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 15 16:19:27 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6753aa6-aedb-4b2d-a78b-8a75bad766eb]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:19:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3703369b-4fe9-40fb-9663-44d032f5f846 tempest-GroupsV314Test-1769010214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-fb51e856-a1b6-4322-ba72-3279bb42942e {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:19:27 devstack sudo[90174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-fb51e856-a1b6-4322-ba72-3279bb42942e Sep 15 16:19:27 devstack sudo[90174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:19:28 devstack sudo[90174]: pam_unix(sudo:session): session closed for user root Sep 15 16:19:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3703369b-4fe9-40fb-9663-44d032f5f846 tempest-GroupsV314Test-1769010214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-fb51e856-a1b6-4322-ba72-3279bb42942e" returned: 0 in 0.704s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:19:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3703369b-4fe9-40fb-9663-44d032f5f846 tempest-GroupsV314Test-1769010214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-fb51e856-a1b6-4322-ba72-3279bb42942e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-fb51e856-a1b6-4322-ba72-3279bb42942e.251bba6b-0e62-42f4-bb55-6e7c8b9692a0 1G {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:19:28 devstack sudo[90180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-fb51e856-a1b6-4322-ba72-3279bb42942e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-fb51e856-a1b6-4322-ba72-3279bb42942e.251bba6b-0e62-42f4-bb55-6e7c8b9692a0 1G Sep 15 16:19:28 devstack sudo[90180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:19:28 devstack sudo[90180]: pam_unix(sudo:session): session closed for user root Sep 15 16:19:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3703369b-4fe9-40fb-9663-44d032f5f846 tempest-GroupsV314Test-1769010214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-fb51e856-a1b6-4322-ba72-3279bb42942e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-fb51e856-a1b6-4322-ba72-3279bb42942e.251bba6b-0e62-42f4-bb55-6e7c8b9692a0 1G" returned: 0 in 0.760s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:19:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3703369b-4fe9-40fb-9663-44d032f5f846 tempest-GroupsV314Test-1769010214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb51e856-a1b6-4322-ba72-3279bb42942e -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-fb51e856-a1b6-4322-ba72-3279bb42942e.251bba6b-0e62-42f4-bb55-6e7c8b9692a0 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:19:28 devstack sudo[90188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb51e856-a1b6-4322-ba72-3279bb42942e -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-fb51e856-a1b6-4322-ba72-3279bb42942e.251bba6b-0e62-42f4-bb55-6e7c8b9692a0 Sep 15 16:19:28 devstack sudo[90188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:19:29 devstack sudo[90188]: pam_unix(sudo:session): session closed for user root Sep 15 16:19:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3703369b-4fe9-40fb-9663-44d032f5f846 tempest-GroupsV314Test-1769010214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fb51e856-a1b6-4322-ba72-3279bb42942e -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-fb51e856-a1b6-4322-ba72-3279bb42942e.251bba6b-0e62-42f4-bb55-6e7c8b9692a0" returned: 0 in 0.586s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:19:29 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-3703369b-4fe9-40fb-9663-44d032f5f846 tempest-GroupsV314Test-1769010214 None] /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-fb51e856-a1b6-4322-ba72-3279bb42942e.251bba6b-0e62-42f4-bb55-6e7c8b9692a0 is being set with open permissions: ugo+rw: NotImplementedError Sep 15 16:19:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3703369b-4fe9-40fb-9663-44d032f5f846 tempest-GroupsV314Test-1769010214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-fb51e856-a1b6-4322-ba72-3279bb42942e.251bba6b-0e62-42f4-bb55-6e7c8b9692a0 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:19:29 devstack sudo[90196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-fb51e856-a1b6-4322-ba72-3279bb42942e.251bba6b-0e62-42f4-bb55-6e7c8b9692a0 Sep 15 16:19:29 devstack sudo[90196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:19:29 devstack sudo[90196]: pam_unix(sudo:session): session closed for user root Sep 15 16:19:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3703369b-4fe9-40fb-9663-44d032f5f846 tempest-GroupsV314Test-1769010214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-fb51e856-a1b6-4322-ba72-3279bb42942e.251bba6b-0e62-42f4-bb55-6e7c8b9692a0" returned: 0 in 0.393s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:19:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3703369b-4fe9-40fb-9663-44d032f5f846 tempest-GroupsV314Test-1769010214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-fb51e856-a1b6-4322-ba72-3279bb42942e.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:19:29 devstack sudo[90200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-fb51e856-a1b6-4322-ba72-3279bb42942e.info Sep 15 16:19:29 devstack sudo[90200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:19:30 devstack sudo[90200]: pam_unix(sudo:session): session closed for user root Sep 15 16:19:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3703369b-4fe9-40fb-9663-44d032f5f846 tempest-GroupsV314Test-1769010214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-fb51e856-a1b6-4322-ba72-3279bb42942e.info" returned: 0 in 0.606s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:19:30 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-3703369b-4fe9-40fb-9663-44d032f5f846 tempest-GroupsV314Test-1769010214 None] /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-fb51e856-a1b6-4322-ba72-3279bb42942e.info is being set with open permissions: ugo+rw: NotImplementedError Sep 15 16:19:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3703369b-4fe9-40fb-9663-44d032f5f846 tempest-GroupsV314Test-1769010214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-fb51e856-a1b6-4322-ba72-3279bb42942e.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:19:30 devstack sudo[90214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-fb51e856-a1b6-4322-ba72-3279bb42942e.info Sep 15 16:19:30 devstack sudo[90214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:19:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-b5fbb567-2a5c-44b6-8fef-0c51a54c088c req-38c5901a-46c2-409c-9aff-689727d98bb0 tempest-ServerActionsTestOtherA-844381334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:19:30 devstack sudo[90214]: pam_unix(sudo:session): session closed for user root Sep 15 16:19:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3703369b-4fe9-40fb-9663-44d032f5f846 tempest-GroupsV314Test-1769010214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-fb51e856-a1b6-4322-ba72-3279bb42942e.info" returned: 0 in 0.455s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:19:30 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-3703369b-4fe9-40fb-9663-44d032f5f846 tempest-GroupsV314Test-1769010214 None] Acquiring lock "cinder-quobyte-24c933e2-7a61-494c-8835-f4c31ffbfaf3" by "_copy_volume_from_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:19:31 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-3703369b-4fe9-40fb-9663-44d032f5f846 tempest-GroupsV314Test-1769010214 None] Lock "cinder-quobyte-24c933e2-7a61-494c-8835-f4c31ffbfaf3" acquired by "_copy_volume_from_snapshot" :: waited 0.035s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:19:31 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-3703369b-4fe9-40fb-9663-44d032f5f846 tempest-GroupsV314Test-1769010214 None] snapshot: 251bba6b-0e62-42f4-bb55-6e7c8b9692a0, volume: 24c933e2-7a61-494c-8835-f4c31ffbfaf3, {{(pid=86082) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 15 16:19:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-3703369b-4fe9-40fb-9663-44d032f5f846 tempest-GroupsV314Test-1769010214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:19:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-3703369b-4fe9-40fb-9663-44d032f5f846 tempest-GroupsV314Test-1769010214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:19:31 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-3703369b-4fe9-40fb-9663-44d032f5f846 tempest-GroupsV314Test-1769010214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:19:31 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-3703369b-4fe9-40fb-9663-44d032f5f846 tempest-GroupsV314Test-1769010214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:19:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-3703369b-4fe9-40fb-9663-44d032f5f846 tempest-GroupsV314Test-1769010214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:19:31 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d40f1d0-ef27-4bef-bc2d-d28dfd661499]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:19:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3703369b-4fe9-40fb-9663-44d032f5f846 tempest-GroupsV314Test-1769010214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-fb51e856-a1b6-4322-ba72-3279bb42942e.251bba6b-0e62-42f4-bb55-6e7c8b9692a0 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:19:31 devstack sudo[90220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-fb51e856-a1b6-4322-ba72-3279bb42942e.251bba6b-0e62-42f4-bb55-6e7c8b9692a0 Sep 15 16:19:31 devstack sudo[90220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:19:31 devstack sudo[90220]: pam_unix(sudo:session): session closed for user root Sep 15 16:19:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3703369b-4fe9-40fb-9663-44d032f5f846 tempest-GroupsV314Test-1769010214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-fb51e856-a1b6-4322-ba72-3279bb42942e.251bba6b-0e62-42f4-bb55-6e7c8b9692a0" returned: 0 in 0.552s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:19:31 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-3703369b-4fe9-40fb-9663-44d032f5f846 tempest-GroupsV314Test-1769010214 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fb51e856-a1b6-4322-ba72-3279bb42942e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 16:19:31 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e2190df-3259-4059-99e8-c04593ba7f12]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:19:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3703369b-4fe9-40fb-9663-44d032f5f846 tempest-GroupsV314Test-1769010214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-fb51e856-a1b6-4322-ba72-3279bb42942e {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:19:31 devstack sudo[90226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-fb51e856-a1b6-4322-ba72-3279bb42942e Sep 15 16:19:31 devstack sudo[90226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:19:32 devstack sudo[90226]: pam_unix(sudo:session): session closed for user root Sep 15 16:19:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3703369b-4fe9-40fb-9663-44d032f5f846 tempest-GroupsV314Test-1769010214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-fb51e856-a1b6-4322-ba72-3279bb42942e" returned: 0 in 0.459s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:19:32 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-3703369b-4fe9-40fb-9663-44d032f5f846 tempest-GroupsV314Test-1769010214 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-fb51e856-a1b6-4322-ba72-3279bb42942e {{(pid=86082) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 15 16:19:32 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-3703369b-4fe9-40fb-9663-44d032f5f846 tempest-GroupsV314Test-1769010214 None] Creating direct copy from snapshot {{(pid=86082) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 15 16:19:32 devstack cinder-volume[86082]: DEBUG cinder.utils [None req-3703369b-4fe9-40fb-9663-44d032f5f846 tempest-GroupsV314Test-1769010214 None] Path /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-24c933e2-7a61-494c-8835-f4c31ffbfaf3 not found in is_blk_device check {{(pid=86082) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 15 16:19:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3703369b-4fe9-40fb-9663-44d032f5f846 tempest-GroupsV314Test-1769010214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-fb51e856-a1b6-4322-ba72-3279bb42942e /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-24c933e2-7a61-494c-8835-f4c31ffbfaf3 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:19:32 devstack sudo[90231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-fb51e856-a1b6-4322-ba72-3279bb42942e /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-24c933e2-7a61-494c-8835-f4c31ffbfaf3 Sep 15 16:19:32 devstack sudo[90231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:19:40 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:UPDATE=42,cinder:INSERT=16,cinder:SELECT=62,cinder:DELETE=1 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 16:19:40 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:SELECT=59,cinder:UPDATE=47,cinder:DELETE=4,cinder:INSERT=17 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 16:19:42 devstack sudo[90231]: pam_unix(sudo:session): session closed for user root Sep 15 16:19:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3703369b-4fe9-40fb-9663-44d032f5f846 tempest-GroupsV314Test-1769010214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-fb51e856-a1b6-4322-ba72-3279bb42942e /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-24c933e2-7a61-494c-8835-f4c31ffbfaf3" returned: 0 in 10.309s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:19:42 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-3703369b-4fe9-40fb-9663-44d032f5f846 tempest-GroupsV314Test-1769010214 None] Image conversion details: src /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-fb51e856-a1b6-4322-ba72-3279bb42942e, size 1024.00 MB, duration 10.31 sec, destination /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-24c933e2-7a61-494c-8835-f4c31ffbfaf3 {{(pid=86082) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 15 16:19:42 devstack cinder-volume[86082]: INFO cinder.image.image_utils [None req-3703369b-4fe9-40fb-9663-44d032f5f846 tempest-GroupsV314Test-1769010214 None] Converted 1024.00 MB image at 99.32 MB/s Sep 15 16:19:42 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-3703369b-4fe9-40fb-9663-44d032f5f846 tempest-GroupsV314Test-1769010214 None] /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-24c933e2-7a61-494c-8835-f4c31ffbfaf3 is being set with open permissions: ugo+rw: NotImplementedError Sep 15 16:19:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3703369b-4fe9-40fb-9663-44d032f5f846 tempest-GroupsV314Test-1769010214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-24c933e2-7a61-494c-8835-f4c31ffbfaf3 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:19:42 devstack sudo[90286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-24c933e2-7a61-494c-8835-f4c31ffbfaf3 Sep 15 16:19:42 devstack sudo[90286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:19:42 devstack sudo[90286]: pam_unix(sudo:session): session closed for user root Sep 15 16:19:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3703369b-4fe9-40fb-9663-44d032f5f846 tempest-GroupsV314Test-1769010214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-24c933e2-7a61-494c-8835-f4c31ffbfaf3" returned: 0 in 0.276s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:19:42 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-3703369b-4fe9-40fb-9663-44d032f5f846 tempest-GroupsV314Test-1769010214 None] Lock "cinder-quobyte-24c933e2-7a61-494c-8835-f4c31ffbfaf3" released by "_copy_volume_from_snapshot" :: held 11.713s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:19:42 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-3703369b-4fe9-40fb-9663-44d032f5f846 tempest-GroupsV314Test-1769010214 None] Acquiring lock "cinder-quobyte-251bba6b-0e62-42f4-bb55-6e7c8b9692a0" by "_delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:19:42 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-3703369b-4fe9-40fb-9663-44d032f5f846 tempest-GroupsV314Test-1769010214 None] Lock "cinder-quobyte-251bba6b-0e62-42f4-bb55-6e7c8b9692a0" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:19:42 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-3703369b-4fe9-40fb-9663-44d032f5f846 tempest-GroupsV314Test-1769010214 None] Deleting offline snapshot 251bba6b-0e62-42f4-bb55-6e7c8b9692a0 of volume fb51e856-a1b6-4322-ba72-3279bb42942e {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 15 16:19:42 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-3703369b-4fe9-40fb-9663-44d032f5f846 tempest-GroupsV314Test-1769010214 None] snapshot_file for this snap is: volume-fb51e856-a1b6-4322-ba72-3279bb42942e.251bba6b-0e62-42f4-bb55-6e7c8b9692a0 {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 15 16:19:42 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[95d9861b-a679-4c6c-8072-3fe8de9a99ad]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:19:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3703369b-4fe9-40fb-9663-44d032f5f846 tempest-GroupsV314Test-1769010214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-fb51e856-a1b6-4322-ba72-3279bb42942e.251bba6b-0e62-42f4-bb55-6e7c8b9692a0 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:19:42 devstack sudo[90289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-fb51e856-a1b6-4322-ba72-3279bb42942e.251bba6b-0e62-42f4-bb55-6e7c8b9692a0 Sep 15 16:19:42 devstack sudo[90289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:19:43 devstack sudo[90289]: pam_unix(sudo:session): session closed for user root Sep 15 16:19:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3703369b-4fe9-40fb-9663-44d032f5f846 tempest-GroupsV314Test-1769010214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-fb51e856-a1b6-4322-ba72-3279bb42942e.251bba6b-0e62-42f4-bb55-6e7c8b9692a0" returned: 0 in 0.416s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:19:43 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-3703369b-4fe9-40fb-9663-44d032f5f846 tempest-GroupsV314Test-1769010214 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fb51e856-a1b6-4322-ba72-3279bb42942e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 16:19:43 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a5a37f7-62d1-4507-87d1-82778a8c91db]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:19:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3703369b-4fe9-40fb-9663-44d032f5f846 tempest-GroupsV314Test-1769010214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-fb51e856-a1b6-4322-ba72-3279bb42942e {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:19:43 devstack sudo[90295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-fb51e856-a1b6-4322-ba72-3279bb42942e Sep 15 16:19:43 devstack sudo[90295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:19:43 devstack sudo[90295]: pam_unix(sudo:session): session closed for user root Sep 15 16:19:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3703369b-4fe9-40fb-9663-44d032f5f846 tempest-GroupsV314Test-1769010214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-fb51e856-a1b6-4322-ba72-3279bb42942e" returned: 0 in 0.554s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:19:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3703369b-4fe9-40fb-9663-44d032f5f846 tempest-GroupsV314Test-1769010214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-fb51e856-a1b6-4322-ba72-3279bb42942e.251bba6b-0e62-42f4-bb55-6e7c8b9692a0 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:19:43 devstack sudo[90300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-fb51e856-a1b6-4322-ba72-3279bb42942e.251bba6b-0e62-42f4-bb55-6e7c8b9692a0 Sep 15 16:19:43 devstack sudo[90300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:19:44 devstack sudo[90300]: pam_unix(sudo:session): session closed for user root Sep 15 16:19:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3703369b-4fe9-40fb-9663-44d032f5f846 tempest-GroupsV314Test-1769010214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-fb51e856-a1b6-4322-ba72-3279bb42942e.251bba6b-0e62-42f4-bb55-6e7c8b9692a0" returned: 0 in 0.418s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:19:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3703369b-4fe9-40fb-9663-44d032f5f846 tempest-GroupsV314Test-1769010214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-fb51e856-a1b6-4322-ba72-3279bb42942e.251bba6b-0e62-42f4-bb55-6e7c8b9692a0 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:19:44 devstack sudo[90306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-fb51e856-a1b6-4322-ba72-3279bb42942e.251bba6b-0e62-42f4-bb55-6e7c8b9692a0 Sep 15 16:19:44 devstack sudo[90306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:19:44 devstack sudo[90306]: pam_unix(sudo:session): session closed for user root Sep 15 16:19:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3703369b-4fe9-40fb-9663-44d032f5f846 tempest-GroupsV314Test-1769010214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-fb51e856-a1b6-4322-ba72-3279bb42942e.251bba6b-0e62-42f4-bb55-6e7c8b9692a0" returned: 0 in 0.288s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:19:44 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-3703369b-4fe9-40fb-9663-44d032f5f846 tempest-GroupsV314Test-1769010214 None] Lock "cinder-quobyte-251bba6b-0e62-42f4-bb55-6e7c8b9692a0" released by "_delete_snapshot" :: held 1.801s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:19:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-3703369b-4fe9-40fb-9663-44d032f5f846 tempest-GroupsV314Test-1769010214 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 17.373s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:19:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-b5fbb567-2a5c-44b6-8fef-0c51a54c088c req-38c5901a-46c2-409c-9aff-689727d98bb0 tempest-ServerActionsTestOtherA-844381334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 13.727s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:19:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-b5fbb567-2a5c-44b6-8fef-0c51a54c088c req-38c5901a-46c2-409c-9aff-689727d98bb0 tempest-ServerActionsTestOtherA-844381334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:19:44 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-b5fbb567-2a5c-44b6-8fef-0c51a54c088c req-38c5901a-46c2-409c-9aff-689727d98bb0 tempest-ServerActionsTestOtherA-844381334 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a', 'name': 'volume-65c6e635-b755-47cf-8c51-e55007e80e16', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9dc5c921-a548-4153-bb07-8ff590c03783', 'enforce_multipath': True} {{(pid=86082) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 15 16:19:44 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-3703369b-4fe9-40fb-9663-44d032f5f846 tempest-GroupsV314Test-1769010214 None] Create group from source-group-120ae8e5-7f89-4034-a305-4f96398a5be7 completed successfully. Sep 15 16:19:44 devstack cinder-volume[86082]: INFO cinder.volume.manager [req-b5fbb567-2a5c-44b6-8fef-0c51a54c088c req-38c5901a-46c2-409c-9aff-689727d98bb0 tempest-ServerActionsTestOtherA-844381334 None] attachment_update completed successfully. Sep 15 16:19:46 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-d5f790c6-27a5-463f-8569-8e6d8d38657c tempest-GroupsV314Test-1769010214 None] Acquiring lock "cinder-quobyte-24c933e2-7a61-494c-8835-f4c31ffbfaf3" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:19:46 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-d5f790c6-27a5-463f-8569-8e6d8d38657c tempest-GroupsV314Test-1769010214 None] Lock "cinder-quobyte-24c933e2-7a61-494c-8835-f4c31ffbfaf3" acquired by "delete_volume" :: waited 0.027s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:19:46 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[df18a73c-d679-4bef-b6d8-ac4942abfa1d]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:19:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d5f790c6-27a5-463f-8569-8e6d8d38657c tempest-GroupsV314Test-1769010214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-24c933e2-7a61-494c-8835-f4c31ffbfaf3 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:19:46 devstack sudo[90760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-24c933e2-7a61-494c-8835-f4c31ffbfaf3 Sep 15 16:19:46 devstack sudo[90760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:19:46 devstack sudo[90760]: pam_unix(sudo:session): session closed for user root Sep 15 16:19:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d5f790c6-27a5-463f-8569-8e6d8d38657c tempest-GroupsV314Test-1769010214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-24c933e2-7a61-494c-8835-f4c31ffbfaf3" returned: 0 in 0.517s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:19:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d5f790c6-27a5-463f-8569-8e6d8d38657c tempest-GroupsV314Test-1769010214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-24c933e2-7a61-494c-8835-f4c31ffbfaf3 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:19:46 devstack sudo[90766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-24c933e2-7a61-494c-8835-f4c31ffbfaf3 Sep 15 16:19:46 devstack sudo[90766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:19:47 devstack sudo[90766]: pam_unix(sudo:session): session closed for user root Sep 15 16:19:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d5f790c6-27a5-463f-8569-8e6d8d38657c tempest-GroupsV314Test-1769010214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-24c933e2-7a61-494c-8835-f4c31ffbfaf3" returned: 0 in 0.275s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:19:47 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-d5f790c6-27a5-463f-8569-8e6d8d38657c tempest-GroupsV314Test-1769010214 None] Lock "cinder-quobyte-24c933e2-7a61-494c-8835-f4c31ffbfaf3" released by "delete_volume" :: held 0.904s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:19:47 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-d5f790c6-27a5-463f-8569-8e6d8d38657c tempest-GroupsV314Test-1769010214 None] Created reservations ['ff273607-860e-4348-a5e7-e6f650fbe3e7'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:19:47 devstack cinder-volume[86082]: WARNING cinder.quota [None req-d5f790c6-27a5-463f-8569-8e6d8d38657c tempest-GroupsV314Test-1769010214 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-816227118 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-816227118, it is now deprecated. Please use the default quota class for default quota. Sep 15 16:19:47 devstack cinder-volume[86082]: WARNING cinder.quota [None req-d5f790c6-27a5-463f-8569-8e6d8d38657c tempest-GroupsV314Test-1769010214 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-816227118 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-816227118, it is now deprecated. Please use the default quota class for default quota. Sep 15 16:19:47 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-d5f790c6-27a5-463f-8569-8e6d8d38657c tempest-GroupsV314Test-1769010214 None] Created reservations ['de525b72-6c6e-4bca-8fa9-933944380820', '3e2203d6-df4b-43f3-b32c-e342ba639117', '434ad737-b5f7-493f-a6e2-216846e22efe', 'e4f864b8-d8cb-4484-a964-927421089ea2'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:19:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-d5f790c6-27a5-463f-8569-8e6d8d38657c tempest-GroupsV314Test-1769010214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:19:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-d5f790c6-27a5-463f-8569-8e6d8d38657c tempest-GroupsV314Test-1769010214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:19:47 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-d5f790c6-27a5-463f-8569-8e6d8d38657c tempest-GroupsV314Test-1769010214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:19:47 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-d5f790c6-27a5-463f-8569-8e6d8d38657c tempest-GroupsV314Test-1769010214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:19:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-d5f790c6-27a5-463f-8569-8e6d8d38657c tempest-GroupsV314Test-1769010214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:19:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d5f790c6-27a5-463f-8569-8e6d8d38657c tempest-GroupsV314Test-1769010214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:19:47 devstack sudo[90771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:19:47 devstack sudo[90771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:19:47 devstack sudo[90771]: pam_unix(sudo:session): session closed for user root Sep 15 16:19:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d5f790c6-27a5-463f-8569-8e6d8d38657c tempest-GroupsV314Test-1769010214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.343s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:19:48 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-d5f790c6-27a5-463f-8569-8e6d8d38657c tempest-GroupsV314Test-1769010214 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:19:48 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-d5f790c6-27a5-463f-8569-8e6d8d38657c tempest-GroupsV314Test-1769010214 None] Delete group completed successfully. Sep 15 16:19:49 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-12c0e3be-ee2c-4634-875a-2e01cfc634c5 tempest-GroupsV314Test-1769010214 None] Acquiring lock "cinder-quobyte-fb51e856-a1b6-4322-ba72-3279bb42942e" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:19:49 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-12c0e3be-ee2c-4634-875a-2e01cfc634c5 tempest-GroupsV314Test-1769010214 None] Lock "cinder-quobyte-fb51e856-a1b6-4322-ba72-3279bb42942e" acquired by "delete_volume" :: waited 0.111s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:19:49 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[36a8f8d9-66c0-4f67-9dc9-3207f306e9fd]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:19:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-12c0e3be-ee2c-4634-875a-2e01cfc634c5 tempest-GroupsV314Test-1769010214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-fb51e856-a1b6-4322-ba72-3279bb42942e {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:19:49 devstack sudo[90775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-fb51e856-a1b6-4322-ba72-3279bb42942e Sep 15 16:19:49 devstack sudo[90775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:19:50 devstack sudo[90775]: pam_unix(sudo:session): session closed for user root Sep 15 16:19:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-12c0e3be-ee2c-4634-875a-2e01cfc634c5 tempest-GroupsV314Test-1769010214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-fb51e856-a1b6-4322-ba72-3279bb42942e" returned: 0 in 0.564s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:19:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-12c0e3be-ee2c-4634-875a-2e01cfc634c5 tempest-GroupsV314Test-1769010214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-fb51e856-a1b6-4322-ba72-3279bb42942e {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:19:50 devstack sudo[90781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-fb51e856-a1b6-4322-ba72-3279bb42942e Sep 15 16:19:50 devstack sudo[90781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:19:50 devstack sudo[90781]: pam_unix(sudo:session): session closed for user root Sep 15 16:19:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-12c0e3be-ee2c-4634-875a-2e01cfc634c5 tempest-GroupsV314Test-1769010214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-fb51e856-a1b6-4322-ba72-3279bb42942e" returned: 0 in 0.365s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:19:50 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-12c0e3be-ee2c-4634-875a-2e01cfc634c5 tempest-GroupsV314Test-1769010214 None] Lock "cinder-quobyte-fb51e856-a1b6-4322-ba72-3279bb42942e" released by "delete_volume" :: held 1.101s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:19:50 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-12c0e3be-ee2c-4634-875a-2e01cfc634c5 tempest-GroupsV314Test-1769010214 None] Created reservations ['703f0682-2ece-4e7f-a54b-cb79918f1b6f'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:19:50 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-12c0e3be-ee2c-4634-875a-2e01cfc634c5 tempest-GroupsV314Test-1769010214 None] Created reservations ['be9e8466-83f7-4e7d-89a1-dcd611023645', 'edc49626-bbcc-4724-ada8-2d77627fd121', '36a4f43c-fc4b-4e05-b695-086b5e40ff15', 'f2af1bd0-aee1-4366-8805-247bc5a800b7'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:19:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-12c0e3be-ee2c-4634-875a-2e01cfc634c5 tempest-GroupsV314Test-1769010214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:19:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-12c0e3be-ee2c-4634-875a-2e01cfc634c5 tempest-GroupsV314Test-1769010214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:19:51 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-12c0e3be-ee2c-4634-875a-2e01cfc634c5 tempest-GroupsV314Test-1769010214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:19:51 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-12c0e3be-ee2c-4634-875a-2e01cfc634c5 tempest-GroupsV314Test-1769010214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:19:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-12c0e3be-ee2c-4634-875a-2e01cfc634c5 tempest-GroupsV314Test-1769010214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:19:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-12c0e3be-ee2c-4634-875a-2e01cfc634c5 tempest-GroupsV314Test-1769010214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:19:51 devstack sudo[90785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:19:51 devstack sudo[90785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:19:51 devstack sudo[90785]: pam_unix(sudo:session): session closed for user root Sep 15 16:19:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-12c0e3be-ee2c-4634-875a-2e01cfc634c5 tempest-GroupsV314Test-1769010214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.386s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:19:51 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-12c0e3be-ee2c-4634-875a-2e01cfc634c5 tempest-GroupsV314Test-1769010214 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:19:51 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-12c0e3be-ee2c-4634-875a-2e01cfc634c5 tempest-GroupsV314Test-1769010214 None] Delete group completed successfully. Sep 15 16:19:59 devstack cinder-volume[86082]: DEBUG oslo_service.periodic_task [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86082) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 15 16:19:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:19:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:19:59 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:19:59 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:19:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:19:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:19:59 devstack sudo[90805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:19:59 devstack sudo[90805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:20:00 devstack sudo[90805]: pam_unix(sudo:session): session closed for user root Sep 15 16:20:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.669s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:20:00 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:20:00 devstack cinder-volume[86082]: DEBUG oslo_service.periodic_task [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Running periodic task VolumeManager._thread_info {{(pid=86082) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 15 16:20:00 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] thread count: 28 {{(pid=86082) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 15 16:20:00 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] thread info: [<_MainThread(MainThread, started 124875935469696)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86082) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 15 16:20:01 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:UPDATE=28,cinder:SELECT=21,cinder:INSERT=6 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 16:20:01 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:SELECT=27,cinder:UPDATE=25,cinder:INSERT=4 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 16:20:01 devstack cinder-volume[86082]: INFO cinder.volume.manager [req-f6eecb2f-0395-4079-962f-be8b724c05ed req-5626f3e6-4324-4032-baf2-8547f8a01169 tempest-ServerActionsTestOtherA-844381334 None] Terminate volume connection completed successfully. Sep 15 16:20:01 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-f6eecb2f-0395-4079-962f-be8b724c05ed req-5626f3e6-4324-4032-baf2-8547f8a01169 tempest-ServerActionsTestOtherA-844381334 None] Deleting attachment 9dc5c921-a548-4153-bb07-8ff590c03783. {{(pid=86082) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 15 16:20:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-f6eecb2f-0395-4079-962f-be8b724c05ed req-5d68d26d-6150-4d52-bb2a-6f753960699d tempest-ServerActionsTestOtherA-844381334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:20:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-f6eecb2f-0395-4079-962f-be8b724c05ed req-5d68d26d-6150-4d52-bb2a-6f753960699d tempest-ServerActionsTestOtherA-844381334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:20:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-f6eecb2f-0395-4079-962f-be8b724c05ed req-5d68d26d-6150-4d52-bb2a-6f753960699d tempest-ServerActionsTestOtherA-844381334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.069s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:20:05 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-f6eecb2f-0395-4079-962f-be8b724c05ed req-5d68d26d-6150-4d52-bb2a-6f753960699d tempest-ServerActionsTestOtherA-844381334 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a', 'name': 'volume-65c6e635-b755-47cf-8c51-e55007e80e16', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4fcefd66-9707-40e0-9aee-08d119c5eb37', 'enforce_multipath': True} {{(pid=86082) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 15 16:20:05 devstack cinder-volume[86082]: INFO cinder.volume.manager [req-f6eecb2f-0395-4079-962f-be8b724c05ed req-5d68d26d-6150-4d52-bb2a-6f753960699d tempest-ServerActionsTestOtherA-844381334 None] attachment_update completed successfully. Sep 15 16:20:14 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-875b13eb-c206-4402-b712-e6a439b6f78b tempest-AttachVolumeShelveTestJSON-944692299 None] Acquiring lock "cinder-c97cf5ee-fa69-430c-b583-dc8bfb7fdab7-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:20:15 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-875b13eb-c206-4402-b712-e6a439b6f78b tempest-AttachVolumeShelveTestJSON-944692299 None] Lock "cinder-c97cf5ee-fa69-430c-b583-dc8bfb7fdab7-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:20:15 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-875b13eb-c206-4402-b712-e6a439b6f78b tempest-AttachVolumeShelveTestJSON-944692299 None] Acquiring lock "cinder-quobyte-c97cf5ee-fa69-430c-b583-dc8bfb7fdab7" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:20:15 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-875b13eb-c206-4402-b712-e6a439b6f78b tempest-AttachVolumeShelveTestJSON-944692299 None] Lock "cinder-quobyte-c97cf5ee-fa69-430c-b583-dc8bfb7fdab7" acquired by "delete_volume" :: waited 0.021s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:20:15 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[8192ab3d-11d2-44a1-80be-7909d772c5ca]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:20:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-875b13eb-c206-4402-b712-e6a439b6f78b tempest-AttachVolumeShelveTestJSON-944692299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c97cf5ee-fa69-430c-b583-dc8bfb7fdab7 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:20:15 devstack sudo[91535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c97cf5ee-fa69-430c-b583-dc8bfb7fdab7 Sep 15 16:20:15 devstack sudo[91535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:20:16 devstack sudo[91535]: pam_unix(sudo:session): session closed for user root Sep 15 16:20:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-875b13eb-c206-4402-b712-e6a439b6f78b tempest-AttachVolumeShelveTestJSON-944692299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c97cf5ee-fa69-430c-b583-dc8bfb7fdab7" returned: 0 in 1.103s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:20:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-875b13eb-c206-4402-b712-e6a439b6f78b tempest-AttachVolumeShelveTestJSON-944692299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c97cf5ee-fa69-430c-b583-dc8bfb7fdab7 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:20:16 devstack sudo[91542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c97cf5ee-fa69-430c-b583-dc8bfb7fdab7 Sep 15 16:20:16 devstack sudo[91542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:20:17 devstack sudo[91542]: pam_unix(sudo:session): session closed for user root Sep 15 16:20:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-875b13eb-c206-4402-b712-e6a439b6f78b tempest-AttachVolumeShelveTestJSON-944692299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c97cf5ee-fa69-430c-b583-dc8bfb7fdab7" returned: 0 in 0.843s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:20:17 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-875b13eb-c206-4402-b712-e6a439b6f78b tempest-AttachVolumeShelveTestJSON-944692299 None] Lock "cinder-quobyte-c97cf5ee-fa69-430c-b583-dc8bfb7fdab7" released by "delete_volume" :: held 2.100s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:20:17 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-875b13eb-c206-4402-b712-e6a439b6f78b tempest-AttachVolumeShelveTestJSON-944692299 None] Created reservations ['f0a9e49a-d033-4f13-ae44-9f0ad9b1ef80', '8fc142cf-279c-4315-838e-c003eca7de09', 'b70ca0a7-d677-497a-8253-9e2ec33b6933', '9cf3220e-732b-40ef-a648-515468b59fa9'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:20:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-875b13eb-c206-4402-b712-e6a439b6f78b tempest-AttachVolumeShelveTestJSON-944692299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:20:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-875b13eb-c206-4402-b712-e6a439b6f78b tempest-AttachVolumeShelveTestJSON-944692299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:20:17 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-875b13eb-c206-4402-b712-e6a439b6f78b tempest-AttachVolumeShelveTestJSON-944692299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:20:17 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-875b13eb-c206-4402-b712-e6a439b6f78b tempest-AttachVolumeShelveTestJSON-944692299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:20:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-875b13eb-c206-4402-b712-e6a439b6f78b tempest-AttachVolumeShelveTestJSON-944692299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.042s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:20:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-875b13eb-c206-4402-b712-e6a439b6f78b tempest-AttachVolumeShelveTestJSON-944692299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:20:17 devstack sudo[91545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:20:17 devstack sudo[91545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:20:18 devstack sudo[91545]: pam_unix(sudo:session): session closed for user root Sep 15 16:20:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-875b13eb-c206-4402-b712-e6a439b6f78b tempest-AttachVolumeShelveTestJSON-944692299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.640s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:20:18 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-875b13eb-c206-4402-b712-e6a439b6f78b tempest-AttachVolumeShelveTestJSON-944692299 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:20:18 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-875b13eb-c206-4402-b712-e6a439b6f78b tempest-AttachVolumeShelveTestJSON-944692299 None] Deleted volume successfully. Sep 15 16:20:18 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-875b13eb-c206-4402-b712-e6a439b6f78b tempest-AttachVolumeShelveTestJSON-944692299 None] Lock "cinder-c97cf5ee-fa69-430c-b583-dc8bfb7fdab7-delete_volume" released by "delete_volume" :: held 3.181s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:20:27 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:SELECT=14,cinder:UPDATE=10,cinder:INSERT=1 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 16:20:28 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:SELECT=11,cinder:UPDATE=9,cinder:INSERT=3,cinder:DELETE=1 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 16:20:28 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-d674bda0-b0cf-4b69-af32-3a87521952c7 tempest-ServerRescueNegativeTestJSON-387964115 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:20:28 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-d674bda0-b0cf-4b69-af32-3a87521952c7 tempest-ServerRescueNegativeTestJSON-387964115 None] Flow 'volume_create_manager' (f43ef8de-b406-4081-b601-f289ef32ac0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:20:28 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-d674bda0-b0cf-4b69-af32-3a87521952c7 tempest-ServerRescueNegativeTestJSON-387964115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (224361bc-5b18-4163-b9b3-6f4b1f01ebe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:20:28 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-d674bda0-b0cf-4b69-af32-3a87521952c7 tempest-ServerRescueNegativeTestJSON-387964115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (224361bc-5b18-4163-b9b3-6f4b1f01ebe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:20:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-193491913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3859d027-d1a5-479a-b7e9-887fa87a49fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41382f827d144b6187800b795d5b0411',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:20:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:20:28Z,use_quota=True,user_id='642d408d77714f1bb1061f31262bfc78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:20:28 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-d674bda0-b0cf-4b69-af32-3a87521952c7 tempest-ServerRescueNegativeTestJSON-387964115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (967b1213-f318-46fd-b6be-3add13805056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:20:28 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-d674bda0-b0cf-4b69-af32-3a87521952c7 tempest-ServerRescueNegativeTestJSON-387964115 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (967b1213-f318-46fd-b6be-3add13805056) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:20:28 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-d674bda0-b0cf-4b69-af32-3a87521952c7 tempest-ServerRescueNegativeTestJSON-387964115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d971d6a-2596-42c9-8ce5-03d49e41cf70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:20:28 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-d674bda0-b0cf-4b69-af32-3a87521952c7 tempest-ServerRescueNegativeTestJSON-387964115 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d971d6a-2596-42c9-8ce5-03d49e41cf70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3859d027-d1a5-479a-b7e9-887fa87a49fb', 'volume_name': 'volume-3859d027-d1a5-479a-b7e9-887fa87a49fb', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:20:28 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-d674bda0-b0cf-4b69-af32-3a87521952c7 tempest-ServerRescueNegativeTestJSON-387964115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (547ca074-1d2d-4c5f-8c62-90f27a9678e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:20:28 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-d674bda0-b0cf-4b69-af32-3a87521952c7 tempest-ServerRescueNegativeTestJSON-387964115 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (547ca074-1d2d-4c5f-8c62-90f27a9678e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:20:28 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-d674bda0-b0cf-4b69-af32-3a87521952c7 tempest-ServerRescueNegativeTestJSON-387964115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (393345ba-0ae1-4091-8786-bd9a354f6fc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:20:28 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-d674bda0-b0cf-4b69-af32-3a87521952c7 tempest-ServerRescueNegativeTestJSON-387964115 None] Volume 3859d027-d1a5-479a-b7e9-887fa87a49fb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3859d027-d1a5-479a-b7e9-887fa87a49fb', 'volume_size': 1} Sep 15 16:20:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-d674bda0-b0cf-4b69-af32-3a87521952c7 tempest-ServerRescueNegativeTestJSON-387964115 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:20:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-d674bda0-b0cf-4b69-af32-3a87521952c7 tempest-ServerRescueNegativeTestJSON-387964115 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:20:28 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-d674bda0-b0cf-4b69-af32-3a87521952c7 tempest-ServerRescueNegativeTestJSON-387964115 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:20:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-193491913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3859d027-d1a5-479a-b7e9-887fa87a49fb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41382f827d144b6187800b795d5b0411',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:20:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:20:28Z,use_quota=True,user_id='642d408d77714f1bb1061f31262bfc78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:20:28 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-d674bda0-b0cf-4b69-af32-3a87521952c7 tempest-ServerRescueNegativeTestJSON-387964115 None] Creating volume 3859d027-d1a5-479a-b7e9-887fa87a49fb {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:20:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-d674bda0-b0cf-4b69-af32-3a87521952c7 tempest-ServerRescueNegativeTestJSON-387964115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:20:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-d674bda0-b0cf-4b69-af32-3a87521952c7 tempest-ServerRescueNegativeTestJSON-387964115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:20:28 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-d674bda0-b0cf-4b69-af32-3a87521952c7 tempest-ServerRescueNegativeTestJSON-387964115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:20:28 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-d674bda0-b0cf-4b69-af32-3a87521952c7 tempest-ServerRescueNegativeTestJSON-387964115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:20:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-d674bda0-b0cf-4b69-af32-3a87521952c7 tempest-ServerRescueNegativeTestJSON-387964115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:20:28 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-d674bda0-b0cf-4b69-af32-3a87521952c7 tempest-ServerRescueNegativeTestJSON-387964115 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:20:28 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-d674bda0-b0cf-4b69-af32-3a87521952c7 tempest-ServerRescueNegativeTestJSON-387964115 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:20:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d674bda0-b0cf-4b69-af32-3a87521952c7 tempest-ServerRescueNegativeTestJSON-387964115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-3859d027-d1a5-479a-b7e9-887fa87a49fb 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:20:28 devstack sudo[91618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-3859d027-d1a5-479a-b7e9-887fa87a49fb 1073741824 Sep 15 16:20:28 devstack sudo[91618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:20:28 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-c44d8c81-32a2-4256-9eb6-3c5303d1ec09 tempest-VolumeQuotasAdminTestJSON-1398611215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:20:29 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c44d8c81-32a2-4256-9eb6-3c5303d1ec09 tempest-VolumeQuotasAdminTestJSON-1398611215 None] Flow 'volume_create_manager' (d04b0ce6-0e84-4a8d-b392-eeaa699249fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:20:29 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c44d8c81-32a2-4256-9eb6-3c5303d1ec09 tempest-VolumeQuotasAdminTestJSON-1398611215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7973701-d5f0-4ce9-8078-e527f7399931) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:20:29 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c44d8c81-32a2-4256-9eb6-3c5303d1ec09 tempest-VolumeQuotasAdminTestJSON-1398611215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7973701-d5f0-4ce9-8078-e527f7399931) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:20:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-430776070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abab6129-bac7-4f86-8eda-66210b821b2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72b3214a520a4c74926be75ed04466ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:20:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:20:29Z,use_quota=True,user_id='6ffb91d06667437faa431dd96d2c510b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:20:29 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c44d8c81-32a2-4256-9eb6-3c5303d1ec09 tempest-VolumeQuotasAdminTestJSON-1398611215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f794e021-13ca-4b91-83e1-8963c1bbe65b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:20:29 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c44d8c81-32a2-4256-9eb6-3c5303d1ec09 tempest-VolumeQuotasAdminTestJSON-1398611215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f794e021-13ca-4b91-83e1-8963c1bbe65b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:20:29 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c44d8c81-32a2-4256-9eb6-3c5303d1ec09 tempest-VolumeQuotasAdminTestJSON-1398611215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f84f2f10-54e8-47c6-8466-4ebe1088e800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:20:29 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c44d8c81-32a2-4256-9eb6-3c5303d1ec09 tempest-VolumeQuotasAdminTestJSON-1398611215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f84f2f10-54e8-47c6-8466-4ebe1088e800) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'abab6129-bac7-4f86-8eda-66210b821b2a', 'volume_name': 'volume-abab6129-bac7-4f86-8eda-66210b821b2a', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:20:29 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c44d8c81-32a2-4256-9eb6-3c5303d1ec09 tempest-VolumeQuotasAdminTestJSON-1398611215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ced859dd-4130-4f02-a593-73b74771a61d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:20:29 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c44d8c81-32a2-4256-9eb6-3c5303d1ec09 tempest-VolumeQuotasAdminTestJSON-1398611215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ced859dd-4130-4f02-a593-73b74771a61d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:20:29 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c44d8c81-32a2-4256-9eb6-3c5303d1ec09 tempest-VolumeQuotasAdminTestJSON-1398611215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6421170d-8c40-42f8-a955-8186c0e8795f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:20:29 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-c44d8c81-32a2-4256-9eb6-3c5303d1ec09 tempest-VolumeQuotasAdminTestJSON-1398611215 None] Volume abab6129-bac7-4f86-8eda-66210b821b2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-abab6129-bac7-4f86-8eda-66210b821b2a', 'volume_size': 1} Sep 15 16:20:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c44d8c81-32a2-4256-9eb6-3c5303d1ec09 tempest-VolumeQuotasAdminTestJSON-1398611215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:20:29 devstack sudo[91618]: pam_unix(sudo:session): session closed for user root Sep 15 16:20:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d674bda0-b0cf-4b69-af32-3a87521952c7 tempest-ServerRescueNegativeTestJSON-387964115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-3859d027-d1a5-479a-b7e9-887fa87a49fb 1073741824" returned: 0 in 0.902s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:20:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d674bda0-b0cf-4b69-af32-3a87521952c7 tempest-ServerRescueNegativeTestJSON-387964115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-3859d027-d1a5-479a-b7e9-887fa87a49fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:20:29 devstack sudo[91657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-3859d027-d1a5-479a-b7e9-887fa87a49fb Sep 15 16:20:29 devstack sudo[91657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:20:29 devstack sudo[91657]: pam_unix(sudo:session): session closed for user root Sep 15 16:20:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d674bda0-b0cf-4b69-af32-3a87521952c7 tempest-ServerRescueNegativeTestJSON-387964115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-3859d027-d1a5-479a-b7e9-887fa87a49fb" returned: 0 in 0.413s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:20:29 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-d674bda0-b0cf-4b69-af32-3a87521952c7 tempest-ServerRescueNegativeTestJSON-387964115 None] <== create_volume: return (1398ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:20:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-d674bda0-b0cf-4b69-af32-3a87521952c7 tempest-ServerRescueNegativeTestJSON-387964115 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.402s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:20:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c44d8c81-32a2-4256-9eb6-3c5303d1ec09 tempest-VolumeQuotasAdminTestJSON-1398611215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.749s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:20:29 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c44d8c81-32a2-4256-9eb6-3c5303d1ec09 tempest-VolumeQuotasAdminTestJSON-1398611215 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:20:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-430776070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abab6129-bac7-4f86-8eda-66210b821b2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72b3214a520a4c74926be75ed04466ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:20:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:20:29Z,use_quota=True,user_id='6ffb91d06667437faa431dd96d2c510b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:20:29 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-c44d8c81-32a2-4256-9eb6-3c5303d1ec09 tempest-VolumeQuotasAdminTestJSON-1398611215 None] Creating volume abab6129-bac7-4f86-8eda-66210b821b2a {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:20:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c44d8c81-32a2-4256-9eb6-3c5303d1ec09 tempest-VolumeQuotasAdminTestJSON-1398611215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:20:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c44d8c81-32a2-4256-9eb6-3c5303d1ec09 tempest-VolumeQuotasAdminTestJSON-1398611215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:20:29 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c44d8c81-32a2-4256-9eb6-3c5303d1ec09 tempest-VolumeQuotasAdminTestJSON-1398611215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:20:29 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c44d8c81-32a2-4256-9eb6-3c5303d1ec09 tempest-VolumeQuotasAdminTestJSON-1398611215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:20:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c44d8c81-32a2-4256-9eb6-3c5303d1ec09 tempest-VolumeQuotasAdminTestJSON-1398611215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:20:29 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c44d8c81-32a2-4256-9eb6-3c5303d1ec09 tempest-VolumeQuotasAdminTestJSON-1398611215 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:20:29 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-c44d8c81-32a2-4256-9eb6-3c5303d1ec09 tempest-VolumeQuotasAdminTestJSON-1398611215 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:20:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c44d8c81-32a2-4256-9eb6-3c5303d1ec09 tempest-VolumeQuotasAdminTestJSON-1398611215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-abab6129-bac7-4f86-8eda-66210b821b2a 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:20:29 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-d674bda0-b0cf-4b69-af32-3a87521952c7 tempest-ServerRescueNegativeTestJSON-387964115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (393345ba-0ae1-4091-8786-bd9a354f6fc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3859d027-d1a5-479a-b7e9-887fa87a49fb', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:20:29 devstack sudo[91660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-abab6129-bac7-4f86-8eda-66210b821b2a 1073741824 Sep 15 16:20:29 devstack sudo[91660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:20:29 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-d674bda0-b0cf-4b69-af32-3a87521952c7 tempest-ServerRescueNegativeTestJSON-387964115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8b5c1e1-ec72-4244-9849-8a8bcfe5bf95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:20:30 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-d674bda0-b0cf-4b69-af32-3a87521952c7 tempest-ServerRescueNegativeTestJSON-387964115 None] Volume volume-3859d027-d1a5-479a-b7e9-887fa87a49fb (3859d027-d1a5-479a-b7e9-887fa87a49fb): created successfully Sep 15 16:20:30 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-d674bda0-b0cf-4b69-af32-3a87521952c7 tempest-ServerRescueNegativeTestJSON-387964115 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8b5c1e1-ec72-4244-9849-8a8bcfe5bf95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:20:30 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-d674bda0-b0cf-4b69-af32-3a87521952c7 tempest-ServerRescueNegativeTestJSON-387964115 None] Flow 'volume_create_manager' (f43ef8de-b406-4081-b601-f289ef32ac0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:20:30 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-d674bda0-b0cf-4b69-af32-3a87521952c7 tempest-ServerRescueNegativeTestJSON-387964115 None] Created volume successfully. Sep 15 16:20:30 devstack sudo[91660]: pam_unix(sudo:session): session closed for user root Sep 15 16:20:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c44d8c81-32a2-4256-9eb6-3c5303d1ec09 tempest-VolumeQuotasAdminTestJSON-1398611215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-abab6129-bac7-4f86-8eda-66210b821b2a 1073741824" returned: 0 in 1.033s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:20:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c44d8c81-32a2-4256-9eb6-3c5303d1ec09 tempest-VolumeQuotasAdminTestJSON-1398611215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-abab6129-bac7-4f86-8eda-66210b821b2a {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:20:31 devstack sudo[91672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-abab6129-bac7-4f86-8eda-66210b821b2a Sep 15 16:20:31 devstack sudo[91672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:20:31 devstack sudo[91672]: pam_unix(sudo:session): session closed for user root Sep 15 16:20:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c44d8c81-32a2-4256-9eb6-3c5303d1ec09 tempest-VolumeQuotasAdminTestJSON-1398611215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-abab6129-bac7-4f86-8eda-66210b821b2a" returned: 0 in 0.452s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:20:31 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c44d8c81-32a2-4256-9eb6-3c5303d1ec09 tempest-VolumeQuotasAdminTestJSON-1398611215 None] <== create_volume: return (1591ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:20:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c44d8c81-32a2-4256-9eb6-3c5303d1ec09 tempest-VolumeQuotasAdminTestJSON-1398611215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.601s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:20:31 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c44d8c81-32a2-4256-9eb6-3c5303d1ec09 tempest-VolumeQuotasAdminTestJSON-1398611215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6421170d-8c40-42f8-a955-8186c0e8795f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abab6129-bac7-4f86-8eda-66210b821b2a', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:20:31 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c44d8c81-32a2-4256-9eb6-3c5303d1ec09 tempest-VolumeQuotasAdminTestJSON-1398611215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad60d654-e08e-4824-a759-55052a4b7207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:20:31 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-c44d8c81-32a2-4256-9eb6-3c5303d1ec09 tempest-VolumeQuotasAdminTestJSON-1398611215 None] Volume volume-abab6129-bac7-4f86-8eda-66210b821b2a (abab6129-bac7-4f86-8eda-66210b821b2a): created successfully Sep 15 16:20:31 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c44d8c81-32a2-4256-9eb6-3c5303d1ec09 tempest-VolumeQuotasAdminTestJSON-1398611215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad60d654-e08e-4824-a759-55052a4b7207) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:20:31 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c44d8c81-32a2-4256-9eb6-3c5303d1ec09 tempest-VolumeQuotasAdminTestJSON-1398611215 None] Flow 'volume_create_manager' (d04b0ce6-0e84-4a8d-b392-eeaa699249fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:20:31 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-c44d8c81-32a2-4256-9eb6-3c5303d1ec09 tempest-VolumeQuotasAdminTestJSON-1398611215 None] Created volume successfully. Sep 15 16:20:32 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-42448eac-0cf7-4422-99db-04d50780cd5b tempest-VolumeQuotasAdminTestJSON-1398611215 None] Acquiring lock "cinder-abab6129-bac7-4f86-8eda-66210b821b2a-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:20:32 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-42448eac-0cf7-4422-99db-04d50780cd5b tempest-VolumeQuotasAdminTestJSON-1398611215 None] Lock "cinder-abab6129-bac7-4f86-8eda-66210b821b2a-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:20:32 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-42448eac-0cf7-4422-99db-04d50780cd5b tempest-VolumeQuotasAdminTestJSON-1398611215 None] Acquiring lock "cinder-quobyte-abab6129-bac7-4f86-8eda-66210b821b2a" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:20:32 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-42448eac-0cf7-4422-99db-04d50780cd5b tempest-VolumeQuotasAdminTestJSON-1398611215 None] Lock "cinder-quobyte-abab6129-bac7-4f86-8eda-66210b821b2a" acquired by "delete_volume" :: waited 0.042s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:20:32 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b29c40a-6699-46d5-a086-8a0f1f82dfff]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:20:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-42448eac-0cf7-4422-99db-04d50780cd5b tempest-VolumeQuotasAdminTestJSON-1398611215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-abab6129-bac7-4f86-8eda-66210b821b2a {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:20:32 devstack sudo[91682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-abab6129-bac7-4f86-8eda-66210b821b2a Sep 15 16:20:32 devstack sudo[91682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:20:33 devstack sudo[91682]: pam_unix(sudo:session): session closed for user root Sep 15 16:20:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-42448eac-0cf7-4422-99db-04d50780cd5b tempest-VolumeQuotasAdminTestJSON-1398611215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-abab6129-bac7-4f86-8eda-66210b821b2a" returned: 0 in 0.752s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:20:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-42448eac-0cf7-4422-99db-04d50780cd5b tempest-VolumeQuotasAdminTestJSON-1398611215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-abab6129-bac7-4f86-8eda-66210b821b2a {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:20:33 devstack sudo[91701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-abab6129-bac7-4f86-8eda-66210b821b2a Sep 15 16:20:33 devstack sudo[91701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:20:33 devstack sudo[91701]: pam_unix(sudo:session): session closed for user root Sep 15 16:20:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-42448eac-0cf7-4422-99db-04d50780cd5b tempest-VolumeQuotasAdminTestJSON-1398611215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-abab6129-bac7-4f86-8eda-66210b821b2a" returned: 0 in 0.627s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:20:33 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-42448eac-0cf7-4422-99db-04d50780cd5b tempest-VolumeQuotasAdminTestJSON-1398611215 None] Lock "cinder-quobyte-abab6129-bac7-4f86-8eda-66210b821b2a" released by "delete_volume" :: held 1.476s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:20:34 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-42448eac-0cf7-4422-99db-04d50780cd5b tempest-VolumeQuotasAdminTestJSON-1398611215 None] Created reservations ['61edf8a1-155c-4409-a04b-eb129d839065', '865974ce-20bc-4620-aa45-03ca2eea3cf3', 'd6577e09-d681-4a3a-8bbb-4c71219a34b4', '7e322174-a4c2-46f6-97f4-4da13f5e5c19'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:20:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-42448eac-0cf7-4422-99db-04d50780cd5b tempest-VolumeQuotasAdminTestJSON-1398611215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:20:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-42448eac-0cf7-4422-99db-04d50780cd5b tempest-VolumeQuotasAdminTestJSON-1398611215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:20:34 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-42448eac-0cf7-4422-99db-04d50780cd5b tempest-VolumeQuotasAdminTestJSON-1398611215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:20:34 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-42448eac-0cf7-4422-99db-04d50780cd5b tempest-VolumeQuotasAdminTestJSON-1398611215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:20:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-42448eac-0cf7-4422-99db-04d50780cd5b tempest-VolumeQuotasAdminTestJSON-1398611215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:20:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-42448eac-0cf7-4422-99db-04d50780cd5b tempest-VolumeQuotasAdminTestJSON-1398611215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:20:34 devstack sudo[91726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:20:34 devstack sudo[91726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:20:34 devstack sudo[91726]: pam_unix(sudo:session): session closed for user root Sep 15 16:20:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-42448eac-0cf7-4422-99db-04d50780cd5b tempest-VolumeQuotasAdminTestJSON-1398611215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.687s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:20:34 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-42448eac-0cf7-4422-99db-04d50780cd5b tempest-VolumeQuotasAdminTestJSON-1398611215 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:20:34 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-42448eac-0cf7-4422-99db-04d50780cd5b tempest-VolumeQuotasAdminTestJSON-1398611215 None] Deleted volume successfully. Sep 15 16:20:35 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-42448eac-0cf7-4422-99db-04d50780cd5b tempest-VolumeQuotasAdminTestJSON-1398611215 None] Lock "cinder-abab6129-bac7-4f86-8eda-66210b821b2a-delete_volume" released by "delete_volume" :: held 2.841s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:20:36 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb23cc21-dc22-4a3f-b542-9d8feda1780c tempest-VolumeQuotasAdminTestJSON-1398611215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:20:36 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-cb23cc21-dc22-4a3f-b542-9d8feda1780c tempest-VolumeQuotasAdminTestJSON-1398611215 None] Flow 'volume_create_manager' (e2f706d1-f1ec-4f3a-bc81-431958a3cf2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:20:36 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-cb23cc21-dc22-4a3f-b542-9d8feda1780c tempest-VolumeQuotasAdminTestJSON-1398611215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97bb66fd-eea6-4fd3-8d46-3f5e22e533f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:20:36 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-cb23cc21-dc22-4a3f-b542-9d8feda1780c tempest-VolumeQuotasAdminTestJSON-1398611215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97bb66fd-eea6-4fd3-8d46-3f5e22e533f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:20:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1443481382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7b1f589-2492-42cf-8af7-099036069130,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72b3214a520a4c74926be75ed04466ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:20:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:20:36Z,use_quota=True,user_id='6ffb91d06667437faa431dd96d2c510b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:20:36 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-cb23cc21-dc22-4a3f-b542-9d8feda1780c tempest-VolumeQuotasAdminTestJSON-1398611215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (320f8b33-f497-4b6a-b5d2-14968db6ed89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:20:36 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-cb23cc21-dc22-4a3f-b542-9d8feda1780c tempest-VolumeQuotasAdminTestJSON-1398611215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (320f8b33-f497-4b6a-b5d2-14968db6ed89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:20:36 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-cb23cc21-dc22-4a3f-b542-9d8feda1780c tempest-VolumeQuotasAdminTestJSON-1398611215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd32a578-6c22-4e27-8808-bfbc926a760b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:20:36 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-cb23cc21-dc22-4a3f-b542-9d8feda1780c tempest-VolumeQuotasAdminTestJSON-1398611215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd32a578-6c22-4e27-8808-bfbc926a760b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7b1f589-2492-42cf-8af7-099036069130', 'volume_name': 'volume-e7b1f589-2492-42cf-8af7-099036069130', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:20:36 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-cb23cc21-dc22-4a3f-b542-9d8feda1780c tempest-VolumeQuotasAdminTestJSON-1398611215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36cb5d5e-3403-4980-8138-aceb5f9a10a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:20:36 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-cb23cc21-dc22-4a3f-b542-9d8feda1780c tempest-VolumeQuotasAdminTestJSON-1398611215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36cb5d5e-3403-4980-8138-aceb5f9a10a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:20:36 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-cb23cc21-dc22-4a3f-b542-9d8feda1780c tempest-VolumeQuotasAdminTestJSON-1398611215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de03c3b8-b682-459c-af2d-73399612d3d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:20:36 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-cb23cc21-dc22-4a3f-b542-9d8feda1780c tempest-VolumeQuotasAdminTestJSON-1398611215 None] Volume e7b1f589-2492-42cf-8af7-099036069130: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7b1f589-2492-42cf-8af7-099036069130', 'volume_size': 1} Sep 15 16:20:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-cb23cc21-dc22-4a3f-b542-9d8feda1780c tempest-VolumeQuotasAdminTestJSON-1398611215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:20:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-cb23cc21-dc22-4a3f-b542-9d8feda1780c tempest-VolumeQuotasAdminTestJSON-1398611215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:20:36 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-cb23cc21-dc22-4a3f-b542-9d8feda1780c tempest-VolumeQuotasAdminTestJSON-1398611215 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:20:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1443481382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7b1f589-2492-42cf-8af7-099036069130,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72b3214a520a4c74926be75ed04466ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:20:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:20:36Z,use_quota=True,user_id='6ffb91d06667437faa431dd96d2c510b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:20:36 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-cb23cc21-dc22-4a3f-b542-9d8feda1780c tempest-VolumeQuotasAdminTestJSON-1398611215 None] Creating volume e7b1f589-2492-42cf-8af7-099036069130 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:20:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-cb23cc21-dc22-4a3f-b542-9d8feda1780c tempest-VolumeQuotasAdminTestJSON-1398611215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:20:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-cb23cc21-dc22-4a3f-b542-9d8feda1780c tempest-VolumeQuotasAdminTestJSON-1398611215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:20:36 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-cb23cc21-dc22-4a3f-b542-9d8feda1780c tempest-VolumeQuotasAdminTestJSON-1398611215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:20:36 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-cb23cc21-dc22-4a3f-b542-9d8feda1780c tempest-VolumeQuotasAdminTestJSON-1398611215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:20:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-cb23cc21-dc22-4a3f-b542-9d8feda1780c tempest-VolumeQuotasAdminTestJSON-1398611215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:20:36 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-cb23cc21-dc22-4a3f-b542-9d8feda1780c tempest-VolumeQuotasAdminTestJSON-1398611215 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:20:36 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-cb23cc21-dc22-4a3f-b542-9d8feda1780c tempest-VolumeQuotasAdminTestJSON-1398611215 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:20:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-cb23cc21-dc22-4a3f-b542-9d8feda1780c tempest-VolumeQuotasAdminTestJSON-1398611215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-e7b1f589-2492-42cf-8af7-099036069130 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:20:36 devstack sudo[91744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-e7b1f589-2492-42cf-8af7-099036069130 1073741824 Sep 15 16:20:36 devstack sudo[91744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:20:37 devstack sudo[91744]: pam_unix(sudo:session): session closed for user root Sep 15 16:20:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-cb23cc21-dc22-4a3f-b542-9d8feda1780c tempest-VolumeQuotasAdminTestJSON-1398611215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-e7b1f589-2492-42cf-8af7-099036069130 1073741824" returned: 0 in 0.701s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:20:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-cb23cc21-dc22-4a3f-b542-9d8feda1780c tempest-VolumeQuotasAdminTestJSON-1398611215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-e7b1f589-2492-42cf-8af7-099036069130 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:20:37 devstack sudo[91751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-e7b1f589-2492-42cf-8af7-099036069130 Sep 15 16:20:37 devstack sudo[91751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:20:37 devstack sudo[91751]: pam_unix(sudo:session): session closed for user root Sep 15 16:20:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-cb23cc21-dc22-4a3f-b542-9d8feda1780c tempest-VolumeQuotasAdminTestJSON-1398611215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-e7b1f589-2492-42cf-8af7-099036069130" returned: 0 in 0.405s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:20:37 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-cb23cc21-dc22-4a3f-b542-9d8feda1780c tempest-VolumeQuotasAdminTestJSON-1398611215 None] <== create_volume: return (1174ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:20:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-cb23cc21-dc22-4a3f-b542-9d8feda1780c tempest-VolumeQuotasAdminTestJSON-1398611215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.181s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:20:37 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-cb23cc21-dc22-4a3f-b542-9d8feda1780c tempest-VolumeQuotasAdminTestJSON-1398611215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de03c3b8-b682-459c-af2d-73399612d3d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7b1f589-2492-42cf-8af7-099036069130', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:20:37 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-cb23cc21-dc22-4a3f-b542-9d8feda1780c tempest-VolumeQuotasAdminTestJSON-1398611215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06f79578-7180-46a8-9229-4be0085f1470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:20:37 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-cb23cc21-dc22-4a3f-b542-9d8feda1780c tempest-VolumeQuotasAdminTestJSON-1398611215 None] Volume volume-e7b1f589-2492-42cf-8af7-099036069130 (e7b1f589-2492-42cf-8af7-099036069130): created successfully Sep 15 16:20:37 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-cb23cc21-dc22-4a3f-b542-9d8feda1780c tempest-VolumeQuotasAdminTestJSON-1398611215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06f79578-7180-46a8-9229-4be0085f1470) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:20:37 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-cb23cc21-dc22-4a3f-b542-9d8feda1780c tempest-VolumeQuotasAdminTestJSON-1398611215 None] Flow 'volume_create_manager' (e2f706d1-f1ec-4f3a-bc81-431958a3cf2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:20:37 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-cb23cc21-dc22-4a3f-b542-9d8feda1780c tempest-VolumeQuotasAdminTestJSON-1398611215 None] Created volume successfully. Sep 15 16:20:39 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-098dc97b-05e4-452b-9ebc-0b3c80a73ec7 tempest-VolumeQuotasAdminTestJSON-409060285 None] Transfer volume completed successfully. Sep 15 16:20:40 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-70832624-5f5d-42e1-bf2e-6b36b9569030 tempest-VolumeQuotasAdminTestJSON-2103287292 None] Acquiring lock "cinder-e7b1f589-2492-42cf-8af7-099036069130-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:20:40 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-70832624-5f5d-42e1-bf2e-6b36b9569030 tempest-VolumeQuotasAdminTestJSON-2103287292 None] Lock "cinder-e7b1f589-2492-42cf-8af7-099036069130-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:20:40 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-70832624-5f5d-42e1-bf2e-6b36b9569030 tempest-VolumeQuotasAdminTestJSON-2103287292 None] Acquiring lock "cinder-quobyte-e7b1f589-2492-42cf-8af7-099036069130" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:20:40 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-70832624-5f5d-42e1-bf2e-6b36b9569030 tempest-VolumeQuotasAdminTestJSON-2103287292 None] Lock "cinder-quobyte-e7b1f589-2492-42cf-8af7-099036069130" acquired by "delete_volume" :: waited 0.033s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:20:40 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[c50eaf39-8db4-44d3-98bc-3c459d9943d2]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:20:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-70832624-5f5d-42e1-bf2e-6b36b9569030 tempest-VolumeQuotasAdminTestJSON-2103287292 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-e7b1f589-2492-42cf-8af7-099036069130 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:20:40 devstack sudo[91795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-e7b1f589-2492-42cf-8af7-099036069130 Sep 15 16:20:40 devstack sudo[91795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:20:41 devstack sudo[91795]: pam_unix(sudo:session): session closed for user root Sep 15 16:20:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-70832624-5f5d-42e1-bf2e-6b36b9569030 tempest-VolumeQuotasAdminTestJSON-2103287292 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-e7b1f589-2492-42cf-8af7-099036069130" returned: 0 in 0.847s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:20:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-70832624-5f5d-42e1-bf2e-6b36b9569030 tempest-VolumeQuotasAdminTestJSON-2103287292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-e7b1f589-2492-42cf-8af7-099036069130 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:20:41 devstack sudo[91837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-e7b1f589-2492-42cf-8af7-099036069130 Sep 15 16:20:41 devstack sudo[91837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:20:42 devstack sudo[91837]: pam_unix(sudo:session): session closed for user root Sep 15 16:20:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-70832624-5f5d-42e1-bf2e-6b36b9569030 tempest-VolumeQuotasAdminTestJSON-2103287292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-e7b1f589-2492-42cf-8af7-099036069130" returned: 0 in 0.599s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:20:42 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-70832624-5f5d-42e1-bf2e-6b36b9569030 tempest-VolumeQuotasAdminTestJSON-2103287292 None] Lock "cinder-quobyte-e7b1f589-2492-42cf-8af7-099036069130" released by "delete_volume" :: held 1.555s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:20:42 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-70832624-5f5d-42e1-bf2e-6b36b9569030 tempest-VolumeQuotasAdminTestJSON-2103287292 None] Created reservations ['91fd8836-57f0-49f2-93cb-156a2f8fc391', 'c6faae5f-a363-42ef-b3b6-ef3ed8e83447', '4014f95f-bafb-4fa7-91c5-d08e92c3e8b1', '4b2875eb-a538-4e96-8c8e-6739377c943f'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:20:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-70832624-5f5d-42e1-bf2e-6b36b9569030 tempest-VolumeQuotasAdminTestJSON-2103287292 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:20:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-70832624-5f5d-42e1-bf2e-6b36b9569030 tempest-VolumeQuotasAdminTestJSON-2103287292 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:20:42 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-70832624-5f5d-42e1-bf2e-6b36b9569030 tempest-VolumeQuotasAdminTestJSON-2103287292 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:20:42 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-70832624-5f5d-42e1-bf2e-6b36b9569030 tempest-VolumeQuotasAdminTestJSON-2103287292 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:20:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-70832624-5f5d-42e1-bf2e-6b36b9569030 tempest-VolumeQuotasAdminTestJSON-2103287292 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:20:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-70832624-5f5d-42e1-bf2e-6b36b9569030 tempest-VolumeQuotasAdminTestJSON-2103287292 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:20:42 devstack sudo[91850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:20:42 devstack sudo[91850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:20:42 devstack sudo[91850]: pam_unix(sudo:session): session closed for user root Sep 15 16:20:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-70832624-5f5d-42e1-bf2e-6b36b9569030 tempest-VolumeQuotasAdminTestJSON-2103287292 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.521s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:20:42 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-70832624-5f5d-42e1-bf2e-6b36b9569030 tempest-VolumeQuotasAdminTestJSON-2103287292 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:20:43 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-70832624-5f5d-42e1-bf2e-6b36b9569030 tempest-VolumeQuotasAdminTestJSON-2103287292 None] Deleted volume successfully. Sep 15 16:20:43 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-70832624-5f5d-42e1-bf2e-6b36b9569030 tempest-VolumeQuotasAdminTestJSON-2103287292 None] Lock "cinder-e7b1f589-2492-42cf-8af7-099036069130-delete_volume" released by "delete_volume" :: held 2.479s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:20:43 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-ccbffe49-bf60-4226-ac41-c4ddb8bf8727 tempest-ServerRescueNegativeTestJSON-387964115 None] Acquiring lock "cinder-3859d027-d1a5-479a-b7e9-887fa87a49fb-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:20:43 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-ccbffe49-bf60-4226-ac41-c4ddb8bf8727 tempest-ServerRescueNegativeTestJSON-387964115 None] Lock "cinder-3859d027-d1a5-479a-b7e9-887fa87a49fb-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:20:43 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-ccbffe49-bf60-4226-ac41-c4ddb8bf8727 tempest-ServerRescueNegativeTestJSON-387964115 None] Acquiring lock "cinder-quobyte-3859d027-d1a5-479a-b7e9-887fa87a49fb" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:20:43 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-ccbffe49-bf60-4226-ac41-c4ddb8bf8727 tempest-ServerRescueNegativeTestJSON-387964115 None] Lock "cinder-quobyte-3859d027-d1a5-479a-b7e9-887fa87a49fb" acquired by "delete_volume" :: waited 0.040s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:20:43 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[e258305d-5180-48c2-860c-f0db27750a88]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:20:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ccbffe49-bf60-4226-ac41-c4ddb8bf8727 tempest-ServerRescueNegativeTestJSON-387964115 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-3859d027-d1a5-479a-b7e9-887fa87a49fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:20:43 devstack sudo[91853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-3859d027-d1a5-479a-b7e9-887fa87a49fb Sep 15 16:20:43 devstack sudo[91853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:20:44 devstack sudo[91853]: pam_unix(sudo:session): session closed for user root Sep 15 16:20:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ccbffe49-bf60-4226-ac41-c4ddb8bf8727 tempest-ServerRescueNegativeTestJSON-387964115 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-3859d027-d1a5-479a-b7e9-887fa87a49fb" returned: 0 in 0.729s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:20:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ccbffe49-bf60-4226-ac41-c4ddb8bf8727 tempest-ServerRescueNegativeTestJSON-387964115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-3859d027-d1a5-479a-b7e9-887fa87a49fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:20:44 devstack sudo[91858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-3859d027-d1a5-479a-b7e9-887fa87a49fb Sep 15 16:20:44 devstack sudo[91858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:20:44 devstack sudo[91858]: pam_unix(sudo:session): session closed for user root Sep 15 16:20:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ccbffe49-bf60-4226-ac41-c4ddb8bf8727 tempest-ServerRescueNegativeTestJSON-387964115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-3859d027-d1a5-479a-b7e9-887fa87a49fb" returned: 0 in 0.532s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:20:44 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-ccbffe49-bf60-4226-ac41-c4ddb8bf8727 tempest-ServerRescueNegativeTestJSON-387964115 None] Lock "cinder-quobyte-3859d027-d1a5-479a-b7e9-887fa87a49fb" released by "delete_volume" :: held 1.360s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:20:44 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-ccbffe49-bf60-4226-ac41-c4ddb8bf8727 tempest-ServerRescueNegativeTestJSON-387964115 None] Created reservations ['b6f016da-4641-431b-b278-f91bd2cbc10d', '9f6ec381-a844-4794-b208-48b66b69b8f3', 'b45001c2-50ce-448d-b00c-f4b517a2c992', '9b094f0d-f7cf-45b2-bd75-f77aa380242f'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:20:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-ccbffe49-bf60-4226-ac41-c4ddb8bf8727 tempest-ServerRescueNegativeTestJSON-387964115 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:20:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-ccbffe49-bf60-4226-ac41-c4ddb8bf8727 tempest-ServerRescueNegativeTestJSON-387964115 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:20:44 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-ccbffe49-bf60-4226-ac41-c4ddb8bf8727 tempest-ServerRescueNegativeTestJSON-387964115 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:20:44 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-ccbffe49-bf60-4226-ac41-c4ddb8bf8727 tempest-ServerRescueNegativeTestJSON-387964115 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:20:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-ccbffe49-bf60-4226-ac41-c4ddb8bf8727 tempest-ServerRescueNegativeTestJSON-387964115 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:20:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ccbffe49-bf60-4226-ac41-c4ddb8bf8727 tempest-ServerRescueNegativeTestJSON-387964115 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:20:45 devstack sudo[91861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:20:45 devstack sudo[91861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:20:45 devstack sudo[91861]: pam_unix(sudo:session): session closed for user root Sep 15 16:20:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ccbffe49-bf60-4226-ac41-c4ddb8bf8727 tempest-ServerRescueNegativeTestJSON-387964115 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.582s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:20:45 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-ccbffe49-bf60-4226-ac41-c4ddb8bf8727 tempest-ServerRescueNegativeTestJSON-387964115 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:20:45 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-ccbffe49-bf60-4226-ac41-c4ddb8bf8727 tempest-ServerRescueNegativeTestJSON-387964115 None] Deleted volume successfully. Sep 15 16:20:45 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-ccbffe49-bf60-4226-ac41-c4ddb8bf8727 tempest-ServerRescueNegativeTestJSON-387964115 None] Lock "cinder-3859d027-d1a5-479a-b7e9-887fa87a49fb-delete_volume" released by "delete_volume" :: held 2.497s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:20:54 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:SELECT=19,cinder:UPDATE=34,cinder:INSERT=5 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 16:20:55 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:SELECT=24,cinder:INSERT=10,cinder:UPDATE=32,cinder:DELETE=6 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 16:20:56 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe224c76-4f0b-4779-b168-3d76d97df76d tempest-VolumeQuotasNegativeTestJSON-66167968 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:20:56 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-fe224c76-4f0b-4779-b168-3d76d97df76d tempest-VolumeQuotasNegativeTestJSON-66167968 None] Flow 'volume_create_manager' (0ee78c53-d1f7-4149-a2f1-995461f1758f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:20:56 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-fe224c76-4f0b-4779-b168-3d76d97df76d tempest-VolumeQuotasNegativeTestJSON-66167968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f8dc147-0121-4818-97a1-6bcb4c154bf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:20:56 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-fe224c76-4f0b-4779-b168-3d76d97df76d tempest-VolumeQuotasNegativeTestJSON-66167968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f8dc147-0121-4818-97a1-6bcb4c154bf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:20:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-57557512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=321d67b9-2d11-4089-85cf-b06c002c8574,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e4d32d0a3e541db93918996c9791a1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:20:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:20:57Z,use_quota=True,user_id='5af431793f724f779a456c757a0d5175',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:20:56 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-fe224c76-4f0b-4779-b168-3d76d97df76d tempest-VolumeQuotasNegativeTestJSON-66167968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dd3dfb5-a259-413f-a873-b1e63a94905b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:20:56 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-fe224c76-4f0b-4779-b168-3d76d97df76d tempest-VolumeQuotasNegativeTestJSON-66167968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dd3dfb5-a259-413f-a873-b1e63a94905b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:20:56 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-fe224c76-4f0b-4779-b168-3d76d97df76d tempest-VolumeQuotasNegativeTestJSON-66167968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (815d9ac2-12d3-4af1-bdb7-570800fc7971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:20:56 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-fe224c76-4f0b-4779-b168-3d76d97df76d tempest-VolumeQuotasNegativeTestJSON-66167968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (815d9ac2-12d3-4af1-bdb7-570800fc7971) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '321d67b9-2d11-4089-85cf-b06c002c8574', 'volume_name': 'volume-321d67b9-2d11-4089-85cf-b06c002c8574', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:20:56 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-fe224c76-4f0b-4779-b168-3d76d97df76d tempest-VolumeQuotasNegativeTestJSON-66167968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (193c3338-2e55-4f55-9fbd-ea678cb3d484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:20:56 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-fe224c76-4f0b-4779-b168-3d76d97df76d tempest-VolumeQuotasNegativeTestJSON-66167968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (193c3338-2e55-4f55-9fbd-ea678cb3d484) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:20:56 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-fe224c76-4f0b-4779-b168-3d76d97df76d tempest-VolumeQuotasNegativeTestJSON-66167968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb0b84bd-63c6-42e1-a385-df22cc161834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:20:56 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-fe224c76-4f0b-4779-b168-3d76d97df76d tempest-VolumeQuotasNegativeTestJSON-66167968 None] Volume 321d67b9-2d11-4089-85cf-b06c002c8574: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-321d67b9-2d11-4089-85cf-b06c002c8574', 'volume_size': 1} Sep 15 16:20:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-fe224c76-4f0b-4779-b168-3d76d97df76d tempest-VolumeQuotasNegativeTestJSON-66167968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:20:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-fe224c76-4f0b-4779-b168-3d76d97df76d tempest-VolumeQuotasNegativeTestJSON-66167968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:20:56 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-fe224c76-4f0b-4779-b168-3d76d97df76d tempest-VolumeQuotasNegativeTestJSON-66167968 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:20:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-57557512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=321d67b9-2d11-4089-85cf-b06c002c8574,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e4d32d0a3e541db93918996c9791a1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:20:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:20:57Z,use_quota=True,user_id='5af431793f724f779a456c757a0d5175',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:20:56 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-fe224c76-4f0b-4779-b168-3d76d97df76d tempest-VolumeQuotasNegativeTestJSON-66167968 None] Creating volume 321d67b9-2d11-4089-85cf-b06c002c8574 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:20:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-fe224c76-4f0b-4779-b168-3d76d97df76d tempest-VolumeQuotasNegativeTestJSON-66167968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:20:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-fe224c76-4f0b-4779-b168-3d76d97df76d tempest-VolumeQuotasNegativeTestJSON-66167968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:20:56 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-fe224c76-4f0b-4779-b168-3d76d97df76d tempest-VolumeQuotasNegativeTestJSON-66167968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:20:56 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-fe224c76-4f0b-4779-b168-3d76d97df76d tempest-VolumeQuotasNegativeTestJSON-66167968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:20:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-fe224c76-4f0b-4779-b168-3d76d97df76d tempest-VolumeQuotasNegativeTestJSON-66167968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:20:56 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-fe224c76-4f0b-4779-b168-3d76d97df76d tempest-VolumeQuotasNegativeTestJSON-66167968 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:20:56 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-fe224c76-4f0b-4779-b168-3d76d97df76d tempest-VolumeQuotasNegativeTestJSON-66167968 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:20:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-fe224c76-4f0b-4779-b168-3d76d97df76d tempest-VolumeQuotasNegativeTestJSON-66167968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-321d67b9-2d11-4089-85cf-b06c002c8574 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:20:57 devstack sudo[91933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-321d67b9-2d11-4089-85cf-b06c002c8574 1073741824 Sep 15 16:20:57 devstack sudo[91933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:20:57 devstack sudo[91933]: pam_unix(sudo:session): session closed for user root Sep 15 16:20:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-fe224c76-4f0b-4779-b168-3d76d97df76d tempest-VolumeQuotasNegativeTestJSON-66167968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-321d67b9-2d11-4089-85cf-b06c002c8574 1073741824" returned: 0 in 0.613s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:20:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-fe224c76-4f0b-4779-b168-3d76d97df76d tempest-VolumeQuotasNegativeTestJSON-66167968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-321d67b9-2d11-4089-85cf-b06c002c8574 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:20:57 devstack sudo[91948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-321d67b9-2d11-4089-85cf-b06c002c8574 Sep 15 16:20:57 devstack sudo[91948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:20:57 devstack sudo[91948]: pam_unix(sudo:session): session closed for user root Sep 15 16:20:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-fe224c76-4f0b-4779-b168-3d76d97df76d tempest-VolumeQuotasNegativeTestJSON-66167968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-321d67b9-2d11-4089-85cf-b06c002c8574" returned: 0 in 0.365s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:20:58 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-fe224c76-4f0b-4779-b168-3d76d97df76d tempest-VolumeQuotasNegativeTestJSON-66167968 None] <== create_volume: return (1039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:20:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-fe224c76-4f0b-4779-b168-3d76d97df76d tempest-VolumeQuotasNegativeTestJSON-66167968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.042s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:20:58 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-fe224c76-4f0b-4779-b168-3d76d97df76d tempest-VolumeQuotasNegativeTestJSON-66167968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb0b84bd-63c6-42e1-a385-df22cc161834) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-321d67b9-2d11-4089-85cf-b06c002c8574', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:20:58 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-fe224c76-4f0b-4779-b168-3d76d97df76d tempest-VolumeQuotasNegativeTestJSON-66167968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4675eece-f4ba-47bd-a914-a3e1ad98d209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:20:58 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-fe224c76-4f0b-4779-b168-3d76d97df76d tempest-VolumeQuotasNegativeTestJSON-66167968 None] Volume volume-321d67b9-2d11-4089-85cf-b06c002c8574 (321d67b9-2d11-4089-85cf-b06c002c8574): created successfully Sep 15 16:20:58 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-fe224c76-4f0b-4779-b168-3d76d97df76d tempest-VolumeQuotasNegativeTestJSON-66167968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4675eece-f4ba-47bd-a914-a3e1ad98d209) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:20:58 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-fe224c76-4f0b-4779-b168-3d76d97df76d tempest-VolumeQuotasNegativeTestJSON-66167968 None] Flow 'volume_create_manager' (0ee78c53-d1f7-4149-a2f1-995461f1758f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:20:58 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-fe224c76-4f0b-4779-b168-3d76d97df76d tempest-VolumeQuotasNegativeTestJSON-66167968 None] Created volume successfully. Sep 15 16:20:59 devstack cinder-volume[86082]: DEBUG oslo_service.periodic_task [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86082) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 15 16:20:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:20:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:20:59 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:20:59 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:20:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:20:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:20:59 devstack sudo[91961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:20:59 devstack sudo[91961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:21:00 devstack sudo[91961]: pam_unix(sudo:session): session closed for user root Sep 15 16:21:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.473s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:21:00 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:21:00 devstack cinder-volume[86082]: DEBUG oslo_service.periodic_task [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Running periodic task VolumeManager._thread_info {{(pid=86082) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 15 16:21:00 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] thread count: 28 {{(pid=86082) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 15 16:21:00 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] thread info: [<_MainThread(MainThread, started 124875935469696)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86082) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 15 16:21:00 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f84c6216-2e11-4620-a8ad-4f79773a7163 tempest-VolumeQuotasNegativeTestJSON-66167968 None] Acquiring lock "cinder-321d67b9-2d11-4089-85cf-b06c002c8574-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:21:00 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f84c6216-2e11-4620-a8ad-4f79773a7163 tempest-VolumeQuotasNegativeTestJSON-66167968 None] Lock "cinder-321d67b9-2d11-4089-85cf-b06c002c8574-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:21:00 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f84c6216-2e11-4620-a8ad-4f79773a7163 tempest-VolumeQuotasNegativeTestJSON-66167968 None] Acquiring lock "cinder-quobyte-321d67b9-2d11-4089-85cf-b06c002c8574" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:21:00 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f84c6216-2e11-4620-a8ad-4f79773a7163 tempest-VolumeQuotasNegativeTestJSON-66167968 None] Lock "cinder-quobyte-321d67b9-2d11-4089-85cf-b06c002c8574" acquired by "delete_volume" :: waited 0.025s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:21:00 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6528eb8-1202-4e2b-8519-ff88975df6bb]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:21:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f84c6216-2e11-4620-a8ad-4f79773a7163 tempest-VolumeQuotasNegativeTestJSON-66167968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-321d67b9-2d11-4089-85cf-b06c002c8574 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:21:00 devstack sudo[91965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-321d67b9-2d11-4089-85cf-b06c002c8574 Sep 15 16:21:00 devstack sudo[91965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:21:01 devstack sudo[91965]: pam_unix(sudo:session): session closed for user root Sep 15 16:21:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f84c6216-2e11-4620-a8ad-4f79773a7163 tempest-VolumeQuotasNegativeTestJSON-66167968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-321d67b9-2d11-4089-85cf-b06c002c8574" returned: 0 in 0.904s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:21:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f84c6216-2e11-4620-a8ad-4f79773a7163 tempest-VolumeQuotasNegativeTestJSON-66167968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-321d67b9-2d11-4089-85cf-b06c002c8574 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:21:01 devstack sudo[92032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-321d67b9-2d11-4089-85cf-b06c002c8574 Sep 15 16:21:01 devstack sudo[92032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:21:02 devstack sudo[92032]: pam_unix(sudo:session): session closed for user root Sep 15 16:21:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f84c6216-2e11-4620-a8ad-4f79773a7163 tempest-VolumeQuotasNegativeTestJSON-66167968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-321d67b9-2d11-4089-85cf-b06c002c8574" returned: 0 in 0.672s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:21:02 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f84c6216-2e11-4620-a8ad-4f79773a7163 tempest-VolumeQuotasNegativeTestJSON-66167968 None] Lock "cinder-quobyte-321d67b9-2d11-4089-85cf-b06c002c8574" released by "delete_volume" :: held 1.652s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:21:02 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-f84c6216-2e11-4620-a8ad-4f79773a7163 tempest-VolumeQuotasNegativeTestJSON-66167968 None] Created reservations ['5afe464a-2e8d-4709-9633-54908091f2fc', '8be497a8-ef32-47a5-b92e-959efa0d9f7e', '35b8e6d1-7e09-4950-9afa-35e9ea1eaf5e', '46c10b0b-272a-4ecc-a4ed-61995d119ac7'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:21:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f84c6216-2e11-4620-a8ad-4f79773a7163 tempest-VolumeQuotasNegativeTestJSON-66167968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:21:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f84c6216-2e11-4620-a8ad-4f79773a7163 tempest-VolumeQuotasNegativeTestJSON-66167968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:21:02 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-f84c6216-2e11-4620-a8ad-4f79773a7163 tempest-VolumeQuotasNegativeTestJSON-66167968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:21:02 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-f84c6216-2e11-4620-a8ad-4f79773a7163 tempest-VolumeQuotasNegativeTestJSON-66167968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:21:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f84c6216-2e11-4620-a8ad-4f79773a7163 tempest-VolumeQuotasNegativeTestJSON-66167968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:21:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f84c6216-2e11-4620-a8ad-4f79773a7163 tempest-VolumeQuotasNegativeTestJSON-66167968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:21:02 devstack sudo[92054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:21:02 devstack sudo[92054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:21:03 devstack sudo[92054]: pam_unix(sudo:session): session closed for user root Sep 15 16:21:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f84c6216-2e11-4620-a8ad-4f79773a7163 tempest-VolumeQuotasNegativeTestJSON-66167968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.664s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:21:03 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-f84c6216-2e11-4620-a8ad-4f79773a7163 tempest-VolumeQuotasNegativeTestJSON-66167968 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:21:03 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-f84c6216-2e11-4620-a8ad-4f79773a7163 tempest-VolumeQuotasNegativeTestJSON-66167968 None] Deleted volume successfully. Sep 15 16:21:03 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f84c6216-2e11-4620-a8ad-4f79773a7163 tempest-VolumeQuotasNegativeTestJSON-66167968 None] Lock "cinder-321d67b9-2d11-4089-85cf-b06c002c8574-delete_volume" released by "delete_volume" :: held 2.709s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:21:05 devstack cinder-volume[86082]: INFO cinder.volume.manager [req-897b96e6-41b6-44a1-b52c-1443f89d5fa9 req-acdffe33-5ca1-4b91-806a-365a5a1053b1 tempest-ServerActionsTestOtherA-844381334 None] Terminate volume connection completed successfully. Sep 15 16:21:05 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-897b96e6-41b6-44a1-b52c-1443f89d5fa9 req-acdffe33-5ca1-4b91-806a-365a5a1053b1 tempest-ServerActionsTestOtherA-844381334 None] Deleting attachment 4fcefd66-9707-40e0-9aee-08d119c5eb37. {{(pid=86082) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 15 16:21:05 devstack cinder-volume[86082]: DEBUG cinder.coordination [req-897b96e6-41b6-44a1-b52c-1443f89d5fa9 req-ca347a57-aea3-4863-aeb0-e86b13749bfc tempest-ServerActionsTestOtherA-844381334 None] Acquiring lock "cinder-65c6e635-b755-47cf-8c51-e55007e80e16-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:21:05 devstack cinder-volume[86082]: DEBUG cinder.coordination [req-897b96e6-41b6-44a1-b52c-1443f89d5fa9 req-ca347a57-aea3-4863-aeb0-e86b13749bfc tempest-ServerActionsTestOtherA-844381334 None] Lock "cinder-65c6e635-b755-47cf-8c51-e55007e80e16-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:21:06 devstack cinder-volume[86082]: DEBUG cinder.coordination [req-897b96e6-41b6-44a1-b52c-1443f89d5fa9 req-ca347a57-aea3-4863-aeb0-e86b13749bfc tempest-ServerActionsTestOtherA-844381334 None] Acquiring lock "cinder-quobyte-65c6e635-b755-47cf-8c51-e55007e80e16" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:21:06 devstack cinder-volume[86082]: DEBUG cinder.coordination [req-897b96e6-41b6-44a1-b52c-1443f89d5fa9 req-ca347a57-aea3-4863-aeb0-e86b13749bfc tempest-ServerActionsTestOtherA-844381334 None] Lock "cinder-quobyte-65c6e635-b755-47cf-8c51-e55007e80e16" acquired by "delete_volume" :: waited 0.019s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:21:06 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5604e2f-4664-4951-83b7-b9ccd1b45418]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:21:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [req-897b96e6-41b6-44a1-b52c-1443f89d5fa9 req-ca347a57-aea3-4863-aeb0-e86b13749bfc tempest-ServerActionsTestOtherA-844381334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-65c6e635-b755-47cf-8c51-e55007e80e16 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:21:06 devstack sudo[92072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-65c6e635-b755-47cf-8c51-e55007e80e16 Sep 15 16:21:06 devstack sudo[92072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:21:06 devstack sudo[92072]: pam_unix(sudo:session): session closed for user root Sep 15 16:21:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [req-897b96e6-41b6-44a1-b52c-1443f89d5fa9 req-ca347a57-aea3-4863-aeb0-e86b13749bfc tempest-ServerActionsTestOtherA-844381334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-65c6e635-b755-47cf-8c51-e55007e80e16" returned: 0 in 0.657s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:21:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [req-897b96e6-41b6-44a1-b52c-1443f89d5fa9 req-ca347a57-aea3-4863-aeb0-e86b13749bfc tempest-ServerActionsTestOtherA-844381334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-65c6e635-b755-47cf-8c51-e55007e80e16 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:21:06 devstack sudo[92078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-65c6e635-b755-47cf-8c51-e55007e80e16 Sep 15 16:21:06 devstack sudo[92078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:21:07 devstack sudo[92078]: pam_unix(sudo:session): session closed for user root Sep 15 16:21:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [req-897b96e6-41b6-44a1-b52c-1443f89d5fa9 req-ca347a57-aea3-4863-aeb0-e86b13749bfc tempest-ServerActionsTestOtherA-844381334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-65c6e635-b755-47cf-8c51-e55007e80e16" returned: 0 in 0.363s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:21:07 devstack cinder-volume[86082]: DEBUG cinder.coordination [req-897b96e6-41b6-44a1-b52c-1443f89d5fa9 req-ca347a57-aea3-4863-aeb0-e86b13749bfc tempest-ServerActionsTestOtherA-844381334 None] Lock "cinder-quobyte-65c6e635-b755-47cf-8c51-e55007e80e16" released by "delete_volume" :: held 1.121s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:21:07 devstack cinder-volume[86082]: DEBUG cinder.quota [req-897b96e6-41b6-44a1-b52c-1443f89d5fa9 req-ca347a57-aea3-4863-aeb0-e86b13749bfc tempest-ServerActionsTestOtherA-844381334 None] Created reservations ['5020e10d-64ea-46a3-aef6-6c1f6f723e9a', '407ea23c-18a2-4dcb-a3b8-9f2863d3e952', 'd36915d4-33fc-4faf-94e0-883a9c7d5a71', '498e1bd4-6be2-4f05-90d4-aded1e62a2f3'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:21:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-897b96e6-41b6-44a1-b52c-1443f89d5fa9 req-ca347a57-aea3-4863-aeb0-e86b13749bfc tempest-ServerActionsTestOtherA-844381334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:21:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-897b96e6-41b6-44a1-b52c-1443f89d5fa9 req-ca347a57-aea3-4863-aeb0-e86b13749bfc tempest-ServerActionsTestOtherA-844381334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:21:07 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [req-897b96e6-41b6-44a1-b52c-1443f89d5fa9 req-ca347a57-aea3-4863-aeb0-e86b13749bfc tempest-ServerActionsTestOtherA-844381334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:21:07 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [req-897b96e6-41b6-44a1-b52c-1443f89d5fa9 req-ca347a57-aea3-4863-aeb0-e86b13749bfc tempest-ServerActionsTestOtherA-844381334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:21:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-897b96e6-41b6-44a1-b52c-1443f89d5fa9 req-ca347a57-aea3-4863-aeb0-e86b13749bfc tempest-ServerActionsTestOtherA-844381334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:21:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [req-897b96e6-41b6-44a1-b52c-1443f89d5fa9 req-ca347a57-aea3-4863-aeb0-e86b13749bfc tempest-ServerActionsTestOtherA-844381334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:21:07 devstack sudo[92082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:21:07 devstack sudo[92082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:21:07 devstack sudo[92082]: pam_unix(sudo:session): session closed for user root Sep 15 16:21:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [req-897b96e6-41b6-44a1-b52c-1443f89d5fa9 req-ca347a57-aea3-4863-aeb0-e86b13749bfc tempest-ServerActionsTestOtherA-844381334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.346s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:21:07 devstack cinder-volume[86082]: DEBUG cinder.manager [req-897b96e6-41b6-44a1-b52c-1443f89d5fa9 req-ca347a57-aea3-4863-aeb0-e86b13749bfc tempest-ServerActionsTestOtherA-844381334 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:21:07 devstack cinder-volume[86082]: INFO cinder.volume.manager [req-897b96e6-41b6-44a1-b52c-1443f89d5fa9 req-ca347a57-aea3-4863-aeb0-e86b13749bfc tempest-ServerActionsTestOtherA-844381334 None] Deleted volume successfully. Sep 15 16:21:07 devstack cinder-volume[86082]: DEBUG cinder.coordination [req-897b96e6-41b6-44a1-b52c-1443f89d5fa9 req-ca347a57-aea3-4863-aeb0-e86b13749bfc tempest-ServerActionsTestOtherA-844381334 None] Lock "cinder-65c6e635-b755-47cf-8c51-e55007e80e16-delete_volume" released by "delete_volume" :: held 1.843s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:21:07 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-43e10b07-73c8-48ec-8743-10f256af52a8 tempest-VolumesTestJSON-831084994 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:21:07 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-43e10b07-73c8-48ec-8743-10f256af52a8 tempest-VolumesTestJSON-831084994 None] Flow 'volume_create_manager' (e1957336-cdc7-43cd-a6f2-0344c498f73f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:21:07 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-43e10b07-73c8-48ec-8743-10f256af52a8 tempest-VolumesTestJSON-831084994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fee54561-96c7-4504-b7f8-a212df582eff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:21:07 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-43e10b07-73c8-48ec-8743-10f256af52a8 tempest-VolumesTestJSON-831084994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fee54561-96c7-4504-b7f8-a212df582eff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:21:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1550099642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24691ecc-e975-4f2b-a4ef-72e6878d8dfc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c089af6416df472f9791e49e2541144f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:21:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:21:08Z,use_quota=True,user_id='ab9ecf10b5c742d789784dc55afe6da0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:21:07 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-43e10b07-73c8-48ec-8743-10f256af52a8 tempest-VolumesTestJSON-831084994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f39daf30-9ebe-419b-a41d-fc90b4aac427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:21:07 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-43e10b07-73c8-48ec-8743-10f256af52a8 tempest-VolumesTestJSON-831084994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f39daf30-9ebe-419b-a41d-fc90b4aac427) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:21:07 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-43e10b07-73c8-48ec-8743-10f256af52a8 tempest-VolumesTestJSON-831084994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65aaa0de-8a22-48d9-9de8-b5f758f0ca19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:21:07 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-43e10b07-73c8-48ec-8743-10f256af52a8 tempest-VolumesTestJSON-831084994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65aaa0de-8a22-48d9-9de8-b5f758f0ca19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24691ecc-e975-4f2b-a4ef-72e6878d8dfc', 'volume_name': 'volume-24691ecc-e975-4f2b-a4ef-72e6878d8dfc', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:21:07 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-43e10b07-73c8-48ec-8743-10f256af52a8 tempest-VolumesTestJSON-831084994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84320955-539e-40df-98a4-a32d8dc3c450) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:21:07 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-43e10b07-73c8-48ec-8743-10f256af52a8 tempest-VolumesTestJSON-831084994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84320955-539e-40df-98a4-a32d8dc3c450) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:21:07 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-43e10b07-73c8-48ec-8743-10f256af52a8 tempest-VolumesTestJSON-831084994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41e35261-a32c-4df1-a6da-e2b9c4185f8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:21:07 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-43e10b07-73c8-48ec-8743-10f256af52a8 tempest-VolumesTestJSON-831084994 None] Volume 24691ecc-e975-4f2b-a4ef-72e6878d8dfc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24691ecc-e975-4f2b-a4ef-72e6878d8dfc', 'volume_size': 1} Sep 15 16:21:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-43e10b07-73c8-48ec-8743-10f256af52a8 tempest-VolumesTestJSON-831084994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:21:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-43e10b07-73c8-48ec-8743-10f256af52a8 tempest-VolumesTestJSON-831084994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:21:07 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-43e10b07-73c8-48ec-8743-10f256af52a8 tempest-VolumesTestJSON-831084994 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:21:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1550099642',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24691ecc-e975-4f2b-a4ef-72e6878d8dfc,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c089af6416df472f9791e49e2541144f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:21:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:21:08Z,use_quota=True,user_id='ab9ecf10b5c742d789784dc55afe6da0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:21:07 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-43e10b07-73c8-48ec-8743-10f256af52a8 tempest-VolumesTestJSON-831084994 None] Creating volume 24691ecc-e975-4f2b-a4ef-72e6878d8dfc {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:21:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-43e10b07-73c8-48ec-8743-10f256af52a8 tempest-VolumesTestJSON-831084994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:21:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-43e10b07-73c8-48ec-8743-10f256af52a8 tempest-VolumesTestJSON-831084994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:21:07 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-43e10b07-73c8-48ec-8743-10f256af52a8 tempest-VolumesTestJSON-831084994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:21:07 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-43e10b07-73c8-48ec-8743-10f256af52a8 tempest-VolumesTestJSON-831084994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:21:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-43e10b07-73c8-48ec-8743-10f256af52a8 tempest-VolumesTestJSON-831084994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:21:07 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-43e10b07-73c8-48ec-8743-10f256af52a8 tempest-VolumesTestJSON-831084994 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:21:07 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-43e10b07-73c8-48ec-8743-10f256af52a8 tempest-VolumesTestJSON-831084994 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:21:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-43e10b07-73c8-48ec-8743-10f256af52a8 tempest-VolumesTestJSON-831084994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-24691ecc-e975-4f2b-a4ef-72e6878d8dfc 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:21:08 devstack sudo[92085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-24691ecc-e975-4f2b-a4ef-72e6878d8dfc 1073741824 Sep 15 16:21:08 devstack sudo[92085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:21:08 devstack sudo[92085]: pam_unix(sudo:session): session closed for user root Sep 15 16:21:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-43e10b07-73c8-48ec-8743-10f256af52a8 tempest-VolumesTestJSON-831084994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-24691ecc-e975-4f2b-a4ef-72e6878d8dfc 1073741824" returned: 0 in 0.532s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:21:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-43e10b07-73c8-48ec-8743-10f256af52a8 tempest-VolumesTestJSON-831084994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-24691ecc-e975-4f2b-a4ef-72e6878d8dfc {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:21:08 devstack sudo[92091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-24691ecc-e975-4f2b-a4ef-72e6878d8dfc Sep 15 16:21:08 devstack sudo[92091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:21:09 devstack sudo[92091]: pam_unix(sudo:session): session closed for user root Sep 15 16:21:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-43e10b07-73c8-48ec-8743-10f256af52a8 tempest-VolumesTestJSON-831084994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-24691ecc-e975-4f2b-a4ef-72e6878d8dfc" returned: 0 in 0.654s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:21:09 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-43e10b07-73c8-48ec-8743-10f256af52a8 tempest-VolumesTestJSON-831084994 None] <== create_volume: return (1231ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:21:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-43e10b07-73c8-48ec-8743-10f256af52a8 tempest-VolumesTestJSON-831084994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.233s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:21:09 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c62da56c-9729-4571-84ab-c5ca1ac1f901 tempest-ServerActionsTestOtherA-844381334 None] Acquiring lock "cinder-79c0dbae-ff1b-47d0-8c9a-8ab2c09eaca8-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:21:09 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-43e10b07-73c8-48ec-8743-10f256af52a8 tempest-VolumesTestJSON-831084994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41e35261-a32c-4df1-a6da-e2b9c4185f8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24691ecc-e975-4f2b-a4ef-72e6878d8dfc', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:21:09 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-43e10b07-73c8-48ec-8743-10f256af52a8 tempest-VolumesTestJSON-831084994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f26d4154-c296-4e4f-986e-7027bd09a273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:21:09 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c62da56c-9729-4571-84ab-c5ca1ac1f901 tempest-ServerActionsTestOtherA-844381334 None] Lock "cinder-79c0dbae-ff1b-47d0-8c9a-8ab2c09eaca8-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:21:09 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-43e10b07-73c8-48ec-8743-10f256af52a8 tempest-VolumesTestJSON-831084994 None] Volume volume-24691ecc-e975-4f2b-a4ef-72e6878d8dfc (24691ecc-e975-4f2b-a4ef-72e6878d8dfc): created successfully Sep 15 16:21:09 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-43e10b07-73c8-48ec-8743-10f256af52a8 tempest-VolumesTestJSON-831084994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f26d4154-c296-4e4f-986e-7027bd09a273) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:21:09 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-43e10b07-73c8-48ec-8743-10f256af52a8 tempest-VolumesTestJSON-831084994 None] Flow 'volume_create_manager' (e1957336-cdc7-43cd-a6f2-0344c498f73f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:21:09 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-43e10b07-73c8-48ec-8743-10f256af52a8 tempest-VolumesTestJSON-831084994 None] Created volume successfully. Sep 15 16:21:09 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c62da56c-9729-4571-84ab-c5ca1ac1f901 tempest-ServerActionsTestOtherA-844381334 None] Acquiring lock "cinder-quobyte-79c0dbae-ff1b-47d0-8c9a-8ab2c09eaca8" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:21:09 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c62da56c-9729-4571-84ab-c5ca1ac1f901 tempest-ServerActionsTestOtherA-844381334 None] Lock "cinder-quobyte-79c0dbae-ff1b-47d0-8c9a-8ab2c09eaca8" acquired by "delete_volume" :: waited 0.022s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:21:09 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1e99fe7-256f-43db-8cfe-5befdc91a32e]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:21:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c62da56c-9729-4571-84ab-c5ca1ac1f901 tempest-ServerActionsTestOtherA-844381334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-79c0dbae-ff1b-47d0-8c9a-8ab2c09eaca8 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:21:09 devstack sudo[92128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-79c0dbae-ff1b-47d0-8c9a-8ab2c09eaca8 Sep 15 16:21:09 devstack sudo[92128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:21:09 devstack sudo[92128]: pam_unix(sudo:session): session closed for user root Sep 15 16:21:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c62da56c-9729-4571-84ab-c5ca1ac1f901 tempest-ServerActionsTestOtherA-844381334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-79c0dbae-ff1b-47d0-8c9a-8ab2c09eaca8" returned: 0 in 0.480s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:21:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c62da56c-9729-4571-84ab-c5ca1ac1f901 tempest-ServerActionsTestOtherA-844381334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-79c0dbae-ff1b-47d0-8c9a-8ab2c09eaca8 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:21:09 devstack sudo[92135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-79c0dbae-ff1b-47d0-8c9a-8ab2c09eaca8 Sep 15 16:21:10 devstack sudo[92135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:21:10 devstack sudo[92135]: pam_unix(sudo:session): session closed for user root Sep 15 16:21:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c62da56c-9729-4571-84ab-c5ca1ac1f901 tempest-ServerActionsTestOtherA-844381334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-79c0dbae-ff1b-47d0-8c9a-8ab2c09eaca8" returned: 0 in 0.328s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:21:10 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c62da56c-9729-4571-84ab-c5ca1ac1f901 tempest-ServerActionsTestOtherA-844381334 None] Lock "cinder-quobyte-79c0dbae-ff1b-47d0-8c9a-8ab2c09eaca8" released by "delete_volume" :: held 0.872s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:21:10 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-c62da56c-9729-4571-84ab-c5ca1ac1f901 tempest-ServerActionsTestOtherA-844381334 None] Created reservations ['2f34988e-f603-4874-9d76-bdd9b801a0e8', '73b5d77a-f631-4e01-a863-aea30ed8cc97', 'ba88d114-6aa6-4079-8026-19cfaf0cd959', '7f1f95ca-d5d7-4d07-8f28-edc9863d8abe'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:21:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c62da56c-9729-4571-84ab-c5ca1ac1f901 tempest-ServerActionsTestOtherA-844381334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:21:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c62da56c-9729-4571-84ab-c5ca1ac1f901 tempest-ServerActionsTestOtherA-844381334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:21:10 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c62da56c-9729-4571-84ab-c5ca1ac1f901 tempest-ServerActionsTestOtherA-844381334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:21:10 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c62da56c-9729-4571-84ab-c5ca1ac1f901 tempest-ServerActionsTestOtherA-844381334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:21:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c62da56c-9729-4571-84ab-c5ca1ac1f901 tempest-ServerActionsTestOtherA-844381334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:21:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c62da56c-9729-4571-84ab-c5ca1ac1f901 tempest-ServerActionsTestOtherA-844381334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:21:10 devstack sudo[92138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:21:10 devstack sudo[92138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:21:10 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-032b17d6-cb7c-4b5b-9a9d-ba3747032c67 tempest-VolumesTestJSON-831084994 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:21:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-032b17d6-cb7c-4b5b-9a9d-ba3747032c67 tempest-VolumesTestJSON-831084994 None] Flow 'volume_create_manager' (25818c4a-5a4f-48fc-9c48-37751efb45c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:21:10 devstack sudo[92138]: pam_unix(sudo:session): session closed for user root Sep 15 16:21:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-032b17d6-cb7c-4b5b-9a9d-ba3747032c67 tempest-VolumesTestJSON-831084994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (417e6db1-4796-4410-86b8-f1e468dcb03a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:21:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c62da56c-9729-4571-84ab-c5ca1ac1f901 tempest-ServerActionsTestOtherA-844381334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.433s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:21:10 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-c62da56c-9729-4571-84ab-c5ca1ac1f901 tempest-ServerActionsTestOtherA-844381334 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:21:10 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-c62da56c-9729-4571-84ab-c5ca1ac1f901 tempest-ServerActionsTestOtherA-844381334 None] Deleted volume successfully. Sep 15 16:21:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-032b17d6-cb7c-4b5b-9a9d-ba3747032c67 tempest-VolumesTestJSON-831084994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (417e6db1-4796-4410-86b8-f1e468dcb03a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:21:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1527251011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab375562-9430-4024-b7b0-87caeafa5a1e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c089af6416df472f9791e49e2541144f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:21:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:21:11Z,use_quota=True,user_id='ab9ecf10b5c742d789784dc55afe6da0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:21:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-032b17d6-cb7c-4b5b-9a9d-ba3747032c67 tempest-VolumesTestJSON-831084994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19006437-1696-40a5-a976-e522fd0e14b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:21:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-032b17d6-cb7c-4b5b-9a9d-ba3747032c67 tempest-VolumesTestJSON-831084994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19006437-1696-40a5-a976-e522fd0e14b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:21:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-032b17d6-cb7c-4b5b-9a9d-ba3747032c67 tempest-VolumesTestJSON-831084994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (184dabca-efa9-42b5-995a-e91429ca3440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:21:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-032b17d6-cb7c-4b5b-9a9d-ba3747032c67 tempest-VolumesTestJSON-831084994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (184dabca-efa9-42b5-995a-e91429ca3440) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab375562-9430-4024-b7b0-87caeafa5a1e', 'volume_name': 'volume-ab375562-9430-4024-b7b0-87caeafa5a1e', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:21:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-032b17d6-cb7c-4b5b-9a9d-ba3747032c67 tempest-VolumesTestJSON-831084994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87e8e4d6-aed2-4b31-a717-d8213c679158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:21:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-032b17d6-cb7c-4b5b-9a9d-ba3747032c67 tempest-VolumesTestJSON-831084994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87e8e4d6-aed2-4b31-a717-d8213c679158) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:21:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-032b17d6-cb7c-4b5b-9a9d-ba3747032c67 tempest-VolumesTestJSON-831084994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c89cf238-14ec-42d2-8fc6-1203561015b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:21:10 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-032b17d6-cb7c-4b5b-9a9d-ba3747032c67 tempest-VolumesTestJSON-831084994 None] Volume ab375562-9430-4024-b7b0-87caeafa5a1e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab375562-9430-4024-b7b0-87caeafa5a1e', 'volume_size': 1} Sep 15 16:21:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-032b17d6-cb7c-4b5b-9a9d-ba3747032c67 tempest-VolumesTestJSON-831084994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:21:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-032b17d6-cb7c-4b5b-9a9d-ba3747032c67 tempest-VolumesTestJSON-831084994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:21:10 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-032b17d6-cb7c-4b5b-9a9d-ba3747032c67 tempest-VolumesTestJSON-831084994 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:21:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1527251011',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab375562-9430-4024-b7b0-87caeafa5a1e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c089af6416df472f9791e49e2541144f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:21:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:21:11Z,use_quota=True,user_id='ab9ecf10b5c742d789784dc55afe6da0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:21:10 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-032b17d6-cb7c-4b5b-9a9d-ba3747032c67 tempest-VolumesTestJSON-831084994 None] Creating volume ab375562-9430-4024-b7b0-87caeafa5a1e {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:21:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-032b17d6-cb7c-4b5b-9a9d-ba3747032c67 tempest-VolumesTestJSON-831084994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:21:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-032b17d6-cb7c-4b5b-9a9d-ba3747032c67 tempest-VolumesTestJSON-831084994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:21:10 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-032b17d6-cb7c-4b5b-9a9d-ba3747032c67 tempest-VolumesTestJSON-831084994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:21:10 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-032b17d6-cb7c-4b5b-9a9d-ba3747032c67 tempest-VolumesTestJSON-831084994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:21:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-032b17d6-cb7c-4b5b-9a9d-ba3747032c67 tempest-VolumesTestJSON-831084994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:21:10 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-032b17d6-cb7c-4b5b-9a9d-ba3747032c67 tempest-VolumesTestJSON-831084994 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:21:10 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-032b17d6-cb7c-4b5b-9a9d-ba3747032c67 tempest-VolumesTestJSON-831084994 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:21:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-032b17d6-cb7c-4b5b-9a9d-ba3747032c67 tempest-VolumesTestJSON-831084994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ab375562-9430-4024-b7b0-87caeafa5a1e 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:21:11 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c62da56c-9729-4571-84ab-c5ca1ac1f901 tempest-ServerActionsTestOtherA-844381334 None] Lock "cinder-79c0dbae-ff1b-47d0-8c9a-8ab2c09eaca8-delete_volume" released by "delete_volume" :: held 1.707s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:21:11 devstack sudo[92141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ab375562-9430-4024-b7b0-87caeafa5a1e 1073741824 Sep 15 16:21:11 devstack sudo[92141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:21:11 devstack sudo[92141]: pam_unix(sudo:session): session closed for user root Sep 15 16:21:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-032b17d6-cb7c-4b5b-9a9d-ba3747032c67 tempest-VolumesTestJSON-831084994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ab375562-9430-4024-b7b0-87caeafa5a1e 1073741824" returned: 0 in 0.579s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:21:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-032b17d6-cb7c-4b5b-9a9d-ba3747032c67 tempest-VolumesTestJSON-831084994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ab375562-9430-4024-b7b0-87caeafa5a1e {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:21:11 devstack sudo[92147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ab375562-9430-4024-b7b0-87caeafa5a1e Sep 15 16:21:11 devstack sudo[92147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:21:12 devstack sudo[92147]: pam_unix(sudo:session): session closed for user root Sep 15 16:21:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-032b17d6-cb7c-4b5b-9a9d-ba3747032c67 tempest-VolumesTestJSON-831084994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ab375562-9430-4024-b7b0-87caeafa5a1e" returned: 0 in 0.388s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:21:12 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-032b17d6-cb7c-4b5b-9a9d-ba3747032c67 tempest-VolumesTestJSON-831084994 None] <== create_volume: return (1033ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:21:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-032b17d6-cb7c-4b5b-9a9d-ba3747032c67 tempest-VolumesTestJSON-831084994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:21:12 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-032b17d6-cb7c-4b5b-9a9d-ba3747032c67 tempest-VolumesTestJSON-831084994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c89cf238-14ec-42d2-8fc6-1203561015b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab375562-9430-4024-b7b0-87caeafa5a1e', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:21:12 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-032b17d6-cb7c-4b5b-9a9d-ba3747032c67 tempest-VolumesTestJSON-831084994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef89f095-6dd4-442f-a099-d69b8a76e31e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:21:12 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-032b17d6-cb7c-4b5b-9a9d-ba3747032c67 tempest-VolumesTestJSON-831084994 None] Volume volume-ab375562-9430-4024-b7b0-87caeafa5a1e (ab375562-9430-4024-b7b0-87caeafa5a1e): created successfully Sep 15 16:21:12 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-032b17d6-cb7c-4b5b-9a9d-ba3747032c67 tempest-VolumesTestJSON-831084994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef89f095-6dd4-442f-a099-d69b8a76e31e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:21:12 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-032b17d6-cb7c-4b5b-9a9d-ba3747032c67 tempest-VolumesTestJSON-831084994 None] Flow 'volume_create_manager' (25818c4a-5a4f-48fc-9c48-37751efb45c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:21:12 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-032b17d6-cb7c-4b5b-9a9d-ba3747032c67 tempest-VolumesTestJSON-831084994 None] Created volume successfully. Sep 15 16:21:14 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-8cdfa017-016f-4224-9424-cabb5b6051a1 tempest-VolumesTestJSON-831084994 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:21:14 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8cdfa017-016f-4224-9424-cabb5b6051a1 tempest-VolumesTestJSON-831084994 None] Flow 'volume_create_manager' (638352b6-f1a7-4ab2-baa3-fd8c6e3eb0c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:21:14 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8cdfa017-016f-4224-9424-cabb5b6051a1 tempest-VolumesTestJSON-831084994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a216db71-3974-4fd5-98c8-200205183193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:21:14 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8cdfa017-016f-4224-9424-cabb5b6051a1 tempest-VolumesTestJSON-831084994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a216db71-3974-4fd5-98c8-200205183193) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:21:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1707114794',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef883f25-7fd5-4d01-9e3f-5be31b44bdde,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c089af6416df472f9791e49e2541144f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:21:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:21:14Z,use_quota=True,user_id='ab9ecf10b5c742d789784dc55afe6da0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:21:14 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8cdfa017-016f-4224-9424-cabb5b6051a1 tempest-VolumesTestJSON-831084994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8c5db09-12f0-448e-8953-ab9be9885241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:21:14 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8cdfa017-016f-4224-9424-cabb5b6051a1 tempest-VolumesTestJSON-831084994 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c8c5db09-12f0-448e-8953-ab9be9885241) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:21:14 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8cdfa017-016f-4224-9424-cabb5b6051a1 tempest-VolumesTestJSON-831084994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36d96d6d-2b59-4e66-a58d-39db568303ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:21:14 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8cdfa017-016f-4224-9424-cabb5b6051a1 tempest-VolumesTestJSON-831084994 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (36d96d6d-2b59-4e66-a58d-39db568303ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef883f25-7fd5-4d01-9e3f-5be31b44bdde', 'volume_name': 'volume-ef883f25-7fd5-4d01-9e3f-5be31b44bdde', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:21:14 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8cdfa017-016f-4224-9424-cabb5b6051a1 tempest-VolumesTestJSON-831084994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (116e69fe-09c5-4bf4-82a1-a6462d5c029b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:21:14 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8cdfa017-016f-4224-9424-cabb5b6051a1 tempest-VolumesTestJSON-831084994 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (116e69fe-09c5-4bf4-82a1-a6462d5c029b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:21:14 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8cdfa017-016f-4224-9424-cabb5b6051a1 tempest-VolumesTestJSON-831084994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c94293f0-a4ed-4e9d-bdbe-557e478ea04b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:21:14 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-8cdfa017-016f-4224-9424-cabb5b6051a1 tempest-VolumesTestJSON-831084994 None] Volume ef883f25-7fd5-4d01-9e3f-5be31b44bdde: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef883f25-7fd5-4d01-9e3f-5be31b44bdde', 'volume_size': 1} Sep 15 16:21:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-8cdfa017-016f-4224-9424-cabb5b6051a1 tempest-VolumesTestJSON-831084994 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:21:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-8cdfa017-016f-4224-9424-cabb5b6051a1 tempest-VolumesTestJSON-831084994 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:21:14 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-8cdfa017-016f-4224-9424-cabb5b6051a1 tempest-VolumesTestJSON-831084994 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:21:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1707114794',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef883f25-7fd5-4d01-9e3f-5be31b44bdde,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='c089af6416df472f9791e49e2541144f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:21:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:21:14Z,use_quota=True,user_id='ab9ecf10b5c742d789784dc55afe6da0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:21:14 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-8cdfa017-016f-4224-9424-cabb5b6051a1 tempest-VolumesTestJSON-831084994 None] Creating volume ef883f25-7fd5-4d01-9e3f-5be31b44bdde {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:21:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-8cdfa017-016f-4224-9424-cabb5b6051a1 tempest-VolumesTestJSON-831084994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:21:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-8cdfa017-016f-4224-9424-cabb5b6051a1 tempest-VolumesTestJSON-831084994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:21:14 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-8cdfa017-016f-4224-9424-cabb5b6051a1 tempest-VolumesTestJSON-831084994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:21:14 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-8cdfa017-016f-4224-9424-cabb5b6051a1 tempest-VolumesTestJSON-831084994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:21:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-8cdfa017-016f-4224-9424-cabb5b6051a1 tempest-VolumesTestJSON-831084994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:21:14 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-8cdfa017-016f-4224-9424-cabb5b6051a1 tempest-VolumesTestJSON-831084994 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:21:14 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-8cdfa017-016f-4224-9424-cabb5b6051a1 tempest-VolumesTestJSON-831084994 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:21:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8cdfa017-016f-4224-9424-cabb5b6051a1 tempest-VolumesTestJSON-831084994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ef883f25-7fd5-4d01-9e3f-5be31b44bdde 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:21:14 devstack sudo[92175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ef883f25-7fd5-4d01-9e3f-5be31b44bdde 1073741824 Sep 15 16:21:14 devstack sudo[92175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:21:14 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-c40407f5-ef4b-4c2c-b011-ecd434440602 tempest-VolumeRetypeWithoutMigrationTest-1884666837 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:21:14 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c40407f5-ef4b-4c2c-b011-ecd434440602 tempest-VolumeRetypeWithoutMigrationTest-1884666837 None] Flow 'volume_create_manager' (ee82c6bb-7ab9-4544-8588-3104cb73543f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:21:14 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c40407f5-ef4b-4c2c-b011-ecd434440602 tempest-VolumeRetypeWithoutMigrationTest-1884666837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da411e19-b64d-4513-a54f-86c30f3c06c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:21:14 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c40407f5-ef4b-4c2c-b011-ecd434440602 tempest-VolumeRetypeWithoutMigrationTest-1884666837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da411e19-b64d-4513-a54f-86c30f3c06c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:21:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-130328804',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2d8e8df-39fd-4238-b72a-7a8eb0e7b414,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01fcad6d885b4d71b76daac0d996009b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:21:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:21:14Z,use_quota=True,user_id='ce557e9d0b5d4b2c94e9c15103138b9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5b82edce-01c0-46b7-ae00-42a265356f1f),volume_type_id=5b82edce-01c0-46b7-ae00-42a265356f1f)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:21:14 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c40407f5-ef4b-4c2c-b011-ecd434440602 tempest-VolumeRetypeWithoutMigrationTest-1884666837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c159719-a39c-41ef-b095-780b3711556c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:21:14 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c40407f5-ef4b-4c2c-b011-ecd434440602 tempest-VolumeRetypeWithoutMigrationTest-1884666837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c159719-a39c-41ef-b095-780b3711556c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:21:14 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c40407f5-ef4b-4c2c-b011-ecd434440602 tempest-VolumeRetypeWithoutMigrationTest-1884666837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eedeef1a-e67a-4a41-83d5-8130a1882348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:21:14 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c40407f5-ef4b-4c2c-b011-ecd434440602 tempest-VolumeRetypeWithoutMigrationTest-1884666837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eedeef1a-e67a-4a41-83d5-8130a1882348) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2d8e8df-39fd-4238-b72a-7a8eb0e7b414', 'volume_name': 'volume-a2d8e8df-39fd-4238-b72a-7a8eb0e7b414', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:21:14 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c40407f5-ef4b-4c2c-b011-ecd434440602 tempest-VolumeRetypeWithoutMigrationTest-1884666837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c972163-daa2-4fb4-91f2-ef1656c290a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:21:14 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c40407f5-ef4b-4c2c-b011-ecd434440602 tempest-VolumeRetypeWithoutMigrationTest-1884666837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c972163-daa2-4fb4-91f2-ef1656c290a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:21:14 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c40407f5-ef4b-4c2c-b011-ecd434440602 tempest-VolumeRetypeWithoutMigrationTest-1884666837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5e85103-b39e-4f36-a769-0e46e0de856c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:21:14 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-c40407f5-ef4b-4c2c-b011-ecd434440602 tempest-VolumeRetypeWithoutMigrationTest-1884666837 None] Volume a2d8e8df-39fd-4238-b72a-7a8eb0e7b414: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2d8e8df-39fd-4238-b72a-7a8eb0e7b414', 'volume_size': 1} Sep 15 16:21:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c40407f5-ef4b-4c2c-b011-ecd434440602 tempest-VolumeRetypeWithoutMigrationTest-1884666837 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:21:14 devstack sudo[92175]: pam_unix(sudo:session): session closed for user root Sep 15 16:21:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8cdfa017-016f-4224-9424-cabb5b6051a1 tempest-VolumesTestJSON-831084994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ef883f25-7fd5-4d01-9e3f-5be31b44bdde 1073741824" returned: 0 in 0.518s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:21:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8cdfa017-016f-4224-9424-cabb5b6051a1 tempest-VolumesTestJSON-831084994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ef883f25-7fd5-4d01-9e3f-5be31b44bdde {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:21:14 devstack sudo[92180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ef883f25-7fd5-4d01-9e3f-5be31b44bdde Sep 15 16:21:14 devstack sudo[92180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:21:15 devstack sudo[92180]: pam_unix(sudo:session): session closed for user root Sep 15 16:21:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8cdfa017-016f-4224-9424-cabb5b6051a1 tempest-VolumesTestJSON-831084994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ef883f25-7fd5-4d01-9e3f-5be31b44bdde" returned: 0 in 0.306s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:21:15 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-8cdfa017-016f-4224-9424-cabb5b6051a1 tempest-VolumesTestJSON-831084994 None] <== create_volume: return (889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:21:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-8cdfa017-016f-4224-9424-cabb5b6051a1 tempest-VolumesTestJSON-831084994 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:21:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c40407f5-ef4b-4c2c-b011-ecd434440602 tempest-VolumeRetypeWithoutMigrationTest-1884666837 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.654s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:21:15 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c40407f5-ef4b-4c2c-b011-ecd434440602 tempest-VolumeRetypeWithoutMigrationTest-1884666837 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:21:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-130328804',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2d8e8df-39fd-4238-b72a-7a8eb0e7b414,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01fcad6d885b4d71b76daac0d996009b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:21:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:21:14Z,use_quota=True,user_id='ce557e9d0b5d4b2c94e9c15103138b9d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5b82edce-01c0-46b7-ae00-42a265356f1f),volume_type_id=5b82edce-01c0-46b7-ae00-42a265356f1f)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:21:15 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-c40407f5-ef4b-4c2c-b011-ecd434440602 tempest-VolumeRetypeWithoutMigrationTest-1884666837 None] Creating volume a2d8e8df-39fd-4238-b72a-7a8eb0e7b414 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:21:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c40407f5-ef4b-4c2c-b011-ecd434440602 tempest-VolumeRetypeWithoutMigrationTest-1884666837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:21:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c40407f5-ef4b-4c2c-b011-ecd434440602 tempest-VolumeRetypeWithoutMigrationTest-1884666837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:21:15 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c40407f5-ef4b-4c2c-b011-ecd434440602 tempest-VolumeRetypeWithoutMigrationTest-1884666837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:21:15 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c40407f5-ef4b-4c2c-b011-ecd434440602 tempest-VolumeRetypeWithoutMigrationTest-1884666837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:21:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c40407f5-ef4b-4c2c-b011-ecd434440602 tempest-VolumeRetypeWithoutMigrationTest-1884666837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:21:15 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c40407f5-ef4b-4c2c-b011-ecd434440602 tempest-VolumeRetypeWithoutMigrationTest-1884666837 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:21:15 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-c40407f5-ef4b-4c2c-b011-ecd434440602 tempest-VolumeRetypeWithoutMigrationTest-1884666837 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:21:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c40407f5-ef4b-4c2c-b011-ecd434440602 tempest-VolumeRetypeWithoutMigrationTest-1884666837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a2d8e8df-39fd-4238-b72a-7a8eb0e7b414 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:21:15 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8cdfa017-016f-4224-9424-cabb5b6051a1 tempest-VolumesTestJSON-831084994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c94293f0-a4ed-4e9d-bdbe-557e478ea04b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef883f25-7fd5-4d01-9e3f-5be31b44bdde', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:21:15 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8cdfa017-016f-4224-9424-cabb5b6051a1 tempest-VolumesTestJSON-831084994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c25370db-95c7-4cda-9d0c-8cb513f3c502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:21:15 devstack sudo[92183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a2d8e8df-39fd-4238-b72a-7a8eb0e7b414 1073741824 Sep 15 16:21:15 devstack sudo[92183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:21:15 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-8cdfa017-016f-4224-9424-cabb5b6051a1 tempest-VolumesTestJSON-831084994 None] Volume volume-ef883f25-7fd5-4d01-9e3f-5be31b44bdde (ef883f25-7fd5-4d01-9e3f-5be31b44bdde): created successfully Sep 15 16:21:15 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8cdfa017-016f-4224-9424-cabb5b6051a1 tempest-VolumesTestJSON-831084994 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c25370db-95c7-4cda-9d0c-8cb513f3c502) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:21:15 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8cdfa017-016f-4224-9424-cabb5b6051a1 tempest-VolumesTestJSON-831084994 None] Flow 'volume_create_manager' (638352b6-f1a7-4ab2-baa3-fd8c6e3eb0c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:21:15 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-8cdfa017-016f-4224-9424-cabb5b6051a1 tempest-VolumesTestJSON-831084994 None] Created volume successfully. Sep 15 16:21:15 devstack sudo[92183]: pam_unix(sudo:session): session closed for user root Sep 15 16:21:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c40407f5-ef4b-4c2c-b011-ecd434440602 tempest-VolumeRetypeWithoutMigrationTest-1884666837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a2d8e8df-39fd-4238-b72a-7a8eb0e7b414 1073741824" returned: 0 in 0.635s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:21:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c40407f5-ef4b-4c2c-b011-ecd434440602 tempest-VolumeRetypeWithoutMigrationTest-1884666837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a2d8e8df-39fd-4238-b72a-7a8eb0e7b414 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:21:15 devstack sudo[92210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a2d8e8df-39fd-4238-b72a-7a8eb0e7b414 Sep 15 16:21:15 devstack sudo[92210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:21:16 devstack sudo[92210]: pam_unix(sudo:session): session closed for user root Sep 15 16:21:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c40407f5-ef4b-4c2c-b011-ecd434440602 tempest-VolumeRetypeWithoutMigrationTest-1884666837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a2d8e8df-39fd-4238-b72a-7a8eb0e7b414" returned: 0 in 0.273s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:21:16 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c40407f5-ef4b-4c2c-b011-ecd434440602 tempest-VolumeRetypeWithoutMigrationTest-1884666837 None] <== create_volume: return (953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:21:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c40407f5-ef4b-4c2c-b011-ecd434440602 tempest-VolumeRetypeWithoutMigrationTest-1884666837 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.958s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:21:16 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c40407f5-ef4b-4c2c-b011-ecd434440602 tempest-VolumeRetypeWithoutMigrationTest-1884666837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5e85103-b39e-4f36-a769-0e46e0de856c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2d8e8df-39fd-4238-b72a-7a8eb0e7b414', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:21:16 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c40407f5-ef4b-4c2c-b011-ecd434440602 tempest-VolumeRetypeWithoutMigrationTest-1884666837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1993879-c327-4ed2-9a77-f439966fbe46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:21:16 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-c40407f5-ef4b-4c2c-b011-ecd434440602 tempest-VolumeRetypeWithoutMigrationTest-1884666837 None] Volume volume-a2d8e8df-39fd-4238-b72a-7a8eb0e7b414 (a2d8e8df-39fd-4238-b72a-7a8eb0e7b414): created successfully Sep 15 16:21:16 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c40407f5-ef4b-4c2c-b011-ecd434440602 tempest-VolumeRetypeWithoutMigrationTest-1884666837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1993879-c327-4ed2-9a77-f439966fbe46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:21:16 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c40407f5-ef4b-4c2c-b011-ecd434440602 tempest-VolumeRetypeWithoutMigrationTest-1884666837 None] Flow 'volume_create_manager' (ee82c6bb-7ab9-4544-8588-3104cb73543f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:21:16 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-c40407f5-ef4b-4c2c-b011-ecd434440602 tempest-VolumeRetypeWithoutMigrationTest-1884666837 None] Created volume successfully. Sep 15 16:21:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-ba49d830-481b-4b4f-b7f8-36d793941c43 tempest-VolumeRetypeWithoutMigrationTest-1884666837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:21:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-ba49d830-481b-4b4f-b7f8-36d793941c43 tempest-VolumeRetypeWithoutMigrationTest-1884666837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:21:16 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-ba49d830-481b-4b4f-b7f8-36d793941c43 tempest-VolumeRetypeWithoutMigrationTest-1884666837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:21:16 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-ba49d830-481b-4b4f-b7f8-36d793941c43 tempest-VolumeRetypeWithoutMigrationTest-1884666837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:21:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-ba49d830-481b-4b4f-b7f8-36d793941c43 tempest-VolumeRetypeWithoutMigrationTest-1884666837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:21:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ba49d830-481b-4b4f-b7f8-36d793941c43 tempest-VolumeRetypeWithoutMigrationTest-1884666837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:21:16 devstack sudo[92214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:21:16 devstack sudo[92214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:21:17 devstack sudo[92214]: pam_unix(sudo:session): session closed for user root Sep 15 16:21:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ba49d830-481b-4b4f-b7f8-36d793941c43 tempest-VolumeRetypeWithoutMigrationTest-1884666837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.300s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:21:17 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-ba49d830-481b-4b4f-b7f8-36d793941c43 tempest-VolumeRetypeWithoutMigrationTest-1884666837 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:21:17 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-ba49d830-481b-4b4f-b7f8-36d793941c43 tempest-VolumeRetypeWithoutMigrationTest-1884666837 None] Retype volume completed successfully. Sep 15 16:21:17 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-a9b7f785-11c7-4d1d-a281-e6b9e3d4819b tempest-VolumesTestJSON-831084994 None] Acquiring lock "cinder-ef883f25-7fd5-4d01-9e3f-5be31b44bdde-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:21:17 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-a9b7f785-11c7-4d1d-a281-e6b9e3d4819b tempest-VolumesTestJSON-831084994 None] Lock "cinder-ef883f25-7fd5-4d01-9e3f-5be31b44bdde-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:21:17 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-a9b7f785-11c7-4d1d-a281-e6b9e3d4819b tempest-VolumesTestJSON-831084994 None] Acquiring lock "cinder-quobyte-ef883f25-7fd5-4d01-9e3f-5be31b44bdde" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:21:17 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-a9b7f785-11c7-4d1d-a281-e6b9e3d4819b tempest-VolumesTestJSON-831084994 None] Lock "cinder-quobyte-ef883f25-7fd5-4d01-9e3f-5be31b44bdde" acquired by "delete_volume" :: waited 0.019s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:21:17 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad680ec7-6a18-428b-9208-718265fd4e22]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:21:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a9b7f785-11c7-4d1d-a281-e6b9e3d4819b tempest-VolumesTestJSON-831084994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ef883f25-7fd5-4d01-9e3f-5be31b44bdde {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:21:17 devstack sudo[92217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ef883f25-7fd5-4d01-9e3f-5be31b44bdde Sep 15 16:21:17 devstack sudo[92217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:21:17 devstack sudo[92217]: pam_unix(sudo:session): session closed for user root Sep 15 16:21:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a9b7f785-11c7-4d1d-a281-e6b9e3d4819b tempest-VolumesTestJSON-831084994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ef883f25-7fd5-4d01-9e3f-5be31b44bdde" returned: 0 in 0.396s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:21:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a9b7f785-11c7-4d1d-a281-e6b9e3d4819b tempest-VolumesTestJSON-831084994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ef883f25-7fd5-4d01-9e3f-5be31b44bdde {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:21:17 devstack sudo[92222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ef883f25-7fd5-4d01-9e3f-5be31b44bdde Sep 15 16:21:17 devstack sudo[92222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:21:17 devstack sudo[92222]: pam_unix(sudo:session): session closed for user root Sep 15 16:21:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a9b7f785-11c7-4d1d-a281-e6b9e3d4819b tempest-VolumesTestJSON-831084994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ef883f25-7fd5-4d01-9e3f-5be31b44bdde" returned: 0 in 0.281s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:21:17 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-a9b7f785-11c7-4d1d-a281-e6b9e3d4819b tempest-VolumesTestJSON-831084994 None] Lock "cinder-quobyte-ef883f25-7fd5-4d01-9e3f-5be31b44bdde" released by "delete_volume" :: held 0.726s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:21:18 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-a9b7f785-11c7-4d1d-a281-e6b9e3d4819b tempest-VolumesTestJSON-831084994 None] Created reservations ['27c98d19-7e0c-4a71-a484-3ee83618be7c', 'fdddf3c2-79a8-466f-96e3-5b2b7c650bcd', 'cd4f3cd1-a95f-4d03-ac0d-86576d8367f6', '445388db-ced7-4532-ba5a-04ceb9a5b6a2'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:21:18 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c683060e-2517-42ce-9b91-0294e483c89b tempest-VolumeRetypeWithoutMigrationTest-1884666837 None] Acquiring lock "cinder-a2d8e8df-39fd-4238-b72a-7a8eb0e7b414-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:21:18 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c683060e-2517-42ce-9b91-0294e483c89b tempest-VolumeRetypeWithoutMigrationTest-1884666837 None] Lock "cinder-a2d8e8df-39fd-4238-b72a-7a8eb0e7b414-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:21:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-a9b7f785-11c7-4d1d-a281-e6b9e3d4819b tempest-VolumesTestJSON-831084994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:21:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-a9b7f785-11c7-4d1d-a281-e6b9e3d4819b tempest-VolumesTestJSON-831084994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:21:18 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-a9b7f785-11c7-4d1d-a281-e6b9e3d4819b tempest-VolumesTestJSON-831084994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:21:18 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-a9b7f785-11c7-4d1d-a281-e6b9e3d4819b tempest-VolumesTestJSON-831084994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:21:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-a9b7f785-11c7-4d1d-a281-e6b9e3d4819b tempest-VolumesTestJSON-831084994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:21:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a9b7f785-11c7-4d1d-a281-e6b9e3d4819b tempest-VolumesTestJSON-831084994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:21:18 devstack sudo[92225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:21:18 devstack sudo[92225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:21:18 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c683060e-2517-42ce-9b91-0294e483c89b tempest-VolumeRetypeWithoutMigrationTest-1884666837 None] Acquiring lock "cinder-quobyte-a2d8e8df-39fd-4238-b72a-7a8eb0e7b414" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:21:18 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c683060e-2517-42ce-9b91-0294e483c89b tempest-VolumeRetypeWithoutMigrationTest-1884666837 None] Lock "cinder-quobyte-a2d8e8df-39fd-4238-b72a-7a8eb0e7b414" acquired by "delete_volume" :: waited 0.017s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:21:18 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce32bd5f-6be2-4b42-b6a1-00a0c477d416]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:21:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c683060e-2517-42ce-9b91-0294e483c89b tempest-VolumeRetypeWithoutMigrationTest-1884666837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a2d8e8df-39fd-4238-b72a-7a8eb0e7b414 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:21:18 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-92dabcb9-ec89-4f92-b1f4-0f6ab8fd721f tempest-VolumesTestJSON-831084994 None] Acquiring lock "cinder-ab375562-9430-4024-b7b0-87caeafa5a1e-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:21:18 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-92dabcb9-ec89-4f92-b1f4-0f6ab8fd721f tempest-VolumesTestJSON-831084994 None] Lock "cinder-ab375562-9430-4024-b7b0-87caeafa5a1e-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:21:18 devstack sudo[92227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a2d8e8df-39fd-4238-b72a-7a8eb0e7b414 Sep 15 16:21:18 devstack sudo[92227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:21:18 devstack sudo[92225]: pam_unix(sudo:session): session closed for user root Sep 15 16:21:18 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-92dabcb9-ec89-4f92-b1f4-0f6ab8fd721f tempest-VolumesTestJSON-831084994 None] Acquiring lock "cinder-quobyte-ab375562-9430-4024-b7b0-87caeafa5a1e" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:21:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a9b7f785-11c7-4d1d-a281-e6b9e3d4819b tempest-VolumesTestJSON-831084994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.305s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:21:18 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-a9b7f785-11c7-4d1d-a281-e6b9e3d4819b tempest-VolumesTestJSON-831084994 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:21:18 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-a9b7f785-11c7-4d1d-a281-e6b9e3d4819b tempest-VolumesTestJSON-831084994 None] Deleted volume successfully. Sep 15 16:21:18 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-92dabcb9-ec89-4f92-b1f4-0f6ab8fd721f tempest-VolumesTestJSON-831084994 None] Lock "cinder-quobyte-ab375562-9430-4024-b7b0-87caeafa5a1e" acquired by "delete_volume" :: waited 0.027s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:21:18 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-a9b7f785-11c7-4d1d-a281-e6b9e3d4819b tempest-VolumesTestJSON-831084994 None] Lock "cinder-ef883f25-7fd5-4d01-9e3f-5be31b44bdde-delete_volume" released by "delete_volume" :: held 1.316s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:21:18 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[447eb00a-0bed-4888-8106-a47b7d5b2498]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:21:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-92dabcb9-ec89-4f92-b1f4-0f6ab8fd721f tempest-VolumesTestJSON-831084994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ab375562-9430-4024-b7b0-87caeafa5a1e {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:21:18 devstack sudo[92230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ab375562-9430-4024-b7b0-87caeafa5a1e Sep 15 16:21:18 devstack sudo[92230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:21:18 devstack sudo[92227]: pam_unix(sudo:session): session closed for user root Sep 15 16:21:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c683060e-2517-42ce-9b91-0294e483c89b tempest-VolumeRetypeWithoutMigrationTest-1884666837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a2d8e8df-39fd-4238-b72a-7a8eb0e7b414" returned: 0 in 0.500s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:21:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c683060e-2517-42ce-9b91-0294e483c89b tempest-VolumeRetypeWithoutMigrationTest-1884666837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a2d8e8df-39fd-4238-b72a-7a8eb0e7b414 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:21:18 devstack sudo[92236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a2d8e8df-39fd-4238-b72a-7a8eb0e7b414 Sep 15 16:21:18 devstack sudo[92236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:21:18 devstack sudo[92230]: pam_unix(sudo:session): session closed for user root Sep 15 16:21:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-92dabcb9-ec89-4f92-b1f4-0f6ab8fd721f tempest-VolumesTestJSON-831084994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ab375562-9430-4024-b7b0-87caeafa5a1e" returned: 0 in 0.402s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:21:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-92dabcb9-ec89-4f92-b1f4-0f6ab8fd721f tempest-VolumesTestJSON-831084994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ab375562-9430-4024-b7b0-87caeafa5a1e {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:21:18 devstack sudo[92241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ab375562-9430-4024-b7b0-87caeafa5a1e Sep 15 16:21:18 devstack sudo[92241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:21:19 devstack sudo[92236]: pam_unix(sudo:session): session closed for user root Sep 15 16:21:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c683060e-2517-42ce-9b91-0294e483c89b tempest-VolumeRetypeWithoutMigrationTest-1884666837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a2d8e8df-39fd-4238-b72a-7a8eb0e7b414" returned: 0 in 0.271s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:21:19 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c683060e-2517-42ce-9b91-0294e483c89b tempest-VolumeRetypeWithoutMigrationTest-1884666837 None] Lock "cinder-quobyte-a2d8e8df-39fd-4238-b72a-7a8eb0e7b414" released by "delete_volume" :: held 0.842s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:21:19 devstack cinder-volume[86082]: WARNING cinder.quota [None req-c683060e-2517-42ce-9b91-0294e483c89b tempest-VolumeRetypeWithoutMigrationTest-1884666837 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 15 16:21:19 devstack cinder-volume[86082]: WARNING cinder.quota [None req-c683060e-2517-42ce-9b91-0294e483c89b tempest-VolumeRetypeWithoutMigrationTest-1884666837 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 15 16:21:19 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-c683060e-2517-42ce-9b91-0294e483c89b tempest-VolumeRetypeWithoutMigrationTest-1884666837 None] Created reservations ['72861751-c927-4497-9593-bcbe8eec6372', 'e14795f7-3858-462c-a7d3-409a76c82d4b', '6adfbc20-7ad8-4b84-826a-e35aeb3a4851', 'cc826a9e-d9e3-4e8a-8d74-a8df2efa9c11'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:21:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c683060e-2517-42ce-9b91-0294e483c89b tempest-VolumeRetypeWithoutMigrationTest-1884666837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:21:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c683060e-2517-42ce-9b91-0294e483c89b tempest-VolumeRetypeWithoutMigrationTest-1884666837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:21:19 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c683060e-2517-42ce-9b91-0294e483c89b tempest-VolumeRetypeWithoutMigrationTest-1884666837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:21:19 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c683060e-2517-42ce-9b91-0294e483c89b tempest-VolumeRetypeWithoutMigrationTest-1884666837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:21:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c683060e-2517-42ce-9b91-0294e483c89b tempest-VolumeRetypeWithoutMigrationTest-1884666837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:21:19 devstack sudo[92241]: pam_unix(sudo:session): session closed for user root Sep 15 16:21:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c683060e-2517-42ce-9b91-0294e483c89b tempest-VolumeRetypeWithoutMigrationTest-1884666837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:21:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-92dabcb9-ec89-4f92-b1f4-0f6ab8fd721f tempest-VolumesTestJSON-831084994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ab375562-9430-4024-b7b0-87caeafa5a1e" returned: 0 in 0.299s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:21:19 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-92dabcb9-ec89-4f92-b1f4-0f6ab8fd721f tempest-VolumesTestJSON-831084994 None] Lock "cinder-quobyte-ab375562-9430-4024-b7b0-87caeafa5a1e" released by "delete_volume" :: held 0.756s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:21:19 devstack sudo[92245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:21:19 devstack sudo[92245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:21:19 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-92dabcb9-ec89-4f92-b1f4-0f6ab8fd721f tempest-VolumesTestJSON-831084994 None] Created reservations ['9abaf6c2-7883-41c0-a1f5-bd9fb08e76e2', 'b48082e3-8c59-4c02-a9cd-cfab8a433ffa', 'd8c467ab-c5ac-42c5-b618-3bc1478c1d04', 'dda74242-0a8e-4200-a745-ffe32bb14b6c'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:21:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-92dabcb9-ec89-4f92-b1f4-0f6ab8fd721f tempest-VolumesTestJSON-831084994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:21:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-92dabcb9-ec89-4f92-b1f4-0f6ab8fd721f tempest-VolumesTestJSON-831084994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:21:19 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-92dabcb9-ec89-4f92-b1f4-0f6ab8fd721f tempest-VolumesTestJSON-831084994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:21:19 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-92dabcb9-ec89-4f92-b1f4-0f6ab8fd721f tempest-VolumesTestJSON-831084994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:21:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-92dabcb9-ec89-4f92-b1f4-0f6ab8fd721f tempest-VolumesTestJSON-831084994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:21:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-92dabcb9-ec89-4f92-b1f4-0f6ab8fd721f tempest-VolumesTestJSON-831084994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:21:19 devstack sudo[92247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:21:19 devstack sudo[92247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:21:19 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-25853020-cd8e-40b2-9270-d25f40a07902 tempest-VolumesTestJSON-831084994 None] Acquiring lock "cinder-24691ecc-e975-4f2b-a4ef-72e6878d8dfc-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:21:19 devstack sudo[92245]: pam_unix(sudo:session): session closed for user root Sep 15 16:21:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c683060e-2517-42ce-9b91-0294e483c89b tempest-VolumeRetypeWithoutMigrationTest-1884666837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.386s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:21:19 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-c683060e-2517-42ce-9b91-0294e483c89b tempest-VolumeRetypeWithoutMigrationTest-1884666837 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:21:19 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-c683060e-2517-42ce-9b91-0294e483c89b tempest-VolumeRetypeWithoutMigrationTest-1884666837 None] Deleted volume successfully. Sep 15 16:21:19 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-25853020-cd8e-40b2-9270-d25f40a07902 tempest-VolumesTestJSON-831084994 None] Lock "cinder-24691ecc-e975-4f2b-a4ef-72e6878d8dfc-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:21:19 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c683060e-2517-42ce-9b91-0294e483c89b tempest-VolumeRetypeWithoutMigrationTest-1884666837 None] Lock "cinder-a2d8e8df-39fd-4238-b72a-7a8eb0e7b414-delete_volume" released by "delete_volume" :: held 1.514s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:21:19 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-25853020-cd8e-40b2-9270-d25f40a07902 tempest-VolumesTestJSON-831084994 None] Acquiring lock "cinder-quobyte-24691ecc-e975-4f2b-a4ef-72e6878d8dfc" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:21:19 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-25853020-cd8e-40b2-9270-d25f40a07902 tempest-VolumesTestJSON-831084994 None] Lock "cinder-quobyte-24691ecc-e975-4f2b-a4ef-72e6878d8dfc" acquired by "delete_volume" :: waited 0.017s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:21:19 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[5150fe36-df2d-459f-b4dc-abfe10980815]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:21:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-25853020-cd8e-40b2-9270-d25f40a07902 tempest-VolumesTestJSON-831084994 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-24691ecc-e975-4f2b-a4ef-72e6878d8dfc {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:21:19 devstack sudo[92247]: pam_unix(sudo:session): session closed for user root Sep 15 16:21:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-92dabcb9-ec89-4f92-b1f4-0f6ab8fd721f tempest-VolumesTestJSON-831084994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.388s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:21:19 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-92dabcb9-ec89-4f92-b1f4-0f6ab8fd721f tempest-VolumesTestJSON-831084994 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:21:19 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-92dabcb9-ec89-4f92-b1f4-0f6ab8fd721f tempest-VolumesTestJSON-831084994 None] Deleted volume successfully. Sep 15 16:21:19 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-92dabcb9-ec89-4f92-b1f4-0f6ab8fd721f tempest-VolumesTestJSON-831084994 None] Lock "cinder-ab375562-9430-4024-b7b0-87caeafa5a1e-delete_volume" released by "delete_volume" :: held 1.443s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:21:19 devstack sudo[92251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-24691ecc-e975-4f2b-a4ef-72e6878d8dfc Sep 15 16:21:19 devstack sudo[92251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:21:20 devstack sudo[92251]: pam_unix(sudo:session): session closed for user root Sep 15 16:21:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-25853020-cd8e-40b2-9270-d25f40a07902 tempest-VolumesTestJSON-831084994 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-24691ecc-e975-4f2b-a4ef-72e6878d8dfc" returned: 0 in 0.470s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:21:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-25853020-cd8e-40b2-9270-d25f40a07902 tempest-VolumesTestJSON-831084994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-24691ecc-e975-4f2b-a4ef-72e6878d8dfc {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:21:20 devstack sudo[92256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-24691ecc-e975-4f2b-a4ef-72e6878d8dfc Sep 15 16:21:20 devstack sudo[92256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:21:20 devstack sudo[92256]: pam_unix(sudo:session): session closed for user root Sep 15 16:21:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-25853020-cd8e-40b2-9270-d25f40a07902 tempest-VolumesTestJSON-831084994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-24691ecc-e975-4f2b-a4ef-72e6878d8dfc" returned: 0 in 0.246s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:21:20 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-25853020-cd8e-40b2-9270-d25f40a07902 tempest-VolumesTestJSON-831084994 None] Lock "cinder-quobyte-24691ecc-e975-4f2b-a4ef-72e6878d8dfc" released by "delete_volume" :: held 0.777s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:21:20 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-25853020-cd8e-40b2-9270-d25f40a07902 tempest-VolumesTestJSON-831084994 None] Created reservations ['3106dc02-b079-4a17-a8c5-0e3e2c54308d', '04d4f2b8-3290-4f1d-8692-72e76275600f', '2a21371a-cb82-4c39-8a87-75134a5cc561', '2805b4d1-3fd6-4dc6-98a5-ddf49cefd598'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:21:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-25853020-cd8e-40b2-9270-d25f40a07902 tempest-VolumesTestJSON-831084994 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:21:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-25853020-cd8e-40b2-9270-d25f40a07902 tempest-VolumesTestJSON-831084994 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:21:20 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-25853020-cd8e-40b2-9270-d25f40a07902 tempest-VolumesTestJSON-831084994 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:21:20 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-25853020-cd8e-40b2-9270-d25f40a07902 tempest-VolumesTestJSON-831084994 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:21:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-25853020-cd8e-40b2-9270-d25f40a07902 tempest-VolumesTestJSON-831084994 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:21:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-25853020-cd8e-40b2-9270-d25f40a07902 tempest-VolumesTestJSON-831084994 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:21:20 devstack sudo[92259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:21:20 devstack sudo[92259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:21:20 devstack sudo[92259]: pam_unix(sudo:session): session closed for user root Sep 15 16:21:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-25853020-cd8e-40b2-9270-d25f40a07902 tempest-VolumesTestJSON-831084994 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.321s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:21:20 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-25853020-cd8e-40b2-9270-d25f40a07902 tempest-VolumesTestJSON-831084994 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:21:20 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-25853020-cd8e-40b2-9270-d25f40a07902 tempest-VolumesTestJSON-831084994 None] Deleted volume successfully. Sep 15 16:21:20 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-25853020-cd8e-40b2-9270-d25f40a07902 tempest-VolumesTestJSON-831084994 None] Lock "cinder-24691ecc-e975-4f2b-a4ef-72e6878d8dfc-delete_volume" released by "delete_volume" :: held 1.336s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:21:26 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8a5f4b52-94d3-4ada-b959-53f5539d3cad tempest-BackendsCapabilitiesAdminTestsJSON-1318797574 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.9663772583008, 'free_capacity_gb': 1775.9663772583008, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86082) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 15 16:21:26 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-056dae34-af26-4f46-9dc3-07c48ec5be19 tempest-BackendsCapabilitiesAdminTestsJSON-1318797574 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.9663772583008, 'free_capacity_gb': 1775.9663772583008, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86082) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 15 16:21:28 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-13e0adff-f91f-44ed-b9c1-ad6b57cc76b2 tempest-AttachVolumeTestJSON-1797013884 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:21:28 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-13e0adff-f91f-44ed-b9c1-ad6b57cc76b2 tempest-AttachVolumeTestJSON-1797013884 None] Flow 'volume_create_manager' (e820a993-d71e-4d3e-a53e-51d229dff87c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:21:28 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-13e0adff-f91f-44ed-b9c1-ad6b57cc76b2 tempest-AttachVolumeTestJSON-1797013884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5abdfbed-a079-46e4-934a-c2d95f864bbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:21:28 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-13e0adff-f91f-44ed-b9c1-ad6b57cc76b2 tempest-AttachVolumeTestJSON-1797013884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5abdfbed-a079-46e4-934a-c2d95f864bbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:21:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1542364450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23be684f-34c0-4ce2-9e13-1be7eac89e5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4074182297cb4184b4a6b5d1aae1cc44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:21:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:21:28Z,use_quota=True,user_id='6e8071e77b4a42e8a3e07a9b3a4737f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:21:28 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-13e0adff-f91f-44ed-b9c1-ad6b57cc76b2 tempest-AttachVolumeTestJSON-1797013884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6464a6ac-8453-496b-87d1-cb707879ea64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:21:28 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-13e0adff-f91f-44ed-b9c1-ad6b57cc76b2 tempest-AttachVolumeTestJSON-1797013884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6464a6ac-8453-496b-87d1-cb707879ea64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:21:28 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-13e0adff-f91f-44ed-b9c1-ad6b57cc76b2 tempest-AttachVolumeTestJSON-1797013884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3834c3c0-298b-45ee-a068-324e8d7eb957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:21:28 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-13e0adff-f91f-44ed-b9c1-ad6b57cc76b2 tempest-AttachVolumeTestJSON-1797013884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3834c3c0-298b-45ee-a068-324e8d7eb957) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '23be684f-34c0-4ce2-9e13-1be7eac89e5a', 'volume_name': 'volume-23be684f-34c0-4ce2-9e13-1be7eac89e5a', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:21:28 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-13e0adff-f91f-44ed-b9c1-ad6b57cc76b2 tempest-AttachVolumeTestJSON-1797013884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70605926-9006-4963-9da8-15538e123ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:21:28 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-13e0adff-f91f-44ed-b9c1-ad6b57cc76b2 tempest-AttachVolumeTestJSON-1797013884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70605926-9006-4963-9da8-15538e123ad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:21:28 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-13e0adff-f91f-44ed-b9c1-ad6b57cc76b2 tempest-AttachVolumeTestJSON-1797013884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acaffa5e-0a4f-4d08-9a7b-6b00b7dfddce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:21:28 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-13e0adff-f91f-44ed-b9c1-ad6b57cc76b2 tempest-AttachVolumeTestJSON-1797013884 None] Volume 23be684f-34c0-4ce2-9e13-1be7eac89e5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-23be684f-34c0-4ce2-9e13-1be7eac89e5a', 'volume_size': 1} Sep 15 16:21:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-13e0adff-f91f-44ed-b9c1-ad6b57cc76b2 tempest-AttachVolumeTestJSON-1797013884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:21:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-13e0adff-f91f-44ed-b9c1-ad6b57cc76b2 tempest-AttachVolumeTestJSON-1797013884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:21:28 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-13e0adff-f91f-44ed-b9c1-ad6b57cc76b2 tempest-AttachVolumeTestJSON-1797013884 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:21:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1542364450',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=23be684f-34c0-4ce2-9e13-1be7eac89e5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4074182297cb4184b4a6b5d1aae1cc44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:21:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:21:28Z,use_quota=True,user_id='6e8071e77b4a42e8a3e07a9b3a4737f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:21:28 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-13e0adff-f91f-44ed-b9c1-ad6b57cc76b2 tempest-AttachVolumeTestJSON-1797013884 None] Creating volume 23be684f-34c0-4ce2-9e13-1be7eac89e5a {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:21:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-13e0adff-f91f-44ed-b9c1-ad6b57cc76b2 tempest-AttachVolumeTestJSON-1797013884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:21:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-13e0adff-f91f-44ed-b9c1-ad6b57cc76b2 tempest-AttachVolumeTestJSON-1797013884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:21:28 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-13e0adff-f91f-44ed-b9c1-ad6b57cc76b2 tempest-AttachVolumeTestJSON-1797013884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:21:28 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-13e0adff-f91f-44ed-b9c1-ad6b57cc76b2 tempest-AttachVolumeTestJSON-1797013884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:21:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-13e0adff-f91f-44ed-b9c1-ad6b57cc76b2 tempest-AttachVolumeTestJSON-1797013884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:21:28 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-13e0adff-f91f-44ed-b9c1-ad6b57cc76b2 tempest-AttachVolumeTestJSON-1797013884 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:21:28 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-13e0adff-f91f-44ed-b9c1-ad6b57cc76b2 tempest-AttachVolumeTestJSON-1797013884 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:21:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-13e0adff-f91f-44ed-b9c1-ad6b57cc76b2 tempest-AttachVolumeTestJSON-1797013884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-23be684f-34c0-4ce2-9e13-1be7eac89e5a 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:21:28 devstack sudo[92270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-23be684f-34c0-4ce2-9e13-1be7eac89e5a 1073741824 Sep 15 16:21:28 devstack sudo[92270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:21:28 devstack sudo[92270]: pam_unix(sudo:session): session closed for user root Sep 15 16:21:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-13e0adff-f91f-44ed-b9c1-ad6b57cc76b2 tempest-AttachVolumeTestJSON-1797013884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-23be684f-34c0-4ce2-9e13-1be7eac89e5a 1073741824" returned: 0 in 0.542s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:21:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-13e0adff-f91f-44ed-b9c1-ad6b57cc76b2 tempest-AttachVolumeTestJSON-1797013884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-23be684f-34c0-4ce2-9e13-1be7eac89e5a {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:21:28 devstack sudo[92276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-23be684f-34c0-4ce2-9e13-1be7eac89e5a Sep 15 16:21:28 devstack sudo[92276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:21:29 devstack sudo[92276]: pam_unix(sudo:session): session closed for user root Sep 15 16:21:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-13e0adff-f91f-44ed-b9c1-ad6b57cc76b2 tempest-AttachVolumeTestJSON-1797013884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-23be684f-34c0-4ce2-9e13-1be7eac89e5a" returned: 0 in 0.287s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:21:29 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-13e0adff-f91f-44ed-b9c1-ad6b57cc76b2 tempest-AttachVolumeTestJSON-1797013884 None] <== create_volume: return (894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:21:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-13e0adff-f91f-44ed-b9c1-ad6b57cc76b2 tempest-AttachVolumeTestJSON-1797013884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:21:29 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-13e0adff-f91f-44ed-b9c1-ad6b57cc76b2 tempest-AttachVolumeTestJSON-1797013884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (acaffa5e-0a4f-4d08-9a7b-6b00b7dfddce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-23be684f-34c0-4ce2-9e13-1be7eac89e5a', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:21:29 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-13e0adff-f91f-44ed-b9c1-ad6b57cc76b2 tempest-AttachVolumeTestJSON-1797013884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5fafa4c-18e2-48bb-bf31-62fe2ffaafec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:21:29 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-13e0adff-f91f-44ed-b9c1-ad6b57cc76b2 tempest-AttachVolumeTestJSON-1797013884 None] Volume volume-23be684f-34c0-4ce2-9e13-1be7eac89e5a (23be684f-34c0-4ce2-9e13-1be7eac89e5a): created successfully Sep 15 16:21:29 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-13e0adff-f91f-44ed-b9c1-ad6b57cc76b2 tempest-AttachVolumeTestJSON-1797013884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5fafa4c-18e2-48bb-bf31-62fe2ffaafec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:21:29 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-13e0adff-f91f-44ed-b9c1-ad6b57cc76b2 tempest-AttachVolumeTestJSON-1797013884 None] Flow 'volume_create_manager' (e820a993-d71e-4d3e-a53e-51d229dff87c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:21:29 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-13e0adff-f91f-44ed-b9c1-ad6b57cc76b2 tempest-AttachVolumeTestJSON-1797013884 None] Created volume successfully. Sep 15 16:21:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-948b6574-0810-470e-9aee-3b758a9531dc req-9ad718f4-3dcf-43d0-841e-16d5222e6332 tempest-AttachVolumeTestJSON-1797013884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:21:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-948b6574-0810-470e-9aee-3b758a9531dc req-9ad718f4-3dcf-43d0-841e-16d5222e6332 tempest-AttachVolumeTestJSON-1797013884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:21:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-948b6574-0810-470e-9aee-3b758a9531dc req-9ad718f4-3dcf-43d0-841e-16d5222e6332 tempest-AttachVolumeTestJSON-1797013884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:21:31 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-948b6574-0810-470e-9aee-3b758a9531dc req-9ad718f4-3dcf-43d0-841e-16d5222e6332 tempest-AttachVolumeTestJSON-1797013884 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a', 'name': 'volume-23be684f-34c0-4ce2-9e13-1be7eac89e5a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a2f04996-acbb-45c3-afb8-95a5e5324155', 'enforce_multipath': True} {{(pid=86082) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 15 16:21:31 devstack cinder-volume[86082]: INFO cinder.volume.manager [req-948b6574-0810-470e-9aee-3b758a9531dc req-9ad718f4-3dcf-43d0-841e-16d5222e6332 tempest-AttachVolumeTestJSON-1797013884 None] attachment_update completed successfully. Sep 15 16:21:41 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:SELECT=64,cinder:UPDATE=82,cinder:INSERT=20,cinder:DELETE=4 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 16:21:41 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:SELECT=59,cinder:UPDATE=78,cinder:DELETE=9,cinder:INSERT=14 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 16:21:48 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-ade8ea0f-ac46-4f94-b9a7-bba84b262541 tempest-VolumesListAdminTestJSON-1844514665 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:21:48 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ade8ea0f-ac46-4f94-b9a7-bba84b262541 tempest-VolumesListAdminTestJSON-1844514665 None] Flow 'volume_create_manager' (33ec2404-82b3-4f0e-8b1d-d838d6d91930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:21:48 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ade8ea0f-ac46-4f94-b9a7-bba84b262541 tempest-VolumesListAdminTestJSON-1844514665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ab33255-554d-4669-a416-534070f9a1b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:21:48 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ade8ea0f-ac46-4f94-b9a7-bba84b262541 tempest-VolumesListAdminTestJSON-1844514665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ab33255-554d-4669-a416-534070f9a1b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:21:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-696267918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bf9127c-d06a-4930-bce9-1d0ba75124b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f22652f10c44907888da104c8abf318',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:21:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:21:48Z,use_quota=True,user_id='322a0d8bd84f4d86a464d88c097f0f46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:21:48 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ade8ea0f-ac46-4f94-b9a7-bba84b262541 tempest-VolumesListAdminTestJSON-1844514665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95a9423d-e25f-4dea-8c98-a1a082cd8646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:21:48 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ade8ea0f-ac46-4f94-b9a7-bba84b262541 tempest-VolumesListAdminTestJSON-1844514665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95a9423d-e25f-4dea-8c98-a1a082cd8646) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:21:48 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ade8ea0f-ac46-4f94-b9a7-bba84b262541 tempest-VolumesListAdminTestJSON-1844514665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ac424c4-7a66-4d49-b4a1-48678ca2a85d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:21:48 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ade8ea0f-ac46-4f94-b9a7-bba84b262541 tempest-VolumesListAdminTestJSON-1844514665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ac424c4-7a66-4d49-b4a1-48678ca2a85d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9bf9127c-d06a-4930-bce9-1d0ba75124b7', 'volume_name': 'volume-9bf9127c-d06a-4930-bce9-1d0ba75124b7', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:21:48 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ade8ea0f-ac46-4f94-b9a7-bba84b262541 tempest-VolumesListAdminTestJSON-1844514665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c05d10e1-ba8f-4192-a740-69ffd00be79b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:21:48 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ade8ea0f-ac46-4f94-b9a7-bba84b262541 tempest-VolumesListAdminTestJSON-1844514665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c05d10e1-ba8f-4192-a740-69ffd00be79b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:21:48 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ade8ea0f-ac46-4f94-b9a7-bba84b262541 tempest-VolumesListAdminTestJSON-1844514665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7f9eed4-d820-49d2-8390-0a1ce6f31992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:21:48 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-ade8ea0f-ac46-4f94-b9a7-bba84b262541 tempest-VolumesListAdminTestJSON-1844514665 None] Volume 9bf9127c-d06a-4930-bce9-1d0ba75124b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9bf9127c-d06a-4930-bce9-1d0ba75124b7', 'volume_size': 1} Sep 15 16:21:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-ade8ea0f-ac46-4f94-b9a7-bba84b262541 tempest-VolumesListAdminTestJSON-1844514665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:21:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-ade8ea0f-ac46-4f94-b9a7-bba84b262541 tempest-VolumesListAdminTestJSON-1844514665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:21:48 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-ade8ea0f-ac46-4f94-b9a7-bba84b262541 tempest-VolumesListAdminTestJSON-1844514665 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:21:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-696267918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9bf9127c-d06a-4930-bce9-1d0ba75124b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f22652f10c44907888da104c8abf318',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:21:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:21:48Z,use_quota=True,user_id='322a0d8bd84f4d86a464d88c097f0f46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:21:48 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-ade8ea0f-ac46-4f94-b9a7-bba84b262541 tempest-VolumesListAdminTestJSON-1844514665 None] Creating volume 9bf9127c-d06a-4930-bce9-1d0ba75124b7 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:21:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-ade8ea0f-ac46-4f94-b9a7-bba84b262541 tempest-VolumesListAdminTestJSON-1844514665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:21:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-ade8ea0f-ac46-4f94-b9a7-bba84b262541 tempest-VolumesListAdminTestJSON-1844514665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:21:48 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-ade8ea0f-ac46-4f94-b9a7-bba84b262541 tempest-VolumesListAdminTestJSON-1844514665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:21:48 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-ade8ea0f-ac46-4f94-b9a7-bba84b262541 tempest-VolumesListAdminTestJSON-1844514665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:21:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-ade8ea0f-ac46-4f94-b9a7-bba84b262541 tempest-VolumesListAdminTestJSON-1844514665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:21:48 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-ade8ea0f-ac46-4f94-b9a7-bba84b262541 tempest-VolumesListAdminTestJSON-1844514665 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:21:48 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-ade8ea0f-ac46-4f94-b9a7-bba84b262541 tempest-VolumesListAdminTestJSON-1844514665 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:21:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ade8ea0f-ac46-4f94-b9a7-bba84b262541 tempest-VolumesListAdminTestJSON-1844514665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-9bf9127c-d06a-4930-bce9-1d0ba75124b7 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:21:48 devstack sudo[93278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-9bf9127c-d06a-4930-bce9-1d0ba75124b7 1073741824 Sep 15 16:21:48 devstack sudo[93278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:21:48 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-1befb155-816a-4acb-b238-9b58c5b9d09d tempest-VolumeSnapshotQuotasNegativeTestJSON-1177716203 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:21:48 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1befb155-816a-4acb-b238-9b58c5b9d09d tempest-VolumeSnapshotQuotasNegativeTestJSON-1177716203 None] Flow 'volume_create_manager' (f6ea2279-cf34-46d9-84d8-b56c436404bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:21:48 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1befb155-816a-4acb-b238-9b58c5b9d09d tempest-VolumeSnapshotQuotasNegativeTestJSON-1177716203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85be0c36-8310-4254-9233-ca3999fb1fb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:21:48 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1befb155-816a-4acb-b238-9b58c5b9d09d tempest-VolumeSnapshotQuotasNegativeTestJSON-1177716203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85be0c36-8310-4254-9233-ca3999fb1fb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:21:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-858852611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=025122c0-2af8-4a6b-863c-cbd5089f0913,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b1fec33bacf48a7a57c7c9ee45f4b72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:21:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:21:49Z,use_quota=True,user_id='6b76b2e70f094ed0a3d81d265e87351d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:21:48 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1befb155-816a-4acb-b238-9b58c5b9d09d tempest-VolumeSnapshotQuotasNegativeTestJSON-1177716203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25b09ac5-abac-44a8-9a7a-c95e6c19e542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:21:48 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1befb155-816a-4acb-b238-9b58c5b9d09d tempest-VolumeSnapshotQuotasNegativeTestJSON-1177716203 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (25b09ac5-abac-44a8-9a7a-c95e6c19e542) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:21:48 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1befb155-816a-4acb-b238-9b58c5b9d09d tempest-VolumeSnapshotQuotasNegativeTestJSON-1177716203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e8fff77-0959-4610-896a-12f55e618d05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:21:48 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1befb155-816a-4acb-b238-9b58c5b9d09d tempest-VolumeSnapshotQuotasNegativeTestJSON-1177716203 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e8fff77-0959-4610-896a-12f55e618d05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '025122c0-2af8-4a6b-863c-cbd5089f0913', 'volume_name': 'volume-025122c0-2af8-4a6b-863c-cbd5089f0913', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:21:48 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1befb155-816a-4acb-b238-9b58c5b9d09d tempest-VolumeSnapshotQuotasNegativeTestJSON-1177716203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfc2b25e-9663-44cb-966d-0ba73d9b4310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:21:48 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1befb155-816a-4acb-b238-9b58c5b9d09d tempest-VolumeSnapshotQuotasNegativeTestJSON-1177716203 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bfc2b25e-9663-44cb-966d-0ba73d9b4310) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:21:48 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1befb155-816a-4acb-b238-9b58c5b9d09d tempest-VolumeSnapshotQuotasNegativeTestJSON-1177716203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d628b1d4-cd2b-43d7-ba15-33b651e1d318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:21:48 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-1befb155-816a-4acb-b238-9b58c5b9d09d tempest-VolumeSnapshotQuotasNegativeTestJSON-1177716203 None] Volume 025122c0-2af8-4a6b-863c-cbd5089f0913: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-025122c0-2af8-4a6b-863c-cbd5089f0913', 'volume_size': 1} Sep 15 16:21:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-1befb155-816a-4acb-b238-9b58c5b9d09d tempest-VolumeSnapshotQuotasNegativeTestJSON-1177716203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:21:49 devstack sudo[93278]: pam_unix(sudo:session): session closed for user root Sep 15 16:21:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ade8ea0f-ac46-4f94-b9a7-bba84b262541 tempest-VolumesListAdminTestJSON-1844514665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-9bf9127c-d06a-4930-bce9-1d0ba75124b7 1073741824" returned: 0 in 0.753s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:21:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ade8ea0f-ac46-4f94-b9a7-bba84b262541 tempest-VolumesListAdminTestJSON-1844514665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-9bf9127c-d06a-4930-bce9-1d0ba75124b7 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:21:49 devstack sudo[93299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-9bf9127c-d06a-4930-bce9-1d0ba75124b7 Sep 15 16:21:49 devstack sudo[93299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:21:49 devstack sudo[93299]: pam_unix(sudo:session): session closed for user root Sep 15 16:21:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ade8ea0f-ac46-4f94-b9a7-bba84b262541 tempest-VolumesListAdminTestJSON-1844514665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-9bf9127c-d06a-4930-bce9-1d0ba75124b7" returned: 0 in 0.455s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:21:49 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-ade8ea0f-ac46-4f94-b9a7-bba84b262541 tempest-VolumesListAdminTestJSON-1844514665 None] <== create_volume: return (1260ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:21:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-ade8ea0f-ac46-4f94-b9a7-bba84b262541 tempest-VolumesListAdminTestJSON-1844514665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.262s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:21:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-1befb155-816a-4acb-b238-9b58c5b9d09d tempest-VolumeSnapshotQuotasNegativeTestJSON-1177716203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.970s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:21:49 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-1befb155-816a-4acb-b238-9b58c5b9d09d tempest-VolumeSnapshotQuotasNegativeTestJSON-1177716203 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:21:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-858852611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=025122c0-2af8-4a6b-863c-cbd5089f0913,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b1fec33bacf48a7a57c7c9ee45f4b72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:21:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:21:49Z,use_quota=True,user_id='6b76b2e70f094ed0a3d81d265e87351d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:21:49 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-1befb155-816a-4acb-b238-9b58c5b9d09d tempest-VolumeSnapshotQuotasNegativeTestJSON-1177716203 None] Creating volume 025122c0-2af8-4a6b-863c-cbd5089f0913 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:21:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-1befb155-816a-4acb-b238-9b58c5b9d09d tempest-VolumeSnapshotQuotasNegativeTestJSON-1177716203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:21:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-1befb155-816a-4acb-b238-9b58c5b9d09d tempest-VolumeSnapshotQuotasNegativeTestJSON-1177716203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:21:49 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-1befb155-816a-4acb-b238-9b58c5b9d09d tempest-VolumeSnapshotQuotasNegativeTestJSON-1177716203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:21:49 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-1befb155-816a-4acb-b238-9b58c5b9d09d tempest-VolumeSnapshotQuotasNegativeTestJSON-1177716203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:21:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-1befb155-816a-4acb-b238-9b58c5b9d09d tempest-VolumeSnapshotQuotasNegativeTestJSON-1177716203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:21:49 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-1befb155-816a-4acb-b238-9b58c5b9d09d tempest-VolumeSnapshotQuotasNegativeTestJSON-1177716203 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:21:49 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-1befb155-816a-4acb-b238-9b58c5b9d09d tempest-VolumeSnapshotQuotasNegativeTestJSON-1177716203 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:21:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-1befb155-816a-4acb-b238-9b58c5b9d09d tempest-VolumeSnapshotQuotasNegativeTestJSON-1177716203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-025122c0-2af8-4a6b-863c-cbd5089f0913 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:21:49 devstack sudo[93302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-025122c0-2af8-4a6b-863c-cbd5089f0913 1073741824 Sep 15 16:21:49 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ade8ea0f-ac46-4f94-b9a7-bba84b262541 tempest-VolumesListAdminTestJSON-1844514665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7f9eed4-d820-49d2-8390-0a1ce6f31992) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9bf9127c-d06a-4930-bce9-1d0ba75124b7', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:21:49 devstack sudo[93302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:21:49 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ade8ea0f-ac46-4f94-b9a7-bba84b262541 tempest-VolumesListAdminTestJSON-1844514665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e18e612-ba92-4a3b-9132-4094ae8eba7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:21:49 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-ade8ea0f-ac46-4f94-b9a7-bba84b262541 tempest-VolumesListAdminTestJSON-1844514665 None] Volume volume-9bf9127c-d06a-4930-bce9-1d0ba75124b7 (9bf9127c-d06a-4930-bce9-1d0ba75124b7): created successfully Sep 15 16:21:49 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ade8ea0f-ac46-4f94-b9a7-bba84b262541 tempest-VolumesListAdminTestJSON-1844514665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e18e612-ba92-4a3b-9132-4094ae8eba7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:21:49 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ade8ea0f-ac46-4f94-b9a7-bba84b262541 tempest-VolumesListAdminTestJSON-1844514665 None] Flow 'volume_create_manager' (33ec2404-82b3-4f0e-8b1d-d838d6d91930) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:21:49 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-ade8ea0f-ac46-4f94-b9a7-bba84b262541 tempest-VolumesListAdminTestJSON-1844514665 None] Created volume successfully. Sep 15 16:21:50 devstack sudo[93302]: pam_unix(sudo:session): session closed for user root Sep 15 16:21:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-1befb155-816a-4acb-b238-9b58c5b9d09d tempest-VolumeSnapshotQuotasNegativeTestJSON-1177716203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-025122c0-2af8-4a6b-863c-cbd5089f0913 1073741824" returned: 0 in 0.624s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:21:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-1befb155-816a-4acb-b238-9b58c5b9d09d tempest-VolumeSnapshotQuotasNegativeTestJSON-1177716203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-025122c0-2af8-4a6b-863c-cbd5089f0913 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:21:50 devstack sudo[93307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-025122c0-2af8-4a6b-863c-cbd5089f0913 Sep 15 16:21:50 devstack sudo[93307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:21:50 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-f87cbaac-4aa1-4483-88bc-671d2eb4f4de tempest-VolumesListAdminTestJSON-1844514665 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:21:50 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f87cbaac-4aa1-4483-88bc-671d2eb4f4de tempest-VolumesListAdminTestJSON-1844514665 None] Flow 'volume_create_manager' (e9e2bc86-9e4e-4682-8257-4adf77cce8c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:21:50 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f87cbaac-4aa1-4483-88bc-671d2eb4f4de tempest-VolumesListAdminTestJSON-1844514665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (160c1c18-af80-4f65-aecc-d180c96c037e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:21:50 devstack sudo[93307]: pam_unix(sudo:session): session closed for user root Sep 15 16:21:50 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f87cbaac-4aa1-4483-88bc-671d2eb4f4de tempest-VolumesListAdminTestJSON-1844514665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (160c1c18-af80-4f65-aecc-d180c96c037e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:21:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1653783547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66e7852d-b6af-414a-b257-b9e0f5127be5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f22652f10c44907888da104c8abf318',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:21:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:21:51Z,use_quota=True,user_id='322a0d8bd84f4d86a464d88c097f0f46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:21:50 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f87cbaac-4aa1-4483-88bc-671d2eb4f4de tempest-VolumesListAdminTestJSON-1844514665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d8226e4-aa5f-4514-b79c-d6b8d2b34e6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:21:50 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f87cbaac-4aa1-4483-88bc-671d2eb4f4de tempest-VolumesListAdminTestJSON-1844514665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d8226e4-aa5f-4514-b79c-d6b8d2b34e6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:21:50 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f87cbaac-4aa1-4483-88bc-671d2eb4f4de tempest-VolumesListAdminTestJSON-1844514665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9ac63f3-ec80-4d26-94bf-a814f65283ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:21:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f87cbaac-4aa1-4483-88bc-671d2eb4f4de tempest-VolumesListAdminTestJSON-1844514665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9ac63f3-ec80-4d26-94bf-a814f65283ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66e7852d-b6af-414a-b257-b9e0f5127be5', 'volume_name': 'volume-66e7852d-b6af-414a-b257-b9e0f5127be5', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:21:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f87cbaac-4aa1-4483-88bc-671d2eb4f4de tempest-VolumesListAdminTestJSON-1844514665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (640adca0-32f8-4ef0-9402-43a6dedbfe93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:21:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f87cbaac-4aa1-4483-88bc-671d2eb4f4de tempest-VolumesListAdminTestJSON-1844514665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (640adca0-32f8-4ef0-9402-43a6dedbfe93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:21:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f87cbaac-4aa1-4483-88bc-671d2eb4f4de tempest-VolumesListAdminTestJSON-1844514665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (538bdee0-ee8b-4c35-b90d-40c1968d2b23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:21:51 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-f87cbaac-4aa1-4483-88bc-671d2eb4f4de tempest-VolumesListAdminTestJSON-1844514665 None] Volume 66e7852d-b6af-414a-b257-b9e0f5127be5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66e7852d-b6af-414a-b257-b9e0f5127be5', 'volume_size': 1} Sep 15 16:21:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f87cbaac-4aa1-4483-88bc-671d2eb4f4de tempest-VolumesListAdminTestJSON-1844514665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:21:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-1befb155-816a-4acb-b238-9b58c5b9d09d tempest-VolumeSnapshotQuotasNegativeTestJSON-1177716203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-025122c0-2af8-4a6b-863c-cbd5089f0913" returned: 0 in 0.503s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:21:51 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-1befb155-816a-4acb-b238-9b58c5b9d09d tempest-VolumeSnapshotQuotasNegativeTestJSON-1177716203 None] <== create_volume: return (1195ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:21:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-1befb155-816a-4acb-b238-9b58c5b9d09d tempest-VolumeSnapshotQuotasNegativeTestJSON-1177716203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.199s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:21:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f87cbaac-4aa1-4483-88bc-671d2eb4f4de tempest-VolumesListAdminTestJSON-1844514665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.009s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:21:51 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-f87cbaac-4aa1-4483-88bc-671d2eb4f4de tempest-VolumesListAdminTestJSON-1844514665 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:21:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1653783547',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66e7852d-b6af-414a-b257-b9e0f5127be5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f22652f10c44907888da104c8abf318',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:21:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:21:51Z,use_quota=True,user_id='322a0d8bd84f4d86a464d88c097f0f46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:21:51 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-f87cbaac-4aa1-4483-88bc-671d2eb4f4de tempest-VolumesListAdminTestJSON-1844514665 None] Creating volume 66e7852d-b6af-414a-b257-b9e0f5127be5 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:21:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f87cbaac-4aa1-4483-88bc-671d2eb4f4de tempest-VolumesListAdminTestJSON-1844514665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:21:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f87cbaac-4aa1-4483-88bc-671d2eb4f4de tempest-VolumesListAdminTestJSON-1844514665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:21:51 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-f87cbaac-4aa1-4483-88bc-671d2eb4f4de tempest-VolumesListAdminTestJSON-1844514665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:21:51 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-f87cbaac-4aa1-4483-88bc-671d2eb4f4de tempest-VolumesListAdminTestJSON-1844514665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:21:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f87cbaac-4aa1-4483-88bc-671d2eb4f4de tempest-VolumesListAdminTestJSON-1844514665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:21:51 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-f87cbaac-4aa1-4483-88bc-671d2eb4f4de tempest-VolumesListAdminTestJSON-1844514665 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:21:51 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-f87cbaac-4aa1-4483-88bc-671d2eb4f4de tempest-VolumesListAdminTestJSON-1844514665 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:21:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f87cbaac-4aa1-4483-88bc-671d2eb4f4de tempest-VolumesListAdminTestJSON-1844514665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-66e7852d-b6af-414a-b257-b9e0f5127be5 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:21:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1befb155-816a-4acb-b238-9b58c5b9d09d tempest-VolumeSnapshotQuotasNegativeTestJSON-1177716203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d628b1d4-cd2b-43d7-ba15-33b651e1d318) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-025122c0-2af8-4a6b-863c-cbd5089f0913', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:21:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1befb155-816a-4acb-b238-9b58c5b9d09d tempest-VolumeSnapshotQuotasNegativeTestJSON-1177716203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42fbefe5-f65d-4386-b27e-6bbcdc4c3d4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:21:51 devstack sudo[93310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-66e7852d-b6af-414a-b257-b9e0f5127be5 1073741824 Sep 15 16:21:51 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-1befb155-816a-4acb-b238-9b58c5b9d09d tempest-VolumeSnapshotQuotasNegativeTestJSON-1177716203 None] Volume volume-025122c0-2af8-4a6b-863c-cbd5089f0913 (025122c0-2af8-4a6b-863c-cbd5089f0913): created successfully Sep 15 16:21:51 devstack sudo[93310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:21:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1befb155-816a-4acb-b238-9b58c5b9d09d tempest-VolumeSnapshotQuotasNegativeTestJSON-1177716203 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42fbefe5-f65d-4386-b27e-6bbcdc4c3d4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:21:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1befb155-816a-4acb-b238-9b58c5b9d09d tempest-VolumeSnapshotQuotasNegativeTestJSON-1177716203 None] Flow 'volume_create_manager' (f6ea2279-cf34-46d9-84d8-b56c436404bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:21:51 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-1befb155-816a-4acb-b238-9b58c5b9d09d tempest-VolumeSnapshotQuotasNegativeTestJSON-1177716203 None] Created volume successfully. Sep 15 16:21:51 devstack sudo[93310]: pam_unix(sudo:session): session closed for user root Sep 15 16:21:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f87cbaac-4aa1-4483-88bc-671d2eb4f4de tempest-VolumesListAdminTestJSON-1844514665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-66e7852d-b6af-414a-b257-b9e0f5127be5 1073741824" returned: 0 in 0.647s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:21:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f87cbaac-4aa1-4483-88bc-671d2eb4f4de tempest-VolumesListAdminTestJSON-1844514665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-66e7852d-b6af-414a-b257-b9e0f5127be5 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:21:51 devstack sudo[93317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-66e7852d-b6af-414a-b257-b9e0f5127be5 Sep 15 16:21:51 devstack sudo[93317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:21:52 devstack sudo[93317]: pam_unix(sudo:session): session closed for user root Sep 15 16:21:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f87cbaac-4aa1-4483-88bc-671d2eb4f4de tempest-VolumesListAdminTestJSON-1844514665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-66e7852d-b6af-414a-b257-b9e0f5127be5" returned: 0 in 0.375s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:21:52 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-f87cbaac-4aa1-4483-88bc-671d2eb4f4de tempest-VolumesListAdminTestJSON-1844514665 None] <== create_volume: return (1073ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:21:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f87cbaac-4aa1-4483-88bc-671d2eb4f4de tempest-VolumesListAdminTestJSON-1844514665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.082s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:21:52 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f87cbaac-4aa1-4483-88bc-671d2eb4f4de tempest-VolumesListAdminTestJSON-1844514665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (538bdee0-ee8b-4c35-b90d-40c1968d2b23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66e7852d-b6af-414a-b257-b9e0f5127be5', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:21:52 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f87cbaac-4aa1-4483-88bc-671d2eb4f4de tempest-VolumesListAdminTestJSON-1844514665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eea17e9f-4f37-4009-8f00-15deb83532cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:21:52 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-f87cbaac-4aa1-4483-88bc-671d2eb4f4de tempest-VolumesListAdminTestJSON-1844514665 None] Volume volume-66e7852d-b6af-414a-b257-b9e0f5127be5 (66e7852d-b6af-414a-b257-b9e0f5127be5): created successfully Sep 15 16:21:52 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f87cbaac-4aa1-4483-88bc-671d2eb4f4de tempest-VolumesListAdminTestJSON-1844514665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eea17e9f-4f37-4009-8f00-15deb83532cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:21:52 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f87cbaac-4aa1-4483-88bc-671d2eb4f4de tempest-VolumesListAdminTestJSON-1844514665 None] Flow 'volume_create_manager' (e9e2bc86-9e4e-4682-8257-4adf77cce8c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:21:52 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-f87cbaac-4aa1-4483-88bc-671d2eb4f4de tempest-VolumesListAdminTestJSON-1844514665 None] Created volume successfully. Sep 15 16:21:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-a0b2ecb2-42a3-400e-91ee-07b834be8c15 tempest-VolumeSnapshotQuotasNegativeTestJSON-1177716203 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:21:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-a0b2ecb2-42a3-400e-91ee-07b834be8c15 tempest-VolumeSnapshotQuotasNegativeTestJSON-1177716203 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:21:52 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-a0b2ecb2-42a3-400e-91ee-07b834be8c15 tempest-VolumeSnapshotQuotasNegativeTestJSON-1177716203 None] Creating offline snapshot 521ac057-d9c6-4ce4-8ce5-eb7c6f0d973d of volume 025122c0-2af8-4a6b-863c-cbd5089f0913 {{(pid=86082) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 15 16:21:52 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[57e4c9cc-961a-4bf8-9aaf-b0c0fc4beac1]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:21:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a0b2ecb2-42a3-400e-91ee-07b834be8c15 tempest-VolumeSnapshotQuotasNegativeTestJSON-1177716203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-025122c0-2af8-4a6b-863c-cbd5089f0913 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:21:53 devstack sudo[93370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-025122c0-2af8-4a6b-863c-cbd5089f0913 Sep 15 16:21:53 devstack sudo[93370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:21:53 devstack sudo[93370]: pam_unix(sudo:session): session closed for user root Sep 15 16:21:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a0b2ecb2-42a3-400e-91ee-07b834be8c15 tempest-VolumeSnapshotQuotasNegativeTestJSON-1177716203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-025122c0-2af8-4a6b-863c-cbd5089f0913" returned: 0 in 0.910s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:21:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a0b2ecb2-42a3-400e-91ee-07b834be8c15 tempest-VolumeSnapshotQuotasNegativeTestJSON-1177716203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-025122c0-2af8-4a6b-863c-cbd5089f0913,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-025122c0-2af8-4a6b-863c-cbd5089f0913.521ac057-d9c6-4ce4-8ce5-eb7c6f0d973d 1G {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:21:53 devstack sudo[93397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-025122c0-2af8-4a6b-863c-cbd5089f0913,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-025122c0-2af8-4a6b-863c-cbd5089f0913.521ac057-d9c6-4ce4-8ce5-eb7c6f0d973d 1G Sep 15 16:21:53 devstack sudo[93397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:21:54 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-261b5347-5f03-497c-8062-60d250224455 tempest-VolumesListAdminTestJSON-1844514665 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:21:54 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-261b5347-5f03-497c-8062-60d250224455 tempest-VolumesListAdminTestJSON-1844514665 None] Flow 'volume_create_manager' (ad6d4efe-b9bb-4717-8b5d-879686a48a2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:21:54 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-261b5347-5f03-497c-8062-60d250224455 tempest-VolumesListAdminTestJSON-1844514665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fea0b89-4a30-422a-9848-1cd3dc192ded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:21:54 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-261b5347-5f03-497c-8062-60d250224455 tempest-VolumesListAdminTestJSON-1844514665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fea0b89-4a30-422a-9848-1cd3dc192ded) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:21:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1703892115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=183b3742-be89-4a75-bdc5-3bf18e30efe5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f22652f10c44907888da104c8abf318',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:21:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:21:54Z,use_quota=True,user_id='322a0d8bd84f4d86a464d88c097f0f46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:21:54 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-261b5347-5f03-497c-8062-60d250224455 tempest-VolumesListAdminTestJSON-1844514665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4bf0c67-073b-4be4-a9c5-2fd52b502cfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:21:54 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-261b5347-5f03-497c-8062-60d250224455 tempest-VolumesListAdminTestJSON-1844514665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4bf0c67-073b-4be4-a9c5-2fd52b502cfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:21:54 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-261b5347-5f03-497c-8062-60d250224455 tempest-VolumesListAdminTestJSON-1844514665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (021f0b1d-0f31-4b9d-9464-3a53a959a529) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:21:54 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-261b5347-5f03-497c-8062-60d250224455 tempest-VolumesListAdminTestJSON-1844514665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (021f0b1d-0f31-4b9d-9464-3a53a959a529) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '183b3742-be89-4a75-bdc5-3bf18e30efe5', 'volume_name': 'volume-183b3742-be89-4a75-bdc5-3bf18e30efe5', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:21:54 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-261b5347-5f03-497c-8062-60d250224455 tempest-VolumesListAdminTestJSON-1844514665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (709c7695-613b-4b69-8411-8eb756450301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:21:54 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-261b5347-5f03-497c-8062-60d250224455 tempest-VolumesListAdminTestJSON-1844514665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (709c7695-613b-4b69-8411-8eb756450301) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:21:54 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-261b5347-5f03-497c-8062-60d250224455 tempest-VolumesListAdminTestJSON-1844514665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7501f8e-6bc3-4f29-bb1e-2d78cce964e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:21:54 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-261b5347-5f03-497c-8062-60d250224455 tempest-VolumesListAdminTestJSON-1844514665 None] Volume 183b3742-be89-4a75-bdc5-3bf18e30efe5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-183b3742-be89-4a75-bdc5-3bf18e30efe5', 'volume_size': 1} Sep 15 16:21:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-261b5347-5f03-497c-8062-60d250224455 tempest-VolumesListAdminTestJSON-1844514665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:21:54 devstack sudo[93397]: pam_unix(sudo:session): session closed for user root Sep 15 16:21:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a0b2ecb2-42a3-400e-91ee-07b834be8c15 tempest-VolumeSnapshotQuotasNegativeTestJSON-1177716203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-025122c0-2af8-4a6b-863c-cbd5089f0913,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-025122c0-2af8-4a6b-863c-cbd5089f0913.521ac057-d9c6-4ce4-8ce5-eb7c6f0d973d 1G" returned: 0 in 0.821s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:21:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a0b2ecb2-42a3-400e-91ee-07b834be8c15 tempest-VolumeSnapshotQuotasNegativeTestJSON-1177716203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-025122c0-2af8-4a6b-863c-cbd5089f0913 -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-025122c0-2af8-4a6b-863c-cbd5089f0913.521ac057-d9c6-4ce4-8ce5-eb7c6f0d973d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:21:54 devstack sudo[93407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-025122c0-2af8-4a6b-863c-cbd5089f0913 -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-025122c0-2af8-4a6b-863c-cbd5089f0913.521ac057-d9c6-4ce4-8ce5-eb7c6f0d973d Sep 15 16:21:54 devstack sudo[93407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:21:54 devstack sudo[93407]: pam_unix(sudo:session): session closed for user root Sep 15 16:21:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a0b2ecb2-42a3-400e-91ee-07b834be8c15 tempest-VolumeSnapshotQuotasNegativeTestJSON-1177716203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-025122c0-2af8-4a6b-863c-cbd5089f0913 -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-025122c0-2af8-4a6b-863c-cbd5089f0913.521ac057-d9c6-4ce4-8ce5-eb7c6f0d973d" returned: 0 in 0.382s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:21:54 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-a0b2ecb2-42a3-400e-91ee-07b834be8c15 tempest-VolumeSnapshotQuotasNegativeTestJSON-1177716203 None] /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-025122c0-2af8-4a6b-863c-cbd5089f0913.521ac057-d9c6-4ce4-8ce5-eb7c6f0d973d is being set with open permissions: ugo+rw Sep 15 16:21:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a0b2ecb2-42a3-400e-91ee-07b834be8c15 tempest-VolumeSnapshotQuotasNegativeTestJSON-1177716203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-025122c0-2af8-4a6b-863c-cbd5089f0913.521ac057-d9c6-4ce4-8ce5-eb7c6f0d973d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:21:54 devstack sudo[93412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-025122c0-2af8-4a6b-863c-cbd5089f0913.521ac057-d9c6-4ce4-8ce5-eb7c6f0d973d Sep 15 16:21:54 devstack sudo[93412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:21:55 devstack sudo[93412]: pam_unix(sudo:session): session closed for user root Sep 15 16:21:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a0b2ecb2-42a3-400e-91ee-07b834be8c15 tempest-VolumeSnapshotQuotasNegativeTestJSON-1177716203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-025122c0-2af8-4a6b-863c-cbd5089f0913.521ac057-d9c6-4ce4-8ce5-eb7c6f0d973d" returned: 0 in 0.289s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:21:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a0b2ecb2-42a3-400e-91ee-07b834be8c15 tempest-VolumeSnapshotQuotasNegativeTestJSON-1177716203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-025122c0-2af8-4a6b-863c-cbd5089f0913.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:21:55 devstack sudo[93415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-025122c0-2af8-4a6b-863c-cbd5089f0913.info Sep 15 16:21:55 devstack sudo[93415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:21:55 devstack sudo[93415]: pam_unix(sudo:session): session closed for user root Sep 15 16:21:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a0b2ecb2-42a3-400e-91ee-07b834be8c15 tempest-VolumeSnapshotQuotasNegativeTestJSON-1177716203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-025122c0-2af8-4a6b-863c-cbd5089f0913.info" returned: 0 in 0.286s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:21:55 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-a0b2ecb2-42a3-400e-91ee-07b834be8c15 tempest-VolumeSnapshotQuotasNegativeTestJSON-1177716203 None] /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-025122c0-2af8-4a6b-863c-cbd5089f0913.info is being set with open permissions: ugo+rw Sep 15 16:21:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a0b2ecb2-42a3-400e-91ee-07b834be8c15 tempest-VolumeSnapshotQuotasNegativeTestJSON-1177716203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-025122c0-2af8-4a6b-863c-cbd5089f0913.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:21:55 devstack sudo[93418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-025122c0-2af8-4a6b-863c-cbd5089f0913.info Sep 15 16:21:55 devstack sudo[93418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:21:55 devstack sudo[93418]: pam_unix(sudo:session): session closed for user root Sep 15 16:21:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a0b2ecb2-42a3-400e-91ee-07b834be8c15 tempest-VolumeSnapshotQuotasNegativeTestJSON-1177716203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-025122c0-2af8-4a6b-863c-cbd5089f0913.info" returned: 0 in 0.281s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:21:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-a0b2ecb2-42a3-400e-91ee-07b834be8c15 tempest-VolumeSnapshotQuotasNegativeTestJSON-1177716203 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.145s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:21:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-261b5347-5f03-497c-8062-60d250224455 tempest-VolumesListAdminTestJSON-1844514665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.386s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:21:55 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-261b5347-5f03-497c-8062-60d250224455 tempest-VolumesListAdminTestJSON-1844514665 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:21:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1703892115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=183b3742-be89-4a75-bdc5-3bf18e30efe5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6f22652f10c44907888da104c8abf318',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:21:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:21:54Z,use_quota=True,user_id='322a0d8bd84f4d86a464d88c097f0f46',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:21:55 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-261b5347-5f03-497c-8062-60d250224455 tempest-VolumesListAdminTestJSON-1844514665 None] Creating volume 183b3742-be89-4a75-bdc5-3bf18e30efe5 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:21:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-261b5347-5f03-497c-8062-60d250224455 tempest-VolumesListAdminTestJSON-1844514665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:21:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-261b5347-5f03-497c-8062-60d250224455 tempest-VolumesListAdminTestJSON-1844514665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:21:55 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-261b5347-5f03-497c-8062-60d250224455 tempest-VolumesListAdminTestJSON-1844514665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:21:55 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-261b5347-5f03-497c-8062-60d250224455 tempest-VolumesListAdminTestJSON-1844514665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:21:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-261b5347-5f03-497c-8062-60d250224455 tempest-VolumesListAdminTestJSON-1844514665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:21:55 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-261b5347-5f03-497c-8062-60d250224455 tempest-VolumesListAdminTestJSON-1844514665 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:21:55 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-261b5347-5f03-497c-8062-60d250224455 tempest-VolumesListAdminTestJSON-1844514665 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:21:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-261b5347-5f03-497c-8062-60d250224455 tempest-VolumesListAdminTestJSON-1844514665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-183b3742-be89-4a75-bdc5-3bf18e30efe5 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:21:55 devstack sudo[93422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-183b3742-be89-4a75-bdc5-3bf18e30efe5 1073741824 Sep 15 16:21:55 devstack sudo[93422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:21:55 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-a0b2ecb2-42a3-400e-91ee-07b834be8c15 tempest-VolumeSnapshotQuotasNegativeTestJSON-1177716203 None] Create snapshot completed successfully Sep 15 16:21:56 devstack sudo[93422]: pam_unix(sudo:session): session closed for user root Sep 15 16:21:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-261b5347-5f03-497c-8062-60d250224455 tempest-VolumesListAdminTestJSON-1844514665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-183b3742-be89-4a75-bdc5-3bf18e30efe5 1073741824" returned: 0 in 0.572s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:21:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-261b5347-5f03-497c-8062-60d250224455 tempest-VolumesListAdminTestJSON-1844514665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-183b3742-be89-4a75-bdc5-3bf18e30efe5 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:21:56 devstack sudo[93428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-183b3742-be89-4a75-bdc5-3bf18e30efe5 Sep 15 16:21:56 devstack sudo[93428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:21:56 devstack sudo[93428]: pam_unix(sudo:session): session closed for user root Sep 15 16:21:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-261b5347-5f03-497c-8062-60d250224455 tempest-VolumesListAdminTestJSON-1844514665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-183b3742-be89-4a75-bdc5-3bf18e30efe5" returned: 0 in 0.317s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:21:56 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-261b5347-5f03-497c-8062-60d250224455 tempest-VolumesListAdminTestJSON-1844514665 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:21:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-261b5347-5f03-497c-8062-60d250224455 tempest-VolumesListAdminTestJSON-1844514665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:21:56 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-261b5347-5f03-497c-8062-60d250224455 tempest-VolumesListAdminTestJSON-1844514665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7501f8e-6bc3-4f29-bb1e-2d78cce964e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-183b3742-be89-4a75-bdc5-3bf18e30efe5', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:21:56 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-261b5347-5f03-497c-8062-60d250224455 tempest-VolumesListAdminTestJSON-1844514665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb2e7998-381b-49ab-9d50-9c8121810b08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:21:56 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-261b5347-5f03-497c-8062-60d250224455 tempest-VolumesListAdminTestJSON-1844514665 None] Volume volume-183b3742-be89-4a75-bdc5-3bf18e30efe5 (183b3742-be89-4a75-bdc5-3bf18e30efe5): created successfully Sep 15 16:21:56 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-261b5347-5f03-497c-8062-60d250224455 tempest-VolumesListAdminTestJSON-1844514665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb2e7998-381b-49ab-9d50-9c8121810b08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:21:56 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-261b5347-5f03-497c-8062-60d250224455 tempest-VolumesListAdminTestJSON-1844514665 None] Flow 'volume_create_manager' (ad6d4efe-b9bb-4717-8b5d-879686a48a2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:21:56 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-261b5347-5f03-497c-8062-60d250224455 tempest-VolumesListAdminTestJSON-1844514665 None] Created volume successfully. Sep 15 16:21:57 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-9434286f-b3e6-439c-909d-497401a86eae tempest-VolumeSnapshotQuotasNegativeTestJSON-1177716203 None] Acquiring lock "cinder-521ac057-d9c6-4ce4-8ce5-eb7c6f0d973d-delete_snapshot" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:21:57 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-9434286f-b3e6-439c-909d-497401a86eae tempest-VolumeSnapshotQuotasNegativeTestJSON-1177716203 None] Lock "cinder-521ac057-d9c6-4ce4-8ce5-eb7c6f0d973d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:21:57 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-9434286f-b3e6-439c-909d-497401a86eae tempest-VolumeSnapshotQuotasNegativeTestJSON-1177716203 None] Acquiring lock "cinder-quobyte-025122c0-2af8-4a6b-863c-cbd5089f0913" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:21:57 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-9434286f-b3e6-439c-909d-497401a86eae tempest-VolumeSnapshotQuotasNegativeTestJSON-1177716203 None] Lock "cinder-quobyte-025122c0-2af8-4a6b-863c-cbd5089f0913" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:21:57 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-9434286f-b3e6-439c-909d-497401a86eae tempest-VolumeSnapshotQuotasNegativeTestJSON-1177716203 None] Acquiring lock "cinder-quobyte-521ac057-d9c6-4ce4-8ce5-eb7c6f0d973d" by "_delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:21:57 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-9434286f-b3e6-439c-909d-497401a86eae tempest-VolumeSnapshotQuotasNegativeTestJSON-1177716203 None] Lock "cinder-quobyte-521ac057-d9c6-4ce4-8ce5-eb7c6f0d973d" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:21:57 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-9434286f-b3e6-439c-909d-497401a86eae tempest-VolumeSnapshotQuotasNegativeTestJSON-1177716203 None] Deleting offline snapshot 521ac057-d9c6-4ce4-8ce5-eb7c6f0d973d of volume 025122c0-2af8-4a6b-863c-cbd5089f0913 {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 15 16:21:57 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-9434286f-b3e6-439c-909d-497401a86eae tempest-VolumeSnapshotQuotasNegativeTestJSON-1177716203 None] snapshot_file for this snap is: volume-025122c0-2af8-4a6b-863c-cbd5089f0913.521ac057-d9c6-4ce4-8ce5-eb7c6f0d973d {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 15 16:21:57 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[eebb4877-a289-41b5-8709-15ece427f01e]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:21:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9434286f-b3e6-439c-909d-497401a86eae tempest-VolumeSnapshotQuotasNegativeTestJSON-1177716203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-025122c0-2af8-4a6b-863c-cbd5089f0913.521ac057-d9c6-4ce4-8ce5-eb7c6f0d973d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:21:57 devstack sudo[93457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-025122c0-2af8-4a6b-863c-cbd5089f0913.521ac057-d9c6-4ce4-8ce5-eb7c6f0d973d Sep 15 16:21:57 devstack sudo[93457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:21:58 devstack sudo[93457]: pam_unix(sudo:session): session closed for user root Sep 15 16:21:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9434286f-b3e6-439c-909d-497401a86eae tempest-VolumeSnapshotQuotasNegativeTestJSON-1177716203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-025122c0-2af8-4a6b-863c-cbd5089f0913.521ac057-d9c6-4ce4-8ce5-eb7c6f0d973d" returned: 0 in 0.505s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:21:58 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-9434286f-b3e6-439c-909d-497401a86eae tempest-VolumeSnapshotQuotasNegativeTestJSON-1177716203 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-025122c0-2af8-4a6b-863c-cbd5089f0913(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 16:21:58 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[13a7e29c-9c77-462c-b6dd-da9b535a3c9f]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:21:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9434286f-b3e6-439c-909d-497401a86eae tempest-VolumeSnapshotQuotasNegativeTestJSON-1177716203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-025122c0-2af8-4a6b-863c-cbd5089f0913 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:21:58 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cbf64c3-dcea-4453-8533-f41e595b1734 tempest-VolumesListAdminTestJSON-1530194341 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:21:58 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1cbf64c3-dcea-4453-8533-f41e595b1734 tempest-VolumesListAdminTestJSON-1530194341 None] Flow 'volume_create_manager' (8a92e92f-0e51-4c31-8ec3-50838f3f36bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:21:58 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1cbf64c3-dcea-4453-8533-f41e595b1734 tempest-VolumesListAdminTestJSON-1530194341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (833bccb3-7130-4152-b62e-552fbe52664a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:21:58 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1cbf64c3-dcea-4453-8533-f41e595b1734 tempest-VolumesListAdminTestJSON-1530194341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (833bccb3-7130-4152-b62e-552fbe52664a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:21:58Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c01f1ac-f7be-426d-b512-b93c86fd093c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ed1eac2d7c345f4b8fb4a7c19542a8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:21:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:21:58Z,use_quota=True,user_id='46d2a4a9f6224a40b73675e432ffdfd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:21:58 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1cbf64c3-dcea-4453-8533-f41e595b1734 tempest-VolumesListAdminTestJSON-1530194341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8541b5b6-337c-486a-bd59-274a18483fd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:21:58 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1cbf64c3-dcea-4453-8533-f41e595b1734 tempest-VolumesListAdminTestJSON-1530194341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8541b5b6-337c-486a-bd59-274a18483fd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:21:58 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1cbf64c3-dcea-4453-8533-f41e595b1734 tempest-VolumesListAdminTestJSON-1530194341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb046242-2e5e-4e2f-bb5a-4b4df8d795ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:21:58 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1cbf64c3-dcea-4453-8533-f41e595b1734 tempest-VolumesListAdminTestJSON-1530194341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb046242-2e5e-4e2f-bb5a-4b4df8d795ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c01f1ac-f7be-426d-b512-b93c86fd093c', 'volume_name': 'volume-4c01f1ac-f7be-426d-b512-b93c86fd093c', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:21:58 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1cbf64c3-dcea-4453-8533-f41e595b1734 tempest-VolumesListAdminTestJSON-1530194341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab1bd189-982b-4775-853c-b0ea12d34151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:21:58 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1cbf64c3-dcea-4453-8533-f41e595b1734 tempest-VolumesListAdminTestJSON-1530194341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab1bd189-982b-4775-853c-b0ea12d34151) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:21:58 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1cbf64c3-dcea-4453-8533-f41e595b1734 tempest-VolumesListAdminTestJSON-1530194341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25448f7f-15f3-432e-935a-24cd223ada68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:21:58 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-1cbf64c3-dcea-4453-8533-f41e595b1734 tempest-VolumesListAdminTestJSON-1530194341 None] Volume 4c01f1ac-f7be-426d-b512-b93c86fd093c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c01f1ac-f7be-426d-b512-b93c86fd093c', 'volume_size': 1} Sep 15 16:21:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-1cbf64c3-dcea-4453-8533-f41e595b1734 tempest-VolumesListAdminTestJSON-1530194341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:21:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-1cbf64c3-dcea-4453-8533-f41e595b1734 tempest-VolumesListAdminTestJSON-1530194341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:21:58 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-1cbf64c3-dcea-4453-8533-f41e595b1734 tempest-VolumesListAdminTestJSON-1530194341 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:21:58Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c01f1ac-f7be-426d-b512-b93c86fd093c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ed1eac2d7c345f4b8fb4a7c19542a8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:21:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:21:58Z,use_quota=True,user_id='46d2a4a9f6224a40b73675e432ffdfd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:21:58 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-1cbf64c3-dcea-4453-8533-f41e595b1734 tempest-VolumesListAdminTestJSON-1530194341 None] Creating volume 4c01f1ac-f7be-426d-b512-b93c86fd093c {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:21:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-1cbf64c3-dcea-4453-8533-f41e595b1734 tempest-VolumesListAdminTestJSON-1530194341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:21:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-1cbf64c3-dcea-4453-8533-f41e595b1734 tempest-VolumesListAdminTestJSON-1530194341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:21:58 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-1cbf64c3-dcea-4453-8533-f41e595b1734 tempest-VolumesListAdminTestJSON-1530194341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:21:58 devstack sudo[93462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-025122c0-2af8-4a6b-863c-cbd5089f0913 Sep 15 16:21:58 devstack sudo[93462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:21:58 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-1cbf64c3-dcea-4453-8533-f41e595b1734 tempest-VolumesListAdminTestJSON-1530194341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:21:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-1cbf64c3-dcea-4453-8533-f41e595b1734 tempest-VolumesListAdminTestJSON-1530194341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:21:58 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-1cbf64c3-dcea-4453-8533-f41e595b1734 tempest-VolumesListAdminTestJSON-1530194341 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:21:58 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-1cbf64c3-dcea-4453-8533-f41e595b1734 tempest-VolumesListAdminTestJSON-1530194341 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:21:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-1cbf64c3-dcea-4453-8533-f41e595b1734 tempest-VolumesListAdminTestJSON-1530194341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-4c01f1ac-f7be-426d-b512-b93c86fd093c 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:21:58 devstack sudo[93464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-4c01f1ac-f7be-426d-b512-b93c86fd093c 1073741824 Sep 15 16:21:58 devstack sudo[93464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:21:58 devstack sudo[93462]: pam_unix(sudo:session): session closed for user root Sep 15 16:21:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9434286f-b3e6-439c-909d-497401a86eae tempest-VolumeSnapshotQuotasNegativeTestJSON-1177716203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-025122c0-2af8-4a6b-863c-cbd5089f0913" returned: 0 in 0.396s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:21:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9434286f-b3e6-439c-909d-497401a86eae tempest-VolumeSnapshotQuotasNegativeTestJSON-1177716203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-025122c0-2af8-4a6b-863c-cbd5089f0913.521ac057-d9c6-4ce4-8ce5-eb7c6f0d973d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:21:58 devstack sudo[93472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-025122c0-2af8-4a6b-863c-cbd5089f0913.521ac057-d9c6-4ce4-8ce5-eb7c6f0d973d Sep 15 16:21:58 devstack sudo[93472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:21:58 devstack sudo[93464]: pam_unix(sudo:session): session closed for user root Sep 15 16:21:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-1cbf64c3-dcea-4453-8533-f41e595b1734 tempest-VolumesListAdminTestJSON-1530194341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-4c01f1ac-f7be-426d-b512-b93c86fd093c 1073741824" returned: 0 in 0.460s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:21:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-1cbf64c3-dcea-4453-8533-f41e595b1734 tempest-VolumesListAdminTestJSON-1530194341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-4c01f1ac-f7be-426d-b512-b93c86fd093c {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:21:58 devstack sudo[93475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-4c01f1ac-f7be-426d-b512-b93c86fd093c Sep 15 16:21:58 devstack sudo[93475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:21:59 devstack sudo[93472]: pam_unix(sudo:session): session closed for user root Sep 15 16:21:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9434286f-b3e6-439c-909d-497401a86eae tempest-VolumeSnapshotQuotasNegativeTestJSON-1177716203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-025122c0-2af8-4a6b-863c-cbd5089f0913.521ac057-d9c6-4ce4-8ce5-eb7c6f0d973d" returned: 0 in 0.400s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:21:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9434286f-b3e6-439c-909d-497401a86eae tempest-VolumeSnapshotQuotasNegativeTestJSON-1177716203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-025122c0-2af8-4a6b-863c-cbd5089f0913.521ac057-d9c6-4ce4-8ce5-eb7c6f0d973d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:21:59 devstack sudo[93480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-025122c0-2af8-4a6b-863c-cbd5089f0913.521ac057-d9c6-4ce4-8ce5-eb7c6f0d973d Sep 15 16:21:59 devstack sudo[93480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:21:59 devstack sudo[93475]: pam_unix(sudo:session): session closed for user root Sep 15 16:21:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-1cbf64c3-dcea-4453-8533-f41e595b1734 tempest-VolumesListAdminTestJSON-1530194341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-4c01f1ac-f7be-426d-b512-b93c86fd093c" returned: 0 in 0.313s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:21:59 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-1cbf64c3-dcea-4453-8533-f41e595b1734 tempest-VolumesListAdminTestJSON-1530194341 None] <== create_volume: return (815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:21:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-1cbf64c3-dcea-4453-8533-f41e595b1734 tempest-VolumesListAdminTestJSON-1530194341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.820s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:21:59 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1cbf64c3-dcea-4453-8533-f41e595b1734 tempest-VolumesListAdminTestJSON-1530194341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25448f7f-15f3-432e-935a-24cd223ada68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c01f1ac-f7be-426d-b512-b93c86fd093c', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:21:59 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1cbf64c3-dcea-4453-8533-f41e595b1734 tempest-VolumesListAdminTestJSON-1530194341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fac4cd19-d8c9-4312-b00b-2b26dd92888e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:21:59 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-1cbf64c3-dcea-4453-8533-f41e595b1734 tempest-VolumesListAdminTestJSON-1530194341 None] Volume volume-4c01f1ac-f7be-426d-b512-b93c86fd093c (4c01f1ac-f7be-426d-b512-b93c86fd093c): created successfully Sep 15 16:21:59 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1cbf64c3-dcea-4453-8533-f41e595b1734 tempest-VolumesListAdminTestJSON-1530194341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fac4cd19-d8c9-4312-b00b-2b26dd92888e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:21:59 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1cbf64c3-dcea-4453-8533-f41e595b1734 tempest-VolumesListAdminTestJSON-1530194341 None] Flow 'volume_create_manager' (8a92e92f-0e51-4c31-8ec3-50838f3f36bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:21:59 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-1cbf64c3-dcea-4453-8533-f41e595b1734 tempest-VolumesListAdminTestJSON-1530194341 None] Created volume successfully. Sep 15 16:21:59 devstack sudo[93480]: pam_unix(sudo:session): session closed for user root Sep 15 16:21:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9434286f-b3e6-439c-909d-497401a86eae tempest-VolumeSnapshotQuotasNegativeTestJSON-1177716203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-025122c0-2af8-4a6b-863c-cbd5089f0913.521ac057-d9c6-4ce4-8ce5-eb7c6f0d973d" returned: 0 in 0.292s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:21:59 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-9434286f-b3e6-439c-909d-497401a86eae tempest-VolumeSnapshotQuotasNegativeTestJSON-1177716203 None] Lock "cinder-quobyte-521ac057-d9c6-4ce4-8ce5-eb7c6f0d973d" released by "_delete_snapshot" :: held 1.757s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:21:59 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-9434286f-b3e6-439c-909d-497401a86eae tempest-VolumeSnapshotQuotasNegativeTestJSON-1177716203 None] Lock "cinder-quobyte-025122c0-2af8-4a6b-863c-cbd5089f0913" released by "delete_snapshot" :: held 1.784s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:21:59 devstack cinder-volume[86082]: WARNING cinder.quota [None req-9434286f-b3e6-439c-909d-497401a86eae tempest-VolumeSnapshotQuotasNegativeTestJSON-1177716203 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 15 16:21:59 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-9434286f-b3e6-439c-909d-497401a86eae tempest-VolumeSnapshotQuotasNegativeTestJSON-1177716203 None] Created reservations ['8a4a786f-42a3-47a6-9db0-1cdd7f754b46', '6beba256-457b-4ac3-915f-1256459cb183', '377454f5-9e42-436b-bd3e-43df113bd762', 'a9539e7b-9c26-46df-bc42-cd6027fe7002'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:21:59 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-9434286f-b3e6-439c-909d-497401a86eae tempest-VolumeSnapshotQuotasNegativeTestJSON-1177716203 None] Delete snapshot completed successfully. Sep 15 16:21:59 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-9434286f-b3e6-439c-909d-497401a86eae tempest-VolumeSnapshotQuotasNegativeTestJSON-1177716203 None] Lock "cinder-521ac057-d9c6-4ce4-8ce5-eb7c6f0d973d-delete_snapshot" released by "delete_snapshot" :: held 1.933s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:21:59 devstack cinder-volume[86082]: DEBUG oslo_service.periodic_task [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86082) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 15 16:21:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:21:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:21:59 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:21:59 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:21:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:21:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:21:59 devstack sudo[93484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:21:59 devstack sudo[93484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:21:59 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-922554d7-36d5-457c-9bdd-fe7cd90794b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1177716203 None] Acquiring lock "cinder-025122c0-2af8-4a6b-863c-cbd5089f0913-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:21:59 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-922554d7-36d5-457c-9bdd-fe7cd90794b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1177716203 None] Lock "cinder-025122c0-2af8-4a6b-863c-cbd5089f0913-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:21:59 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-922554d7-36d5-457c-9bdd-fe7cd90794b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1177716203 None] Acquiring lock "cinder-quobyte-025122c0-2af8-4a6b-863c-cbd5089f0913" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:21:59 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-922554d7-36d5-457c-9bdd-fe7cd90794b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1177716203 None] Lock "cinder-quobyte-025122c0-2af8-4a6b-863c-cbd5089f0913" acquired by "delete_volume" :: waited 0.022s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:21:59 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[149be499-837f-49b8-8a9b-731e30402664]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:21:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-922554d7-36d5-457c-9bdd-fe7cd90794b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1177716203 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-025122c0-2af8-4a6b-863c-cbd5089f0913 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:22:00 devstack sudo[93486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-025122c0-2af8-4a6b-863c-cbd5089f0913 Sep 15 16:22:00 devstack sudo[93486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:22:00 devstack sudo[93484]: pam_unix(sudo:session): session closed for user root Sep 15 16:22:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.355s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:22:00 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:22:00 devstack cinder-volume[86082]: DEBUG oslo_service.periodic_task [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Running periodic task VolumeManager._thread_info {{(pid=86082) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 15 16:22:00 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] thread count: 28 {{(pid=86082) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 15 16:22:00 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] thread info: [<_MainThread(MainThread, started 124875935469696)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86082) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 15 16:22:00 devstack sudo[93486]: pam_unix(sudo:session): session closed for user root Sep 15 16:22:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-922554d7-36d5-457c-9bdd-fe7cd90794b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1177716203 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-025122c0-2af8-4a6b-863c-cbd5089f0913" returned: 0 in 0.451s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:22:00 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-d0b3a9d4-489d-4970-9433-8a8f25d6f823 tempest-VolumesListAdminTestJSON-1530194341 None] Acquiring lock "cinder-4c01f1ac-f7be-426d-b512-b93c86fd093c-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:22:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-922554d7-36d5-457c-9bdd-fe7cd90794b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1177716203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-025122c0-2af8-4a6b-863c-cbd5089f0913 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:22:00 devstack sudo[93493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-025122c0-2af8-4a6b-863c-cbd5089f0913 Sep 15 16:22:00 devstack sudo[93493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:22:00 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-d0b3a9d4-489d-4970-9433-8a8f25d6f823 tempest-VolumesListAdminTestJSON-1530194341 None] Lock "cinder-4c01f1ac-f7be-426d-b512-b93c86fd093c-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:22:00 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-d0b3a9d4-489d-4970-9433-8a8f25d6f823 tempest-VolumesListAdminTestJSON-1530194341 None] Acquiring lock "cinder-quobyte-4c01f1ac-f7be-426d-b512-b93c86fd093c" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:22:00 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-d0b3a9d4-489d-4970-9433-8a8f25d6f823 tempest-VolumesListAdminTestJSON-1530194341 None] Lock "cinder-quobyte-4c01f1ac-f7be-426d-b512-b93c86fd093c" acquired by "delete_volume" :: waited 0.033s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:22:00 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-0b062339-7f7e-45d8-90bd-de1ad9df30b2 tempest-VolumesListAdminTestJSON-1844514665 None] Acquiring lock "cinder-183b3742-be89-4a75-bdc5-3bf18e30efe5-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:22:00 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[9554f03a-fc1d-4764-b416-5d9823979c26]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:22:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d0b3a9d4-489d-4970-9433-8a8f25d6f823 tempest-VolumesListAdminTestJSON-1530194341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-4c01f1ac-f7be-426d-b512-b93c86fd093c {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:22:00 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-0b062339-7f7e-45d8-90bd-de1ad9df30b2 tempest-VolumesListAdminTestJSON-1844514665 None] Lock "cinder-183b3742-be89-4a75-bdc5-3bf18e30efe5-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:22:00 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-0b062339-7f7e-45d8-90bd-de1ad9df30b2 tempest-VolumesListAdminTestJSON-1844514665 None] Acquiring lock "cinder-quobyte-183b3742-be89-4a75-bdc5-3bf18e30efe5" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:22:00 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-0b062339-7f7e-45d8-90bd-de1ad9df30b2 tempest-VolumesListAdminTestJSON-1844514665 None] Lock "cinder-quobyte-183b3742-be89-4a75-bdc5-3bf18e30efe5" acquired by "delete_volume" :: waited 0.037s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:22:00 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8076028-0de4-4ef3-b2ec-2fb10fe435b0]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:22:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0b062339-7f7e-45d8-90bd-de1ad9df30b2 tempest-VolumesListAdminTestJSON-1844514665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-183b3742-be89-4a75-bdc5-3bf18e30efe5 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:22:00 devstack sudo[93495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-4c01f1ac-f7be-426d-b512-b93c86fd093c Sep 15 16:22:00 devstack sudo[93495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:22:00 devstack sudo[93493]: pam_unix(sudo:session): session closed for user root Sep 15 16:22:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-922554d7-36d5-457c-9bdd-fe7cd90794b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1177716203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-025122c0-2af8-4a6b-863c-cbd5089f0913" returned: 0 in 0.545s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:22:01 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-922554d7-36d5-457c-9bdd-fe7cd90794b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1177716203 None] Lock "cinder-quobyte-025122c0-2af8-4a6b-863c-cbd5089f0913" released by "delete_volume" :: held 1.096s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:22:01 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-922554d7-36d5-457c-9bdd-fe7cd90794b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1177716203 None] Created reservations ['76d288ce-ed59-486e-9742-14b813d66de9', 'e6561cc1-df2e-417e-8e44-74943785fc43', '02dfb5a0-9307-4bc1-998b-3b48a144477e', '39566ef1-13c6-4734-8217-6e88a208f58c'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:22:01 devstack sudo[93497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-183b3742-be89-4a75-bdc5-3bf18e30efe5 Sep 15 16:22:01 devstack sudo[93497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:22:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-922554d7-36d5-457c-9bdd-fe7cd90794b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1177716203 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:22:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-922554d7-36d5-457c-9bdd-fe7cd90794b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1177716203 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:22:01 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-922554d7-36d5-457c-9bdd-fe7cd90794b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1177716203 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:22:01 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-922554d7-36d5-457c-9bdd-fe7cd90794b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1177716203 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:22:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-922554d7-36d5-457c-9bdd-fe7cd90794b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1177716203 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:22:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-922554d7-36d5-457c-9bdd-fe7cd90794b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1177716203 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:22:01 devstack sudo[93495]: pam_unix(sudo:session): session closed for user root Sep 15 16:22:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d0b3a9d4-489d-4970-9433-8a8f25d6f823 tempest-VolumesListAdminTestJSON-1530194341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-4c01f1ac-f7be-426d-b512-b93c86fd093c" returned: 0 in 0.712s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:22:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d0b3a9d4-489d-4970-9433-8a8f25d6f823 tempest-VolumesListAdminTestJSON-1530194341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-4c01f1ac-f7be-426d-b512-b93c86fd093c {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:22:01 devstack sudo[93503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:22:01 devstack sudo[93503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:22:01 devstack sudo[93504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-4c01f1ac-f7be-426d-b512-b93c86fd093c Sep 15 16:22:01 devstack sudo[93504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:22:01 devstack sudo[93497]: pam_unix(sudo:session): session closed for user root Sep 15 16:22:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0b062339-7f7e-45d8-90bd-de1ad9df30b2 tempest-VolumesListAdminTestJSON-1844514665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-183b3742-be89-4a75-bdc5-3bf18e30efe5" returned: 0 in 0.645s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:22:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0b062339-7f7e-45d8-90bd-de1ad9df30b2 tempest-VolumesListAdminTestJSON-1844514665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-183b3742-be89-4a75-bdc5-3bf18e30efe5 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:22:01 devstack sudo[93510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-183b3742-be89-4a75-bdc5-3bf18e30efe5 Sep 15 16:22:01 devstack sudo[93510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:22:01 devstack sudo[93504]: pam_unix(sudo:session): session closed for user root Sep 15 16:22:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d0b3a9d4-489d-4970-9433-8a8f25d6f823 tempest-VolumesListAdminTestJSON-1530194341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-4c01f1ac-f7be-426d-b512-b93c86fd093c" returned: 0 in 0.389s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:22:01 devstack sudo[93503]: pam_unix(sudo:session): session closed for user root Sep 15 16:22:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-922554d7-36d5-457c-9bdd-fe7cd90794b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1177716203 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.442s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:22:01 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-922554d7-36d5-457c-9bdd-fe7cd90794b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1177716203 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:22:01 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-d0b3a9d4-489d-4970-9433-8a8f25d6f823 tempest-VolumesListAdminTestJSON-1530194341 None] Lock "cinder-quobyte-4c01f1ac-f7be-426d-b512-b93c86fd093c" released by "delete_volume" :: held 1.196s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:22:01 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-922554d7-36d5-457c-9bdd-fe7cd90794b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1177716203 None] Deleted volume successfully. Sep 15 16:22:01 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-922554d7-36d5-457c-9bdd-fe7cd90794b8 tempest-VolumeSnapshotQuotasNegativeTestJSON-1177716203 None] Lock "cinder-025122c0-2af8-4a6b-863c-cbd5089f0913-delete_volume" released by "delete_volume" :: held 1.999s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:22:01 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-d0b3a9d4-489d-4970-9433-8a8f25d6f823 tempest-VolumesListAdminTestJSON-1530194341 None] Created reservations ['7bb5d3cc-9ef0-4e89-be0c-253664c208c8', '79561bb0-598e-47d5-90ca-5092b4f3c3ea', '9358850e-6a6d-46e5-a151-4dc9177625d7', '12e07775-83b1-4ff0-a0ac-3a00bbafcaf7'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:22:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-d0b3a9d4-489d-4970-9433-8a8f25d6f823 tempest-VolumesListAdminTestJSON-1530194341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:22:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-d0b3a9d4-489d-4970-9433-8a8f25d6f823 tempest-VolumesListAdminTestJSON-1530194341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:22:02 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-d0b3a9d4-489d-4970-9433-8a8f25d6f823 tempest-VolumesListAdminTestJSON-1530194341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:22:02 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-d0b3a9d4-489d-4970-9433-8a8f25d6f823 tempest-VolumesListAdminTestJSON-1530194341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:22:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-d0b3a9d4-489d-4970-9433-8a8f25d6f823 tempest-VolumesListAdminTestJSON-1530194341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:22:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d0b3a9d4-489d-4970-9433-8a8f25d6f823 tempest-VolumesListAdminTestJSON-1530194341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:22:02 devstack sudo[93510]: pam_unix(sudo:session): session closed for user root Sep 15 16:22:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0b062339-7f7e-45d8-90bd-de1ad9df30b2 tempest-VolumesListAdminTestJSON-1844514665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-183b3742-be89-4a75-bdc5-3bf18e30efe5" returned: 0 in 0.513s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:22:02 devstack sudo[93515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:22:02 devstack sudo[93515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:22:02 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-0b062339-7f7e-45d8-90bd-de1ad9df30b2 tempest-VolumesListAdminTestJSON-1844514665 None] Lock "cinder-quobyte-183b3742-be89-4a75-bdc5-3bf18e30efe5" released by "delete_volume" :: held 1.283s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:22:02 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-0b062339-7f7e-45d8-90bd-de1ad9df30b2 tempest-VolumesListAdminTestJSON-1844514665 None] Created reservations ['44a1bb6f-4581-4fec-b748-5c8be417eda9', 'e06da007-1579-4096-af0d-1a3b51f28408', '7812e7f8-d1f7-4465-83bc-a22a78b5fe09', 'a76557b9-8d1b-4207-a942-190fcbd63ce3'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:22:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-0b062339-7f7e-45d8-90bd-de1ad9df30b2 tempest-VolumesListAdminTestJSON-1844514665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:22:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-0b062339-7f7e-45d8-90bd-de1ad9df30b2 tempest-VolumesListAdminTestJSON-1844514665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:22:02 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-0b062339-7f7e-45d8-90bd-de1ad9df30b2 tempest-VolumesListAdminTestJSON-1844514665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:22:02 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-0b062339-7f7e-45d8-90bd-de1ad9df30b2 tempest-VolumesListAdminTestJSON-1844514665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:22:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-0b062339-7f7e-45d8-90bd-de1ad9df30b2 tempest-VolumesListAdminTestJSON-1844514665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:22:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0b062339-7f7e-45d8-90bd-de1ad9df30b2 tempest-VolumesListAdminTestJSON-1844514665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:22:02 devstack sudo[93519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:22:02 devstack sudo[93519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:22:02 devstack sudo[93515]: pam_unix(sudo:session): session closed for user root Sep 15 16:22:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d0b3a9d4-489d-4970-9433-8a8f25d6f823 tempest-VolumesListAdminTestJSON-1530194341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.406s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:22:02 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-d0b3a9d4-489d-4970-9433-8a8f25d6f823 tempest-VolumesListAdminTestJSON-1530194341 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:22:02 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-d0b3a9d4-489d-4970-9433-8a8f25d6f823 tempest-VolumesListAdminTestJSON-1530194341 None] Deleted volume successfully. Sep 15 16:22:02 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-d0b3a9d4-489d-4970-9433-8a8f25d6f823 tempest-VolumesListAdminTestJSON-1530194341 None] Lock "cinder-4c01f1ac-f7be-426d-b512-b93c86fd093c-delete_volume" released by "delete_volume" :: held 2.006s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:22:02 devstack sudo[93519]: pam_unix(sudo:session): session closed for user root Sep 15 16:22:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0b062339-7f7e-45d8-90bd-de1ad9df30b2 tempest-VolumesListAdminTestJSON-1844514665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.346s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:22:02 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-0b062339-7f7e-45d8-90bd-de1ad9df30b2 tempest-VolumesListAdminTestJSON-1844514665 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:22:02 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-0b062339-7f7e-45d8-90bd-de1ad9df30b2 tempest-VolumesListAdminTestJSON-1844514665 None] Deleted volume successfully. Sep 15 16:22:02 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-0b062339-7f7e-45d8-90bd-de1ad9df30b2 tempest-VolumesListAdminTestJSON-1844514665 None] Lock "cinder-183b3742-be89-4a75-bdc5-3bf18e30efe5-delete_volume" released by "delete_volume" :: held 2.038s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:22:03 devstack cinder-volume[86082]: INFO cinder.volume.manager [req-0b111283-49e7-42d9-ad46-b653e23a1ab2 req-bdccd663-7f69-4e58-9c4c-855bd521381c tempest-AttachVolumeTestJSON-1797013884 None] Terminate volume connection completed successfully. Sep 15 16:22:03 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-0b111283-49e7-42d9-ad46-b653e23a1ab2 req-bdccd663-7f69-4e58-9c4c-855bd521381c tempest-AttachVolumeTestJSON-1797013884 None] Deleting attachment a2f04996-acbb-45c3-afb8-95a5e5324155. {{(pid=86082) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 15 16:22:03 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-65c74fe3-91e8-46b9-b3ca-1bd907bdfad9 tempest-VolumesListAdminTestJSON-1844514665 None] Acquiring lock "cinder-66e7852d-b6af-414a-b257-b9e0f5127be5-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:22:03 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-65c74fe3-91e8-46b9-b3ca-1bd907bdfad9 tempest-VolumesListAdminTestJSON-1844514665 None] Lock "cinder-66e7852d-b6af-414a-b257-b9e0f5127be5-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:22:03 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-65c74fe3-91e8-46b9-b3ca-1bd907bdfad9 tempest-VolumesListAdminTestJSON-1844514665 None] Acquiring lock "cinder-quobyte-66e7852d-b6af-414a-b257-b9e0f5127be5" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:22:03 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-65c74fe3-91e8-46b9-b3ca-1bd907bdfad9 tempest-VolumesListAdminTestJSON-1844514665 None] Lock "cinder-quobyte-66e7852d-b6af-414a-b257-b9e0f5127be5" acquired by "delete_volume" :: waited 0.022s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:22:03 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[99910b9d-4c60-404e-bb72-940faacaa6c8]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:22:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-65c74fe3-91e8-46b9-b3ca-1bd907bdfad9 tempest-VolumesListAdminTestJSON-1844514665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-66e7852d-b6af-414a-b257-b9e0f5127be5 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:22:03 devstack sudo[93527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-66e7852d-b6af-414a-b257-b9e0f5127be5 Sep 15 16:22:03 devstack sudo[93527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:22:03 devstack sudo[93527]: pam_unix(sudo:session): session closed for user root Sep 15 16:22:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-65c74fe3-91e8-46b9-b3ca-1bd907bdfad9 tempest-VolumesListAdminTestJSON-1844514665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-66e7852d-b6af-414a-b257-b9e0f5127be5" returned: 0 in 0.421s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:22:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-65c74fe3-91e8-46b9-b3ca-1bd907bdfad9 tempest-VolumesListAdminTestJSON-1844514665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-66e7852d-b6af-414a-b257-b9e0f5127be5 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:22:03 devstack sudo[93532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-66e7852d-b6af-414a-b257-b9e0f5127be5 Sep 15 16:22:03 devstack sudo[93532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:22:04 devstack sudo[93532]: pam_unix(sudo:session): session closed for user root Sep 15 16:22:04 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-65c74fe3-91e8-46b9-b3ca-1bd907bdfad9 tempest-VolumesListAdminTestJSON-1844514665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-66e7852d-b6af-414a-b257-b9e0f5127be5" returned: 0 in 0.510s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:22:04 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-65c74fe3-91e8-46b9-b3ca-1bd907bdfad9 tempest-VolumesListAdminTestJSON-1844514665 None] Lock "cinder-quobyte-66e7852d-b6af-414a-b257-b9e0f5127be5" released by "delete_volume" :: held 1.003s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:22:04 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-65c74fe3-91e8-46b9-b3ca-1bd907bdfad9 tempest-VolumesListAdminTestJSON-1844514665 None] Created reservations ['6bc78e06-cc32-471b-8b9e-315ef11fe5b9', '3e0b81ff-e832-46c2-99e4-0a0010860926', '4d8ca277-eedf-45fa-b5e6-f8ca2d421938', 'c05d33ae-fcb0-4324-97d0-ab03d8aea82e'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:22:04 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-65c74fe3-91e8-46b9-b3ca-1bd907bdfad9 tempest-VolumesListAdminTestJSON-1844514665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:22:04 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-65c74fe3-91e8-46b9-b3ca-1bd907bdfad9 tempest-VolumesListAdminTestJSON-1844514665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:22:04 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-65c74fe3-91e8-46b9-b3ca-1bd907bdfad9 tempest-VolumesListAdminTestJSON-1844514665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:22:04 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-65c74fe3-91e8-46b9-b3ca-1bd907bdfad9 tempest-VolumesListAdminTestJSON-1844514665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:22:04 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-65c74fe3-91e8-46b9-b3ca-1bd907bdfad9 tempest-VolumesListAdminTestJSON-1844514665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:22:04 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-65c74fe3-91e8-46b9-b3ca-1bd907bdfad9 tempest-VolumesListAdminTestJSON-1844514665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:22:04 devstack sudo[93540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:22:04 devstack sudo[93540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:22:05 devstack sudo[93540]: pam_unix(sudo:session): session closed for user root Sep 15 16:22:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-65c74fe3-91e8-46b9-b3ca-1bd907bdfad9 tempest-VolumesListAdminTestJSON-1844514665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.296s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:22:05 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-65c74fe3-91e8-46b9-b3ca-1bd907bdfad9 tempest-VolumesListAdminTestJSON-1844514665 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:22:05 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-65c74fe3-91e8-46b9-b3ca-1bd907bdfad9 tempest-VolumesListAdminTestJSON-1844514665 None] Deleted volume successfully. Sep 15 16:22:05 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-65c74fe3-91e8-46b9-b3ca-1bd907bdfad9 tempest-VolumesListAdminTestJSON-1844514665 None] Lock "cinder-66e7852d-b6af-414a-b257-b9e0f5127be5-delete_volume" released by "delete_volume" :: held 1.666s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:22:05 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-d08e6c00-903e-447a-881c-4a148d13d2eb tempest-VolumesListAdminTestJSON-1844514665 None] Acquiring lock "cinder-9bf9127c-d06a-4930-bce9-1d0ba75124b7-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:22:05 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-d08e6c00-903e-447a-881c-4a148d13d2eb tempest-VolumesListAdminTestJSON-1844514665 None] Lock "cinder-9bf9127c-d06a-4930-bce9-1d0ba75124b7-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:22:05 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-d08e6c00-903e-447a-881c-4a148d13d2eb tempest-VolumesListAdminTestJSON-1844514665 None] Acquiring lock "cinder-quobyte-9bf9127c-d06a-4930-bce9-1d0ba75124b7" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:22:05 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-d08e6c00-903e-447a-881c-4a148d13d2eb tempest-VolumesListAdminTestJSON-1844514665 None] Lock "cinder-quobyte-9bf9127c-d06a-4930-bce9-1d0ba75124b7" acquired by "delete_volume" :: waited 0.019s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:22:06 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef99c760-e3dd-4cf3-a4b1-c93ec34369ac]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:22:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d08e6c00-903e-447a-881c-4a148d13d2eb tempest-VolumesListAdminTestJSON-1844514665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-9bf9127c-d06a-4930-bce9-1d0ba75124b7 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:22:06 devstack sudo[93545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-9bf9127c-d06a-4930-bce9-1d0ba75124b7 Sep 15 16:22:06 devstack sudo[93545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:22:06 devstack sudo[93545]: pam_unix(sudo:session): session closed for user root Sep 15 16:22:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d08e6c00-903e-447a-881c-4a148d13d2eb tempest-VolumesListAdminTestJSON-1844514665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-9bf9127c-d06a-4930-bce9-1d0ba75124b7" returned: 0 in 0.630s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:22:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d08e6c00-903e-447a-881c-4a148d13d2eb tempest-VolumesListAdminTestJSON-1844514665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-9bf9127c-d06a-4930-bce9-1d0ba75124b7 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:22:06 devstack sudo[93584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-9bf9127c-d06a-4930-bce9-1d0ba75124b7 Sep 15 16:22:06 devstack sudo[93584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:22:07 devstack sudo[93584]: pam_unix(sudo:session): session closed for user root Sep 15 16:22:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d08e6c00-903e-447a-881c-4a148d13d2eb tempest-VolumesListAdminTestJSON-1844514665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-9bf9127c-d06a-4930-bce9-1d0ba75124b7" returned: 0 in 0.421s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:22:07 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-d08e6c00-903e-447a-881c-4a148d13d2eb tempest-VolumesListAdminTestJSON-1844514665 None] Lock "cinder-quobyte-9bf9127c-d06a-4930-bce9-1d0ba75124b7" released by "delete_volume" :: held 1.106s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:22:07 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-d08e6c00-903e-447a-881c-4a148d13d2eb tempest-VolumesListAdminTestJSON-1844514665 None] Created reservations ['95a57d6c-1bc5-418b-8191-cab6fc9cafc7', '2d294fcd-4f93-4aba-91e8-405d2fdbf1cc', 'fff92f7a-f3c8-4433-9214-5b090d998e60', 'dafb0217-2ae1-4e28-8407-aa675f1ac608'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:22:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-d08e6c00-903e-447a-881c-4a148d13d2eb tempest-VolumesListAdminTestJSON-1844514665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:22:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-d08e6c00-903e-447a-881c-4a148d13d2eb tempest-VolumesListAdminTestJSON-1844514665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:22:07 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-d08e6c00-903e-447a-881c-4a148d13d2eb tempest-VolumesListAdminTestJSON-1844514665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:22:07 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-d08e6c00-903e-447a-881c-4a148d13d2eb tempest-VolumesListAdminTestJSON-1844514665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:22:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-d08e6c00-903e-447a-881c-4a148d13d2eb tempest-VolumesListAdminTestJSON-1844514665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:22:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d08e6c00-903e-447a-881c-4a148d13d2eb tempest-VolumesListAdminTestJSON-1844514665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:22:07 devstack sudo[93587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:22:07 devstack sudo[93587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:22:07 devstack sudo[93587]: pam_unix(sudo:session): session closed for user root Sep 15 16:22:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d08e6c00-903e-447a-881c-4a148d13d2eb tempest-VolumesListAdminTestJSON-1844514665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.393s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:22:07 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-d08e6c00-903e-447a-881c-4a148d13d2eb tempest-VolumesListAdminTestJSON-1844514665 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:22:07 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-d08e6c00-903e-447a-881c-4a148d13d2eb tempest-VolumesListAdminTestJSON-1844514665 None] Deleted volume successfully. Sep 15 16:22:07 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-d08e6c00-903e-447a-881c-4a148d13d2eb tempest-VolumesListAdminTestJSON-1844514665 None] Lock "cinder-9bf9127c-d06a-4930-bce9-1d0ba75124b7-delete_volume" released by "delete_volume" :: held 1.880s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:22:12 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-86100246-d2af-4f0f-a761-1868721dc19b tempest-VolumeTypesAccessTest-1866444975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:22:12 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-86100246-d2af-4f0f-a761-1868721dc19b tempest-VolumeTypesAccessTest-1866444975 None] Flow 'volume_create_manager' (fc12c5e0-9a39-476b-81d0-bae5cf502460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:22:12 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-86100246-d2af-4f0f-a761-1868721dc19b tempest-VolumeTypesAccessTest-1866444975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3929734-1dd4-476b-bfd2-84e13a5c87f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:22:12 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-86100246-d2af-4f0f-a761-1868721dc19b tempest-VolumeTypesAccessTest-1866444975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3929734-1dd4-476b-bfd2-84e13a5c87f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:22:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-693916610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48b55876-f30f-4ddd-b9f3-575160f1b4e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='307c0327901d498eb788eb0b74788463',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:22:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:22:12Z,use_quota=True,user_id='057ccfa21b6942e0870ac92508316e3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(32f93dc7-96f9-418e-bca0-c57f7f3202d5),volume_type_id=32f93dc7-96f9-418e-bca0-c57f7f3202d5)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:22:12 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-86100246-d2af-4f0f-a761-1868721dc19b tempest-VolumeTypesAccessTest-1866444975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fd7e6d9-5eb9-4543-9374-0cc547c1b8c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:22:12 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-86100246-d2af-4f0f-a761-1868721dc19b tempest-VolumeTypesAccessTest-1866444975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fd7e6d9-5eb9-4543-9374-0cc547c1b8c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:22:12 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-86100246-d2af-4f0f-a761-1868721dc19b tempest-VolumeTypesAccessTest-1866444975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bed9581c-ce27-4719-a843-44ebb74ad441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:22:12 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-86100246-d2af-4f0f-a761-1868721dc19b tempest-VolumeTypesAccessTest-1866444975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bed9581c-ce27-4719-a843-44ebb74ad441) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48b55876-f30f-4ddd-b9f3-575160f1b4e3', 'volume_name': 'volume-48b55876-f30f-4ddd-b9f3-575160f1b4e3', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:22:12 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-86100246-d2af-4f0f-a761-1868721dc19b tempest-VolumeTypesAccessTest-1866444975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (555226d3-56b4-4511-b55b-5f70fed85ff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:22:12 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-86100246-d2af-4f0f-a761-1868721dc19b tempest-VolumeTypesAccessTest-1866444975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (555226d3-56b4-4511-b55b-5f70fed85ff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:22:12 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-86100246-d2af-4f0f-a761-1868721dc19b tempest-VolumeTypesAccessTest-1866444975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a19e03c-59ed-4afa-a2f8-69d3464ead12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:22:12 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-86100246-d2af-4f0f-a761-1868721dc19b tempest-VolumeTypesAccessTest-1866444975 None] Volume 48b55876-f30f-4ddd-b9f3-575160f1b4e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48b55876-f30f-4ddd-b9f3-575160f1b4e3', 'volume_size': 1} Sep 15 16:22:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-86100246-d2af-4f0f-a761-1868721dc19b tempest-VolumeTypesAccessTest-1866444975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:22:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-86100246-d2af-4f0f-a761-1868721dc19b tempest-VolumeTypesAccessTest-1866444975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:22:12 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-86100246-d2af-4f0f-a761-1868721dc19b tempest-VolumeTypesAccessTest-1866444975 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:22:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-693916610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48b55876-f30f-4ddd-b9f3-575160f1b4e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='307c0327901d498eb788eb0b74788463',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:22:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:22:12Z,use_quota=True,user_id='057ccfa21b6942e0870ac92508316e3b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(32f93dc7-96f9-418e-bca0-c57f7f3202d5),volume_type_id=32f93dc7-96f9-418e-bca0-c57f7f3202d5)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:22:12 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-86100246-d2af-4f0f-a761-1868721dc19b tempest-VolumeTypesAccessTest-1866444975 None] Creating volume 48b55876-f30f-4ddd-b9f3-575160f1b4e3 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:22:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-86100246-d2af-4f0f-a761-1868721dc19b tempest-VolumeTypesAccessTest-1866444975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:22:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-86100246-d2af-4f0f-a761-1868721dc19b tempest-VolumeTypesAccessTest-1866444975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:22:12 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-86100246-d2af-4f0f-a761-1868721dc19b tempest-VolumeTypesAccessTest-1866444975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:22:12 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-86100246-d2af-4f0f-a761-1868721dc19b tempest-VolumeTypesAccessTest-1866444975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:22:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-86100246-d2af-4f0f-a761-1868721dc19b tempest-VolumeTypesAccessTest-1866444975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:22:12 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-86100246-d2af-4f0f-a761-1868721dc19b tempest-VolumeTypesAccessTest-1866444975 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:22:12 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-86100246-d2af-4f0f-a761-1868721dc19b tempest-VolumeTypesAccessTest-1866444975 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:22:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-86100246-d2af-4f0f-a761-1868721dc19b tempest-VolumeTypesAccessTest-1866444975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-48b55876-f30f-4ddd-b9f3-575160f1b4e3 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:22:12 devstack sudo[93723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-48b55876-f30f-4ddd-b9f3-575160f1b4e3 1073741824 Sep 15 16:22:12 devstack sudo[93723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:22:12 devstack sudo[93723]: pam_unix(sudo:session): session closed for user root Sep 15 16:22:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-86100246-d2af-4f0f-a761-1868721dc19b tempest-VolumeTypesAccessTest-1866444975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-48b55876-f30f-4ddd-b9f3-575160f1b4e3 1073741824" returned: 0 in 0.610s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:22:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-86100246-d2af-4f0f-a761-1868721dc19b tempest-VolumeTypesAccessTest-1866444975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-48b55876-f30f-4ddd-b9f3-575160f1b4e3 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:22:12 devstack sudo[93730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-48b55876-f30f-4ddd-b9f3-575160f1b4e3 Sep 15 16:22:12 devstack sudo[93730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:22:13 devstack sudo[93730]: pam_unix(sudo:session): session closed for user root Sep 15 16:22:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-86100246-d2af-4f0f-a761-1868721dc19b tempest-VolumeTypesAccessTest-1866444975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-48b55876-f30f-4ddd-b9f3-575160f1b4e3" returned: 0 in 0.344s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:22:13 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-86100246-d2af-4f0f-a761-1868721dc19b tempest-VolumeTypesAccessTest-1866444975 None] <== create_volume: return (1031ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:22:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-86100246-d2af-4f0f-a761-1868721dc19b tempest-VolumeTypesAccessTest-1866444975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.034s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:22:13 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-86100246-d2af-4f0f-a761-1868721dc19b tempest-VolumeTypesAccessTest-1866444975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a19e03c-59ed-4afa-a2f8-69d3464ead12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48b55876-f30f-4ddd-b9f3-575160f1b4e3', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:22:13 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-86100246-d2af-4f0f-a761-1868721dc19b tempest-VolumeTypesAccessTest-1866444975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc76f60b-4e6e-45cf-bfc6-23097f392885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:22:13 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-86100246-d2af-4f0f-a761-1868721dc19b tempest-VolumeTypesAccessTest-1866444975 None] Volume volume-48b55876-f30f-4ddd-b9f3-575160f1b4e3 (48b55876-f30f-4ddd-b9f3-575160f1b4e3): created successfully Sep 15 16:22:13 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-86100246-d2af-4f0f-a761-1868721dc19b tempest-VolumeTypesAccessTest-1866444975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc76f60b-4e6e-45cf-bfc6-23097f392885) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:22:13 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-86100246-d2af-4f0f-a761-1868721dc19b tempest-VolumeTypesAccessTest-1866444975 None] Flow 'volume_create_manager' (fc12c5e0-9a39-476b-81d0-bae5cf502460) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:22:13 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-86100246-d2af-4f0f-a761-1868721dc19b tempest-VolumeTypesAccessTest-1866444975 None] Created volume successfully. Sep 15 16:22:14 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-451042da-857a-49af-b2e6-ad5be9a87a09 tempest-VolumeTypesAccessTest-1866444975 None] Acquiring lock "cinder-48b55876-f30f-4ddd-b9f3-575160f1b4e3-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:22:14 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-451042da-857a-49af-b2e6-ad5be9a87a09 tempest-VolumeTypesAccessTest-1866444975 None] Lock "cinder-48b55876-f30f-4ddd-b9f3-575160f1b4e3-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:22:14 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-451042da-857a-49af-b2e6-ad5be9a87a09 tempest-VolumeTypesAccessTest-1866444975 None] Acquiring lock "cinder-quobyte-48b55876-f30f-4ddd-b9f3-575160f1b4e3" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:22:14 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-451042da-857a-49af-b2e6-ad5be9a87a09 tempest-VolumeTypesAccessTest-1866444975 None] Lock "cinder-quobyte-48b55876-f30f-4ddd-b9f3-575160f1b4e3" acquired by "delete_volume" :: waited 0.020s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:22:14 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[afd4f158-1660-4b68-b1fe-5863b4968dda]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:22:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-451042da-857a-49af-b2e6-ad5be9a87a09 tempest-VolumeTypesAccessTest-1866444975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-48b55876-f30f-4ddd-b9f3-575160f1b4e3 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:22:14 devstack sudo[93733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-48b55876-f30f-4ddd-b9f3-575160f1b4e3 Sep 15 16:22:14 devstack sudo[93733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:22:14 devstack sudo[93733]: pam_unix(sudo:session): session closed for user root Sep 15 16:22:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-451042da-857a-49af-b2e6-ad5be9a87a09 tempest-VolumeTypesAccessTest-1866444975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-48b55876-f30f-4ddd-b9f3-575160f1b4e3" returned: 0 in 0.443s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:22:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-451042da-857a-49af-b2e6-ad5be9a87a09 tempest-VolumeTypesAccessTest-1866444975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-48b55876-f30f-4ddd-b9f3-575160f1b4e3 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:22:15 devstack sudo[93738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-48b55876-f30f-4ddd-b9f3-575160f1b4e3 Sep 15 16:22:15 devstack sudo[93738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:22:15 devstack sudo[93738]: pam_unix(sudo:session): session closed for user root Sep 15 16:22:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-451042da-857a-49af-b2e6-ad5be9a87a09 tempest-VolumeTypesAccessTest-1866444975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-48b55876-f30f-4ddd-b9f3-575160f1b4e3" returned: 0 in 0.283s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:22:15 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-451042da-857a-49af-b2e6-ad5be9a87a09 tempest-VolumeTypesAccessTest-1866444975 None] Lock "cinder-quobyte-48b55876-f30f-4ddd-b9f3-575160f1b4e3" released by "delete_volume" :: held 0.801s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:22:15 devstack cinder-volume[86082]: WARNING cinder.quota [None req-451042da-857a-49af-b2e6-ad5be9a87a09 tempest-VolumeTypesAccessTest-1866444975 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-935190210 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-935190210, it is now deprecated. Please use the default quota class for default quota. Sep 15 16:22:15 devstack cinder-volume[86082]: WARNING cinder.quota [None req-451042da-857a-49af-b2e6-ad5be9a87a09 tempest-VolumeTypesAccessTest-1866444975 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-935190210 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-935190210, it is now deprecated. Please use the default quota class for default quota. Sep 15 16:22:15 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-451042da-857a-49af-b2e6-ad5be9a87a09 tempest-VolumeTypesAccessTest-1866444975 None] Created reservations ['fe22aa63-e481-44c5-b617-20ddd8cfc4dd', '38970b15-b979-4ef4-9ab4-6a95fbf8f2c7', 'c143756d-29b9-43d7-b11b-7e9498eefbdc', 'cff3f060-6f28-41fe-a33a-0581db5ef657'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:22:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-451042da-857a-49af-b2e6-ad5be9a87a09 tempest-VolumeTypesAccessTest-1866444975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:22:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-451042da-857a-49af-b2e6-ad5be9a87a09 tempest-VolumeTypesAccessTest-1866444975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:22:15 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-451042da-857a-49af-b2e6-ad5be9a87a09 tempest-VolumeTypesAccessTest-1866444975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:22:15 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-451042da-857a-49af-b2e6-ad5be9a87a09 tempest-VolumeTypesAccessTest-1866444975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:22:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-451042da-857a-49af-b2e6-ad5be9a87a09 tempest-VolumeTypesAccessTest-1866444975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:22:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-451042da-857a-49af-b2e6-ad5be9a87a09 tempest-VolumeTypesAccessTest-1866444975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:22:15 devstack sudo[93741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:22:15 devstack sudo[93741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:22:15 devstack sudo[93741]: pam_unix(sudo:session): session closed for user root Sep 15 16:22:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-451042da-857a-49af-b2e6-ad5be9a87a09 tempest-VolumeTypesAccessTest-1866444975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.422s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:22:15 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-451042da-857a-49af-b2e6-ad5be9a87a09 tempest-VolumeTypesAccessTest-1866444975 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:22:15 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-451042da-857a-49af-b2e6-ad5be9a87a09 tempest-VolumeTypesAccessTest-1866444975 None] Deleted volume successfully. Sep 15 16:22:15 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-451042da-857a-49af-b2e6-ad5be9a87a09 tempest-VolumeTypesAccessTest-1866444975 None] Lock "cinder-48b55876-f30f-4ddd-b9f3-575160f1b4e3-delete_volume" released by "delete_volume" :: held 1.518s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:22:17 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-eb4f80ad-2b22-4d16-b3cc-cf8c88e7a932 tempest-AttachVolumeNegativeTest-612785929 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:22:17 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-eb4f80ad-2b22-4d16-b3cc-cf8c88e7a932 tempest-AttachVolumeNegativeTest-612785929 None] Flow 'volume_create_manager' (68d4a45a-ed6e-46ab-849e-2c1ec7f3ec1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:22:17 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-eb4f80ad-2b22-4d16-b3cc-cf8c88e7a932 tempest-AttachVolumeNegativeTest-612785929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3096e459-eb36-49ce-84f2-d421b4691520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:22:17 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-eb4f80ad-2b22-4d16-b3cc-cf8c88e7a932 tempest-AttachVolumeNegativeTest-612785929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3096e459-eb36-49ce-84f2-d421b4691520) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:22:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-294327214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2f57520-c196-4a78-887a-f15e14f925e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef4cf00d20054e2aa09d80608ec2688a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:22:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:22:17Z,use_quota=True,user_id='8fdca69cd06d4561a61b26546e2e803b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:22:17 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-eb4f80ad-2b22-4d16-b3cc-cf8c88e7a932 tempest-AttachVolumeNegativeTest-612785929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6ddd1cb-584e-4455-aff5-2daaf2c68244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:22:17 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-eb4f80ad-2b22-4d16-b3cc-cf8c88e7a932 tempest-AttachVolumeNegativeTest-612785929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6ddd1cb-584e-4455-aff5-2daaf2c68244) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:22:17 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-eb4f80ad-2b22-4d16-b3cc-cf8c88e7a932 tempest-AttachVolumeNegativeTest-612785929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d317dde3-0f2b-43cd-94d0-3c58c17eb800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:22:17 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-eb4f80ad-2b22-4d16-b3cc-cf8c88e7a932 tempest-AttachVolumeNegativeTest-612785929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d317dde3-0f2b-43cd-94d0-3c58c17eb800) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2f57520-c196-4a78-887a-f15e14f925e0', 'volume_name': 'volume-e2f57520-c196-4a78-887a-f15e14f925e0', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:22:17 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-eb4f80ad-2b22-4d16-b3cc-cf8c88e7a932 tempest-AttachVolumeNegativeTest-612785929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cc0f424-a940-49b6-b734-f86e82c516dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:22:17 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-eb4f80ad-2b22-4d16-b3cc-cf8c88e7a932 tempest-AttachVolumeNegativeTest-612785929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cc0f424-a940-49b6-b734-f86e82c516dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:22:17 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-eb4f80ad-2b22-4d16-b3cc-cf8c88e7a932 tempest-AttachVolumeNegativeTest-612785929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb845b6b-a316-4711-9e06-12fc67f70fee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:22:17 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-eb4f80ad-2b22-4d16-b3cc-cf8c88e7a932 tempest-AttachVolumeNegativeTest-612785929 None] Volume e2f57520-c196-4a78-887a-f15e14f925e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2f57520-c196-4a78-887a-f15e14f925e0', 'volume_size': 1} Sep 15 16:22:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-eb4f80ad-2b22-4d16-b3cc-cf8c88e7a932 tempest-AttachVolumeNegativeTest-612785929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:22:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-eb4f80ad-2b22-4d16-b3cc-cf8c88e7a932 tempest-AttachVolumeNegativeTest-612785929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:22:17 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-eb4f80ad-2b22-4d16-b3cc-cf8c88e7a932 tempest-AttachVolumeNegativeTest-612785929 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:22:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-294327214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2f57520-c196-4a78-887a-f15e14f925e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef4cf00d20054e2aa09d80608ec2688a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:22:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:22:17Z,use_quota=True,user_id='8fdca69cd06d4561a61b26546e2e803b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:22:17 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-eb4f80ad-2b22-4d16-b3cc-cf8c88e7a932 tempest-AttachVolumeNegativeTest-612785929 None] Creating volume e2f57520-c196-4a78-887a-f15e14f925e0 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:22:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-eb4f80ad-2b22-4d16-b3cc-cf8c88e7a932 tempest-AttachVolumeNegativeTest-612785929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:22:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-eb4f80ad-2b22-4d16-b3cc-cf8c88e7a932 tempest-AttachVolumeNegativeTest-612785929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:22:17 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-eb4f80ad-2b22-4d16-b3cc-cf8c88e7a932 tempest-AttachVolumeNegativeTest-612785929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:22:17 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-eb4f80ad-2b22-4d16-b3cc-cf8c88e7a932 tempest-AttachVolumeNegativeTest-612785929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:22:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-eb4f80ad-2b22-4d16-b3cc-cf8c88e7a932 tempest-AttachVolumeNegativeTest-612785929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:22:17 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-eb4f80ad-2b22-4d16-b3cc-cf8c88e7a932 tempest-AttachVolumeNegativeTest-612785929 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:22:17 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-eb4f80ad-2b22-4d16-b3cc-cf8c88e7a932 tempest-AttachVolumeNegativeTest-612785929 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:22:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-eb4f80ad-2b22-4d16-b3cc-cf8c88e7a932 tempest-AttachVolumeNegativeTest-612785929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-e2f57520-c196-4a78-887a-f15e14f925e0 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:22:17 devstack sudo[93747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-e2f57520-c196-4a78-887a-f15e14f925e0 1073741824 Sep 15 16:22:17 devstack sudo[93747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:22:18 devstack sudo[93747]: pam_unix(sudo:session): session closed for user root Sep 15 16:22:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-eb4f80ad-2b22-4d16-b3cc-cf8c88e7a932 tempest-AttachVolumeNegativeTest-612785929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-e2f57520-c196-4a78-887a-f15e14f925e0 1073741824" returned: 0 in 0.711s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:22:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-eb4f80ad-2b22-4d16-b3cc-cf8c88e7a932 tempest-AttachVolumeNegativeTest-612785929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-e2f57520-c196-4a78-887a-f15e14f925e0 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:22:18 devstack sudo[93753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-e2f57520-c196-4a78-887a-f15e14f925e0 Sep 15 16:22:18 devstack sudo[93753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:22:18 devstack sudo[93753]: pam_unix(sudo:session): session closed for user root Sep 15 16:22:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-eb4f80ad-2b22-4d16-b3cc-cf8c88e7a932 tempest-AttachVolumeNegativeTest-612785929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-e2f57520-c196-4a78-887a-f15e14f925e0" returned: 0 in 0.350s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:22:18 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-eb4f80ad-2b22-4d16-b3cc-cf8c88e7a932 tempest-AttachVolumeNegativeTest-612785929 None] <== create_volume: return (1162ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:22:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-eb4f80ad-2b22-4d16-b3cc-cf8c88e7a932 tempest-AttachVolumeNegativeTest-612785929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.167s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:22:18 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-eb4f80ad-2b22-4d16-b3cc-cf8c88e7a932 tempest-AttachVolumeNegativeTest-612785929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb845b6b-a316-4711-9e06-12fc67f70fee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2f57520-c196-4a78-887a-f15e14f925e0', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:22:18 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-eb4f80ad-2b22-4d16-b3cc-cf8c88e7a932 tempest-AttachVolumeNegativeTest-612785929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c442b8f-167a-4e33-91df-97d556152c42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:22:18 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-eb4f80ad-2b22-4d16-b3cc-cf8c88e7a932 tempest-AttachVolumeNegativeTest-612785929 None] Volume volume-e2f57520-c196-4a78-887a-f15e14f925e0 (e2f57520-c196-4a78-887a-f15e14f925e0): created successfully Sep 15 16:22:18 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-eb4f80ad-2b22-4d16-b3cc-cf8c88e7a932 tempest-AttachVolumeNegativeTest-612785929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c442b8f-167a-4e33-91df-97d556152c42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:22:18 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-eb4f80ad-2b22-4d16-b3cc-cf8c88e7a932 tempest-AttachVolumeNegativeTest-612785929 None] Flow 'volume_create_manager' (68d4a45a-ed6e-46ab-849e-2c1ec7f3ec1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:22:18 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-eb4f80ad-2b22-4d16-b3cc-cf8c88e7a932 tempest-AttachVolumeNegativeTest-612785929 None] Created volume successfully. Sep 15 16:22:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-97f7ff12-82bb-4f75-8ed4-6204ef7e8e71 req-42f6542f-0bb3-4229-9c9d-d68f387ccecb tempest-AttachVolumeNegativeTest-612785929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:22:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-97f7ff12-82bb-4f75-8ed4-6204ef7e8e71 req-42f6542f-0bb3-4229-9c9d-d68f387ccecb tempest-AttachVolumeNegativeTest-612785929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:22:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-97f7ff12-82bb-4f75-8ed4-6204ef7e8e71 req-42f6542f-0bb3-4229-9c9d-d68f387ccecb tempest-AttachVolumeNegativeTest-612785929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.028s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:22:20 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-97f7ff12-82bb-4f75-8ed4-6204ef7e8e71 req-42f6542f-0bb3-4229-9c9d-d68f387ccecb tempest-AttachVolumeNegativeTest-612785929 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a', 'name': 'volume-e2f57520-c196-4a78-887a-f15e14f925e0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '87e8341b-26b9-4738-a139-34622a027ee5', 'enforce_multipath': True} {{(pid=86082) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 15 16:22:20 devstack cinder-volume[86082]: INFO cinder.volume.manager [req-97f7ff12-82bb-4f75-8ed4-6204ef7e8e71 req-42f6542f-0bb3-4229-9c9d-d68f387ccecb tempest-AttachVolumeNegativeTest-612785929 None] attachment_update completed successfully. Sep 15 16:22:21 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-29f4e05f-8cae-4e2c-a859-4730560dba98 tempest-AbsoluteLimitsTests-352334013 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:22:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-29f4e05f-8cae-4e2c-a859-4730560dba98 tempest-AbsoluteLimitsTests-352334013 None] Flow 'volume_create_manager' (3e96e8e9-9344-4144-981b-5e40b33e6cbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:22:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-29f4e05f-8cae-4e2c-a859-4730560dba98 tempest-AbsoluteLimitsTests-352334013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79af0618-a195-41bb-bebe-a308368f9e74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:22:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-29f4e05f-8cae-4e2c-a859-4730560dba98 tempest-AbsoluteLimitsTests-352334013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79af0618-a195-41bb-bebe-a308368f9e74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:22:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1508230872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05aba1cb-b9c4-4576-8880-dce520ebe52e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c552cbd4b3124e308cd46c240d3e7690',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:22:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:22:22Z,use_quota=True,user_id='ca6230f511bd44f3885b7e58c9e3a16e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:22:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-29f4e05f-8cae-4e2c-a859-4730560dba98 tempest-AbsoluteLimitsTests-352334013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1631e023-a36a-4f9f-b4fa-854ef5bf7620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:22:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-29f4e05f-8cae-4e2c-a859-4730560dba98 tempest-AbsoluteLimitsTests-352334013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1631e023-a36a-4f9f-b4fa-854ef5bf7620) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:22:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-29f4e05f-8cae-4e2c-a859-4730560dba98 tempest-AbsoluteLimitsTests-352334013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19500178-ac95-443c-91f3-3ea1ccdba5c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:22:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-29f4e05f-8cae-4e2c-a859-4730560dba98 tempest-AbsoluteLimitsTests-352334013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19500178-ac95-443c-91f3-3ea1ccdba5c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05aba1cb-b9c4-4576-8880-dce520ebe52e', 'volume_name': 'volume-05aba1cb-b9c4-4576-8880-dce520ebe52e', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:22:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-29f4e05f-8cae-4e2c-a859-4730560dba98 tempest-AbsoluteLimitsTests-352334013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75e35c99-ced3-4257-9475-fe0a31962600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:22:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-29f4e05f-8cae-4e2c-a859-4730560dba98 tempest-AbsoluteLimitsTests-352334013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75e35c99-ced3-4257-9475-fe0a31962600) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:22:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-29f4e05f-8cae-4e2c-a859-4730560dba98 tempest-AbsoluteLimitsTests-352334013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44980f59-abbb-407f-ab95-a9a338f2d95f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:22:21 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-29f4e05f-8cae-4e2c-a859-4730560dba98 tempest-AbsoluteLimitsTests-352334013 None] Volume 05aba1cb-b9c4-4576-8880-dce520ebe52e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05aba1cb-b9c4-4576-8880-dce520ebe52e', 'volume_size': 1} Sep 15 16:22:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-29f4e05f-8cae-4e2c-a859-4730560dba98 tempest-AbsoluteLimitsTests-352334013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:22:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-29f4e05f-8cae-4e2c-a859-4730560dba98 tempest-AbsoluteLimitsTests-352334013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:22:21 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-29f4e05f-8cae-4e2c-a859-4730560dba98 tempest-AbsoluteLimitsTests-352334013 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:22:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1508230872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05aba1cb-b9c4-4576-8880-dce520ebe52e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c552cbd4b3124e308cd46c240d3e7690',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:22:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:22:22Z,use_quota=True,user_id='ca6230f511bd44f3885b7e58c9e3a16e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:22:21 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-29f4e05f-8cae-4e2c-a859-4730560dba98 tempest-AbsoluteLimitsTests-352334013 None] Creating volume 05aba1cb-b9c4-4576-8880-dce520ebe52e {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:22:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-29f4e05f-8cae-4e2c-a859-4730560dba98 tempest-AbsoluteLimitsTests-352334013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:22:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-29f4e05f-8cae-4e2c-a859-4730560dba98 tempest-AbsoluteLimitsTests-352334013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:22:21 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-29f4e05f-8cae-4e2c-a859-4730560dba98 tempest-AbsoluteLimitsTests-352334013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:22:21 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-29f4e05f-8cae-4e2c-a859-4730560dba98 tempest-AbsoluteLimitsTests-352334013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:22:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-29f4e05f-8cae-4e2c-a859-4730560dba98 tempest-AbsoluteLimitsTests-352334013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:22:21 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-29f4e05f-8cae-4e2c-a859-4730560dba98 tempest-AbsoluteLimitsTests-352334013 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:22:21 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-29f4e05f-8cae-4e2c-a859-4730560dba98 tempest-AbsoluteLimitsTests-352334013 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:22:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-29f4e05f-8cae-4e2c-a859-4730560dba98 tempest-AbsoluteLimitsTests-352334013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-05aba1cb-b9c4-4576-8880-dce520ebe52e 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:22:21 devstack sudo[94181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-05aba1cb-b9c4-4576-8880-dce520ebe52e 1073741824 Sep 15 16:22:21 devstack sudo[94181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:22:22 devstack sudo[94181]: pam_unix(sudo:session): session closed for user root Sep 15 16:22:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-29f4e05f-8cae-4e2c-a859-4730560dba98 tempest-AbsoluteLimitsTests-352334013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-05aba1cb-b9c4-4576-8880-dce520ebe52e 1073741824" returned: 0 in 0.667s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:22:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-29f4e05f-8cae-4e2c-a859-4730560dba98 tempest-AbsoluteLimitsTests-352334013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-05aba1cb-b9c4-4576-8880-dce520ebe52e {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:22:22 devstack sudo[94186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-05aba1cb-b9c4-4576-8880-dce520ebe52e Sep 15 16:22:22 devstack sudo[94186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:22:22 devstack sudo[94186]: pam_unix(sudo:session): session closed for user root Sep 15 16:22:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-29f4e05f-8cae-4e2c-a859-4730560dba98 tempest-AbsoluteLimitsTests-352334013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-05aba1cb-b9c4-4576-8880-dce520ebe52e" returned: 0 in 0.334s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:22:22 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-29f4e05f-8cae-4e2c-a859-4730560dba98 tempest-AbsoluteLimitsTests-352334013 None] <== create_volume: return (1061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:22:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-29f4e05f-8cae-4e2c-a859-4730560dba98 tempest-AbsoluteLimitsTests-352334013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.064s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:22:22 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-29f4e05f-8cae-4e2c-a859-4730560dba98 tempest-AbsoluteLimitsTests-352334013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44980f59-abbb-407f-ab95-a9a338f2d95f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05aba1cb-b9c4-4576-8880-dce520ebe52e', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:22:22 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-29f4e05f-8cae-4e2c-a859-4730560dba98 tempest-AbsoluteLimitsTests-352334013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebb3d772-0777-4218-8777-adbf6f7d4462) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:22:22 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-29f4e05f-8cae-4e2c-a859-4730560dba98 tempest-AbsoluteLimitsTests-352334013 None] Volume volume-05aba1cb-b9c4-4576-8880-dce520ebe52e (05aba1cb-b9c4-4576-8880-dce520ebe52e): created successfully Sep 15 16:22:22 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-29f4e05f-8cae-4e2c-a859-4730560dba98 tempest-AbsoluteLimitsTests-352334013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebb3d772-0777-4218-8777-adbf6f7d4462) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:22:22 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-29f4e05f-8cae-4e2c-a859-4730560dba98 tempest-AbsoluteLimitsTests-352334013 None] Flow 'volume_create_manager' (3e96e8e9-9344-4144-981b-5e40b33e6cbe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:22:22 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-29f4e05f-8cae-4e2c-a859-4730560dba98 tempest-AbsoluteLimitsTests-352334013 None] Created volume successfully. Sep 15 16:22:23 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-da3e4dbc-925f-4e0e-b643-fc19a2447614 tempest-AbsoluteLimitsTests-352334013 None] Acquiring lock "cinder-05aba1cb-b9c4-4576-8880-dce520ebe52e-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:22:24 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-da3e4dbc-925f-4e0e-b643-fc19a2447614 tempest-AbsoluteLimitsTests-352334013 None] Lock "cinder-05aba1cb-b9c4-4576-8880-dce520ebe52e-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:22:24 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-da3e4dbc-925f-4e0e-b643-fc19a2447614 tempest-AbsoluteLimitsTests-352334013 None] Acquiring lock "cinder-quobyte-05aba1cb-b9c4-4576-8880-dce520ebe52e" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:22:24 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-da3e4dbc-925f-4e0e-b643-fc19a2447614 tempest-AbsoluteLimitsTests-352334013 None] Lock "cinder-quobyte-05aba1cb-b9c4-4576-8880-dce520ebe52e" acquired by "delete_volume" :: waited 0.015s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:22:24 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf8740f8-272e-4ca7-a94b-e0dcfb7af706]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:22:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-da3e4dbc-925f-4e0e-b643-fc19a2447614 tempest-AbsoluteLimitsTests-352334013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-05aba1cb-b9c4-4576-8880-dce520ebe52e {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:22:24 devstack sudo[94190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-05aba1cb-b9c4-4576-8880-dce520ebe52e Sep 15 16:22:24 devstack sudo[94190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:22:24 devstack sudo[94190]: pam_unix(sudo:session): session closed for user root Sep 15 16:22:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-da3e4dbc-925f-4e0e-b643-fc19a2447614 tempest-AbsoluteLimitsTests-352334013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-05aba1cb-b9c4-4576-8880-dce520ebe52e" returned: 0 in 0.477s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:22:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-da3e4dbc-925f-4e0e-b643-fc19a2447614 tempest-AbsoluteLimitsTests-352334013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-05aba1cb-b9c4-4576-8880-dce520ebe52e {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:22:24 devstack sudo[94195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-05aba1cb-b9c4-4576-8880-dce520ebe52e Sep 15 16:22:24 devstack sudo[94195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:22:24 devstack sudo[94195]: pam_unix(sudo:session): session closed for user root Sep 15 16:22:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-da3e4dbc-925f-4e0e-b643-fc19a2447614 tempest-AbsoluteLimitsTests-352334013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-05aba1cb-b9c4-4576-8880-dce520ebe52e" returned: 0 in 0.295s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:22:24 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-da3e4dbc-925f-4e0e-b643-fc19a2447614 tempest-AbsoluteLimitsTests-352334013 None] Lock "cinder-quobyte-05aba1cb-b9c4-4576-8880-dce520ebe52e" released by "delete_volume" :: held 0.831s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:22:24 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-da3e4dbc-925f-4e0e-b643-fc19a2447614 tempest-AbsoluteLimitsTests-352334013 None] Created reservations ['34e36133-d701-43ca-8b70-5427e5f2ba8f', '64627f7d-5a53-4519-b121-196e2159566a', '3d698bda-a0b2-4c43-b7af-015846622aaf', 'f4b9d102-a021-4bca-9f1a-de315c0f8f5c'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:22:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-da3e4dbc-925f-4e0e-b643-fc19a2447614 tempest-AbsoluteLimitsTests-352334013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:22:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-da3e4dbc-925f-4e0e-b643-fc19a2447614 tempest-AbsoluteLimitsTests-352334013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:22:25 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-da3e4dbc-925f-4e0e-b643-fc19a2447614 tempest-AbsoluteLimitsTests-352334013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:22:25 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-da3e4dbc-925f-4e0e-b643-fc19a2447614 tempest-AbsoluteLimitsTests-352334013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:22:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-da3e4dbc-925f-4e0e-b643-fc19a2447614 tempest-AbsoluteLimitsTests-352334013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:22:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-da3e4dbc-925f-4e0e-b643-fc19a2447614 tempest-AbsoluteLimitsTests-352334013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:22:25 devstack sudo[94198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:22:25 devstack sudo[94198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:22:25 devstack sudo[94198]: pam_unix(sudo:session): session closed for user root Sep 15 16:22:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-da3e4dbc-925f-4e0e-b643-fc19a2447614 tempest-AbsoluteLimitsTests-352334013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.317s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:22:25 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-da3e4dbc-925f-4e0e-b643-fc19a2447614 tempest-AbsoluteLimitsTests-352334013 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:22:25 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-da3e4dbc-925f-4e0e-b643-fc19a2447614 tempest-AbsoluteLimitsTests-352334013 None] Deleted volume successfully. Sep 15 16:22:25 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-da3e4dbc-925f-4e0e-b643-fc19a2447614 tempest-AbsoluteLimitsTests-352334013 None] Lock "cinder-05aba1cb-b9c4-4576-8880-dce520ebe52e-delete_volume" released by "delete_volume" :: held 1.400s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:22:31 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-965730bc-b48e-463c-bfc4-15ed736d8bd3 tempest-VolumesDeleteCascade-122696450 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:22:32 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-965730bc-b48e-463c-bfc4-15ed736d8bd3 tempest-VolumesDeleteCascade-122696450 None] Flow 'volume_create_manager' (1219756f-6883-4cf4-a4cc-7a6e3871a8cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:22:32 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-965730bc-b48e-463c-bfc4-15ed736d8bd3 tempest-VolumesDeleteCascade-122696450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6efa859-1add-4edc-8ecc-54b6f472ea06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:22:32 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-965730bc-b48e-463c-bfc4-15ed736d8bd3 tempest-VolumesDeleteCascade-122696450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6efa859-1add-4edc-8ecc-54b6f472ea06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:22:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-770345039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2aa0024c-7c86-45ef-b58b-62d50bb04ceb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc863f6b48e94cbb98508c3164aef4f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:22:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:22:32Z,use_quota=True,user_id='9b763b7f6a4d4ec1a507466dc055742e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:22:32 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-965730bc-b48e-463c-bfc4-15ed736d8bd3 tempest-VolumesDeleteCascade-122696450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06b94fe1-495f-4184-821a-388c10ec5b19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:22:32 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-965730bc-b48e-463c-bfc4-15ed736d8bd3 tempest-VolumesDeleteCascade-122696450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06b94fe1-495f-4184-821a-388c10ec5b19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:22:32 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-965730bc-b48e-463c-bfc4-15ed736d8bd3 tempest-VolumesDeleteCascade-122696450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a8d27bc-b1e8-4281-a185-f83d81fcc43b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:22:32 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-965730bc-b48e-463c-bfc4-15ed736d8bd3 tempest-VolumesDeleteCascade-122696450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a8d27bc-b1e8-4281-a185-f83d81fcc43b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2aa0024c-7c86-45ef-b58b-62d50bb04ceb', 'volume_name': 'volume-2aa0024c-7c86-45ef-b58b-62d50bb04ceb', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:22:32 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-965730bc-b48e-463c-bfc4-15ed736d8bd3 tempest-VolumesDeleteCascade-122696450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (707269a3-942f-4b67-924c-9d5d4b2d4795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:22:32 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-965730bc-b48e-463c-bfc4-15ed736d8bd3 tempest-VolumesDeleteCascade-122696450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (707269a3-942f-4b67-924c-9d5d4b2d4795) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:22:32 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-965730bc-b48e-463c-bfc4-15ed736d8bd3 tempest-VolumesDeleteCascade-122696450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e766240-c678-4acd-b93b-78396f2ac51a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:22:32 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-965730bc-b48e-463c-bfc4-15ed736d8bd3 tempest-VolumesDeleteCascade-122696450 None] Volume 2aa0024c-7c86-45ef-b58b-62d50bb04ceb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2aa0024c-7c86-45ef-b58b-62d50bb04ceb', 'volume_size': 1} Sep 15 16:22:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-965730bc-b48e-463c-bfc4-15ed736d8bd3 tempest-VolumesDeleteCascade-122696450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:22:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-965730bc-b48e-463c-bfc4-15ed736d8bd3 tempest-VolumesDeleteCascade-122696450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:22:32 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-965730bc-b48e-463c-bfc4-15ed736d8bd3 tempest-VolumesDeleteCascade-122696450 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:22:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-770345039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2aa0024c-7c86-45ef-b58b-62d50bb04ceb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc863f6b48e94cbb98508c3164aef4f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:22:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:22:32Z,use_quota=True,user_id='9b763b7f6a4d4ec1a507466dc055742e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:22:32 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-965730bc-b48e-463c-bfc4-15ed736d8bd3 tempest-VolumesDeleteCascade-122696450 None] Creating volume 2aa0024c-7c86-45ef-b58b-62d50bb04ceb {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:22:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-965730bc-b48e-463c-bfc4-15ed736d8bd3 tempest-VolumesDeleteCascade-122696450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:22:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-965730bc-b48e-463c-bfc4-15ed736d8bd3 tempest-VolumesDeleteCascade-122696450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:22:32 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-965730bc-b48e-463c-bfc4-15ed736d8bd3 tempest-VolumesDeleteCascade-122696450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:22:32 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-965730bc-b48e-463c-bfc4-15ed736d8bd3 tempest-VolumesDeleteCascade-122696450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:22:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-965730bc-b48e-463c-bfc4-15ed736d8bd3 tempest-VolumesDeleteCascade-122696450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:22:32 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-965730bc-b48e-463c-bfc4-15ed736d8bd3 tempest-VolumesDeleteCascade-122696450 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:22:32 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-965730bc-b48e-463c-bfc4-15ed736d8bd3 tempest-VolumesDeleteCascade-122696450 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:22:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-965730bc-b48e-463c-bfc4-15ed736d8bd3 tempest-VolumesDeleteCascade-122696450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2aa0024c-7c86-45ef-b58b-62d50bb04ceb 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:22:32 devstack sudo[94266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2aa0024c-7c86-45ef-b58b-62d50bb04ceb 1073741824 Sep 15 16:22:32 devstack sudo[94266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:22:33 devstack sudo[94266]: pam_unix(sudo:session): session closed for user root Sep 15 16:22:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-965730bc-b48e-463c-bfc4-15ed736d8bd3 tempest-VolumesDeleteCascade-122696450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2aa0024c-7c86-45ef-b58b-62d50bb04ceb 1073741824" returned: 0 in 0.921s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:22:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-965730bc-b48e-463c-bfc4-15ed736d8bd3 tempest-VolumesDeleteCascade-122696450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2aa0024c-7c86-45ef-b58b-62d50bb04ceb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:22:33 devstack sudo[94295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2aa0024c-7c86-45ef-b58b-62d50bb04ceb Sep 15 16:22:33 devstack sudo[94295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:22:33 devstack sudo[94295]: pam_unix(sudo:session): session closed for user root Sep 15 16:22:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-965730bc-b48e-463c-bfc4-15ed736d8bd3 tempest-VolumesDeleteCascade-122696450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2aa0024c-7c86-45ef-b58b-62d50bb04ceb" returned: 0 in 0.624s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:22:33 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-965730bc-b48e-463c-bfc4-15ed736d8bd3 tempest-VolumesDeleteCascade-122696450 None] <== create_volume: return (1661ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:22:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-965730bc-b48e-463c-bfc4-15ed736d8bd3 tempest-VolumesDeleteCascade-122696450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.675s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:22:33 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-965730bc-b48e-463c-bfc4-15ed736d8bd3 tempest-VolumesDeleteCascade-122696450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e766240-c678-4acd-b93b-78396f2ac51a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2aa0024c-7c86-45ef-b58b-62d50bb04ceb', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:22:33 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-965730bc-b48e-463c-bfc4-15ed736d8bd3 tempest-VolumesDeleteCascade-122696450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c1a0d55-c9f6-44c3-8928-702bed91287f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:22:34 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-965730bc-b48e-463c-bfc4-15ed736d8bd3 tempest-VolumesDeleteCascade-122696450 None] Volume volume-2aa0024c-7c86-45ef-b58b-62d50bb04ceb (2aa0024c-7c86-45ef-b58b-62d50bb04ceb): created successfully Sep 15 16:22:34 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-965730bc-b48e-463c-bfc4-15ed736d8bd3 tempest-VolumesDeleteCascade-122696450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c1a0d55-c9f6-44c3-8928-702bed91287f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:22:34 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-965730bc-b48e-463c-bfc4-15ed736d8bd3 tempest-VolumesDeleteCascade-122696450 None] Flow 'volume_create_manager' (1219756f-6883-4cf4-a4cc-7a6e3871a8cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:22:34 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-965730bc-b48e-463c-bfc4-15ed736d8bd3 tempest-VolumesDeleteCascade-122696450 None] Created volume successfully. Sep 15 16:22:35 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-4055e716-19fa-4f60-86d6-28c7b55702cd tempest-VolumesMetadataTest-608731662 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:22:35 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4055e716-19fa-4f60-86d6-28c7b55702cd tempest-VolumesMetadataTest-608731662 None] Flow 'volume_create_manager' (d7cff06b-dc59-47c5-a4e1-ae8a62b999bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:22:35 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4055e716-19fa-4f60-86d6-28c7b55702cd tempest-VolumesMetadataTest-608731662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28208ce6-d7c0-4968-aa78-06d5103cc476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:22:35 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4055e716-19fa-4f60-86d6-28c7b55702cd tempest-VolumesMetadataTest-608731662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28208ce6-d7c0-4968-aa78-06d5103cc476) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:22:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1842539599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af605f11-5890-401a-b88a-d774d25d8e72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5449dd80f7da4acda92a5cf7aa7df721',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:22:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:22:35Z,use_quota=True,user_id='937291c24bd347ce8005682ddb941839',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:22:35 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4055e716-19fa-4f60-86d6-28c7b55702cd tempest-VolumesMetadataTest-608731662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b87dee07-60da-4039-bb97-4276f8f471a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:22:35 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4055e716-19fa-4f60-86d6-28c7b55702cd tempest-VolumesMetadataTest-608731662 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b87dee07-60da-4039-bb97-4276f8f471a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:22:35 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4055e716-19fa-4f60-86d6-28c7b55702cd tempest-VolumesMetadataTest-608731662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1919e824-f19c-4108-9b3b-9a23d278d54c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:22:35 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4055e716-19fa-4f60-86d6-28c7b55702cd tempest-VolumesMetadataTest-608731662 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1919e824-f19c-4108-9b3b-9a23d278d54c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af605f11-5890-401a-b88a-d774d25d8e72', 'volume_name': 'volume-af605f11-5890-401a-b88a-d774d25d8e72', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:22:35 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4055e716-19fa-4f60-86d6-28c7b55702cd tempest-VolumesMetadataTest-608731662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1dfb932-ef96-4bc1-bd91-e66542aea647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:22:35 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4055e716-19fa-4f60-86d6-28c7b55702cd tempest-VolumesMetadataTest-608731662 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1dfb932-ef96-4bc1-bd91-e66542aea647) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:22:35 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4055e716-19fa-4f60-86d6-28c7b55702cd tempest-VolumesMetadataTest-608731662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c472632-05d0-41fc-80ea-af05651fd2b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:22:35 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-4055e716-19fa-4f60-86d6-28c7b55702cd tempest-VolumesMetadataTest-608731662 None] Volume af605f11-5890-401a-b88a-d774d25d8e72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af605f11-5890-401a-b88a-d774d25d8e72', 'volume_size': 1} Sep 15 16:22:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-4055e716-19fa-4f60-86d6-28c7b55702cd tempest-VolumesMetadataTest-608731662 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:22:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-4055e716-19fa-4f60-86d6-28c7b55702cd tempest-VolumesMetadataTest-608731662 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:22:35 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-4055e716-19fa-4f60-86d6-28c7b55702cd tempest-VolumesMetadataTest-608731662 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:22:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1842539599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af605f11-5890-401a-b88a-d774d25d8e72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5449dd80f7da4acda92a5cf7aa7df721',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:22:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:22:35Z,use_quota=True,user_id='937291c24bd347ce8005682ddb941839',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:22:35 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-4055e716-19fa-4f60-86d6-28c7b55702cd tempest-VolumesMetadataTest-608731662 None] Creating volume af605f11-5890-401a-b88a-d774d25d8e72 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:22:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-4055e716-19fa-4f60-86d6-28c7b55702cd tempest-VolumesMetadataTest-608731662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:22:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-4055e716-19fa-4f60-86d6-28c7b55702cd tempest-VolumesMetadataTest-608731662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:22:35 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-4055e716-19fa-4f60-86d6-28c7b55702cd tempest-VolumesMetadataTest-608731662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:22:35 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-4055e716-19fa-4f60-86d6-28c7b55702cd tempest-VolumesMetadataTest-608731662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:22:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-4055e716-19fa-4f60-86d6-28c7b55702cd tempest-VolumesMetadataTest-608731662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:22:35 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-4055e716-19fa-4f60-86d6-28c7b55702cd tempest-VolumesMetadataTest-608731662 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:22:35 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-4055e716-19fa-4f60-86d6-28c7b55702cd tempest-VolumesMetadataTest-608731662 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:22:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4055e716-19fa-4f60-86d6-28c7b55702cd tempest-VolumesMetadataTest-608731662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-af605f11-5890-401a-b88a-d774d25d8e72 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:22:35 devstack sudo[94304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-af605f11-5890-401a-b88a-d774d25d8e72 1073741824 Sep 15 16:22:35 devstack sudo[94304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:22:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-62822672-3375-402b-a378-18d6c6883b9c tempest-VolumesDeleteCascade-122696450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:22:35 devstack sudo[94304]: pam_unix(sudo:session): session closed for user root Sep 15 16:22:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4055e716-19fa-4f60-86d6-28c7b55702cd tempest-VolumesMetadataTest-608731662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-af605f11-5890-401a-b88a-d774d25d8e72 1073741824" returned: 0 in 0.605s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:22:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4055e716-19fa-4f60-86d6-28c7b55702cd tempest-VolumesMetadataTest-608731662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-af605f11-5890-401a-b88a-d774d25d8e72 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:22:35 devstack sudo[94310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-af605f11-5890-401a-b88a-d774d25d8e72 Sep 15 16:22:35 devstack sudo[94310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:22:36 devstack sudo[94310]: pam_unix(sudo:session): session closed for user root Sep 15 16:22:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4055e716-19fa-4f60-86d6-28c7b55702cd tempest-VolumesMetadataTest-608731662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-af605f11-5890-401a-b88a-d774d25d8e72" returned: 0 in 0.335s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:22:36 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-4055e716-19fa-4f60-86d6-28c7b55702cd tempest-VolumesMetadataTest-608731662 None] <== create_volume: return (1012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:22:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-4055e716-19fa-4f60-86d6-28c7b55702cd tempest-VolumesMetadataTest-608731662 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.016s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:22:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-62822672-3375-402b-a378-18d6c6883b9c tempest-VolumesDeleteCascade-122696450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.760s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:22:36 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4055e716-19fa-4f60-86d6-28c7b55702cd tempest-VolumesMetadataTest-608731662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1c472632-05d0-41fc-80ea-af05651fd2b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af605f11-5890-401a-b88a-d774d25d8e72', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:22:36 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4055e716-19fa-4f60-86d6-28c7b55702cd tempest-VolumesMetadataTest-608731662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dd4d739-3722-49c7-bb4b-a058cda28415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:22:36 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-62822672-3375-402b-a378-18d6c6883b9c tempest-VolumesDeleteCascade-122696450 None] Creating offline snapshot b8208326-9854-43c7-8503-b08d604eb53c of volume 2aa0024c-7c86-45ef-b58b-62d50bb04ceb {{(pid=86082) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 15 16:22:36 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-4055e716-19fa-4f60-86d6-28c7b55702cd tempest-VolumesMetadataTest-608731662 None] Volume volume-af605f11-5890-401a-b88a-d774d25d8e72 (af605f11-5890-401a-b88a-d774d25d8e72): created successfully Sep 15 16:22:36 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4055e716-19fa-4f60-86d6-28c7b55702cd tempest-VolumesMetadataTest-608731662 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5dd4d739-3722-49c7-bb4b-a058cda28415) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:22:36 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4055e716-19fa-4f60-86d6-28c7b55702cd tempest-VolumesMetadataTest-608731662 None] Flow 'volume_create_manager' (d7cff06b-dc59-47c5-a4e1-ae8a62b999bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:22:36 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d091433-b678-4685-9a94-6f0b80c7ba6f]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:22:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-62822672-3375-402b-a378-18d6c6883b9c tempest-VolumesDeleteCascade-122696450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2aa0024c-7c86-45ef-b58b-62d50bb04ceb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:22:36 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-4055e716-19fa-4f60-86d6-28c7b55702cd tempest-VolumesMetadataTest-608731662 None] Created volume successfully. Sep 15 16:22:36 devstack sudo[94314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2aa0024c-7c86-45ef-b58b-62d50bb04ceb Sep 15 16:22:36 devstack sudo[94314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:22:36 devstack sudo[94314]: pam_unix(sudo:session): session closed for user root Sep 15 16:22:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-62822672-3375-402b-a378-18d6c6883b9c tempest-VolumesDeleteCascade-122696450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2aa0024c-7c86-45ef-b58b-62d50bb04ceb" returned: 0 in 0.492s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:22:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-62822672-3375-402b-a378-18d6c6883b9c tempest-VolumesDeleteCascade-122696450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2aa0024c-7c86-45ef-b58b-62d50bb04ceb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2aa0024c-7c86-45ef-b58b-62d50bb04ceb.b8208326-9854-43c7-8503-b08d604eb53c 1G {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:22:36 devstack sudo[94321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2aa0024c-7c86-45ef-b58b-62d50bb04ceb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2aa0024c-7c86-45ef-b58b-62d50bb04ceb.b8208326-9854-43c7-8503-b08d604eb53c 1G Sep 15 16:22:36 devstack sudo[94321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:22:37 devstack sudo[94321]: pam_unix(sudo:session): session closed for user root Sep 15 16:22:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-62822672-3375-402b-a378-18d6c6883b9c tempest-VolumesDeleteCascade-122696450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2aa0024c-7c86-45ef-b58b-62d50bb04ceb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2aa0024c-7c86-45ef-b58b-62d50bb04ceb.b8208326-9854-43c7-8503-b08d604eb53c 1G" returned: 0 in 0.817s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:22:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-62822672-3375-402b-a378-18d6c6883b9c tempest-VolumesDeleteCascade-122696450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2aa0024c-7c86-45ef-b58b-62d50bb04ceb -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2aa0024c-7c86-45ef-b58b-62d50bb04ceb.b8208326-9854-43c7-8503-b08d604eb53c {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:22:37 devstack sudo[94328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2aa0024c-7c86-45ef-b58b-62d50bb04ceb -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2aa0024c-7c86-45ef-b58b-62d50bb04ceb.b8208326-9854-43c7-8503-b08d604eb53c Sep 15 16:22:37 devstack sudo[94328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:22:38 devstack sudo[94328]: pam_unix(sudo:session): session closed for user root Sep 15 16:22:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-62822672-3375-402b-a378-18d6c6883b9c tempest-VolumesDeleteCascade-122696450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2aa0024c-7c86-45ef-b58b-62d50bb04ceb -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2aa0024c-7c86-45ef-b58b-62d50bb04ceb.b8208326-9854-43c7-8503-b08d604eb53c" returned: 0 in 0.518s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:22:38 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-62822672-3375-402b-a378-18d6c6883b9c tempest-VolumesDeleteCascade-122696450 None] /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2aa0024c-7c86-45ef-b58b-62d50bb04ceb.b8208326-9854-43c7-8503-b08d604eb53c is being set with open permissions: ugo+rw Sep 15 16:22:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-62822672-3375-402b-a378-18d6c6883b9c tempest-VolumesDeleteCascade-122696450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2aa0024c-7c86-45ef-b58b-62d50bb04ceb.b8208326-9854-43c7-8503-b08d604eb53c {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:22:38 devstack sudo[94334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2aa0024c-7c86-45ef-b58b-62d50bb04ceb.b8208326-9854-43c7-8503-b08d604eb53c Sep 15 16:22:38 devstack sudo[94334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:22:38 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-32e9e9d7-0f06-4a38-b80e-b10634dd4831 tempest-VolumesMetadataTest-608731662 None] Acquiring lock "cinder-af605f11-5890-401a-b88a-d774d25d8e72-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:22:38 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-32e9e9d7-0f06-4a38-b80e-b10634dd4831 tempest-VolumesMetadataTest-608731662 None] Lock "cinder-af605f11-5890-401a-b88a-d774d25d8e72-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:22:38 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-32e9e9d7-0f06-4a38-b80e-b10634dd4831 tempest-VolumesMetadataTest-608731662 None] Acquiring lock "cinder-quobyte-af605f11-5890-401a-b88a-d774d25d8e72" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:22:38 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-32e9e9d7-0f06-4a38-b80e-b10634dd4831 tempest-VolumesMetadataTest-608731662 None] Lock "cinder-quobyte-af605f11-5890-401a-b88a-d774d25d8e72" acquired by "delete_volume" :: waited 0.047s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:22:38 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[2dad994d-cbf9-41ab-9dc0-12583c2b3b54]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:22:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-32e9e9d7-0f06-4a38-b80e-b10634dd4831 tempest-VolumesMetadataTest-608731662 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-af605f11-5890-401a-b88a-d774d25d8e72 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:22:38 devstack sudo[94337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-af605f11-5890-401a-b88a-d774d25d8e72 Sep 15 16:22:38 devstack sudo[94337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:22:38 devstack sudo[94334]: pam_unix(sudo:session): session closed for user root Sep 15 16:22:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-62822672-3375-402b-a378-18d6c6883b9c tempest-VolumesDeleteCascade-122696450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2aa0024c-7c86-45ef-b58b-62d50bb04ceb.b8208326-9854-43c7-8503-b08d604eb53c" returned: 0 in 0.511s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:22:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-62822672-3375-402b-a378-18d6c6883b9c tempest-VolumesDeleteCascade-122696450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2aa0024c-7c86-45ef-b58b-62d50bb04ceb.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:22:38 devstack sudo[94339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2aa0024c-7c86-45ef-b58b-62d50bb04ceb.info Sep 15 16:22:38 devstack sudo[94339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:22:39 devstack sudo[94337]: pam_unix(sudo:session): session closed for user root Sep 15 16:22:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-32e9e9d7-0f06-4a38-b80e-b10634dd4831 tempest-VolumesMetadataTest-608731662 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-af605f11-5890-401a-b88a-d774d25d8e72" returned: 0 in 0.475s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:22:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-32e9e9d7-0f06-4a38-b80e-b10634dd4831 tempest-VolumesMetadataTest-608731662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-af605f11-5890-401a-b88a-d774d25d8e72 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:22:39 devstack sudo[94344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-af605f11-5890-401a-b88a-d774d25d8e72 Sep 15 16:22:39 devstack sudo[94344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:22:39 devstack sudo[94339]: pam_unix(sudo:session): session closed for user root Sep 15 16:22:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-62822672-3375-402b-a378-18d6c6883b9c tempest-VolumesDeleteCascade-122696450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2aa0024c-7c86-45ef-b58b-62d50bb04ceb.info" returned: 0 in 0.441s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:22:39 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-62822672-3375-402b-a378-18d6c6883b9c tempest-VolumesDeleteCascade-122696450 None] /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2aa0024c-7c86-45ef-b58b-62d50bb04ceb.info is being set with open permissions: ugo+rw Sep 15 16:22:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-62822672-3375-402b-a378-18d6c6883b9c tempest-VolumesDeleteCascade-122696450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2aa0024c-7c86-45ef-b58b-62d50bb04ceb.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:22:39 devstack sudo[94347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2aa0024c-7c86-45ef-b58b-62d50bb04ceb.info Sep 15 16:22:39 devstack sudo[94347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:22:39 devstack sudo[94344]: pam_unix(sudo:session): session closed for user root Sep 15 16:22:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-32e9e9d7-0f06-4a38-b80e-b10634dd4831 tempest-VolumesMetadataTest-608731662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-af605f11-5890-401a-b88a-d774d25d8e72" returned: 0 in 0.390s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:22:39 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-32e9e9d7-0f06-4a38-b80e-b10634dd4831 tempest-VolumesMetadataTest-608731662 None] Lock "cinder-quobyte-af605f11-5890-401a-b88a-d774d25d8e72" released by "delete_volume" :: held 0.946s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:22:39 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-32e9e9d7-0f06-4a38-b80e-b10634dd4831 tempest-VolumesMetadataTest-608731662 None] Created reservations ['0f192c7a-09b0-4bed-a58d-58d6fd0d21a1', 'f513a86c-a2da-442e-9b44-73c3fcb12171', 'd366f00b-f6e7-410d-80b5-aa3dccb9324c', '968b8b93-7fde-43b6-88b4-697924f27f6f'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:22:39 devstack sudo[94347]: pam_unix(sudo:session): session closed for user root Sep 15 16:22:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-62822672-3375-402b-a378-18d6c6883b9c tempest-VolumesDeleteCascade-122696450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2aa0024c-7c86-45ef-b58b-62d50bb04ceb.info" returned: 0 in 0.346s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:22:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-62822672-3375-402b-a378-18d6c6883b9c tempest-VolumesDeleteCascade-122696450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.376s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:22:39 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-62822672-3375-402b-a378-18d6c6883b9c tempest-VolumesDeleteCascade-122696450 None] Create snapshot completed successfully Sep 15 16:22:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-32e9e9d7-0f06-4a38-b80e-b10634dd4831 tempest-VolumesMetadataTest-608731662 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:22:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-32e9e9d7-0f06-4a38-b80e-b10634dd4831 tempest-VolumesMetadataTest-608731662 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:22:39 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-32e9e9d7-0f06-4a38-b80e-b10634dd4831 tempest-VolumesMetadataTest-608731662 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:22:39 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-32e9e9d7-0f06-4a38-b80e-b10634dd4831 tempest-VolumesMetadataTest-608731662 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:22:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-32e9e9d7-0f06-4a38-b80e-b10634dd4831 tempest-VolumesMetadataTest-608731662 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:22:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-32e9e9d7-0f06-4a38-b80e-b10634dd4831 tempest-VolumesMetadataTest-608731662 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:22:39 devstack sudo[94351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:22:39 devstack sudo[94351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:22:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-e3b88691-c8b7-456d-b937-285520a50559 tempest-VolumesDeleteCascade-122696450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:22:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-e3b88691-c8b7-456d-b937-285520a50559 tempest-VolumesDeleteCascade-122696450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:22:40 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-e3b88691-c8b7-456d-b937-285520a50559 tempest-VolumesDeleteCascade-122696450 None] Creating offline snapshot 72e33b71-6a93-4208-b675-6493e6c5fe99 of volume 2aa0024c-7c86-45ef-b58b-62d50bb04ceb {{(pid=86082) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 15 16:22:40 devstack sudo[94351]: pam_unix(sudo:session): session closed for user root Sep 15 16:22:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-32e9e9d7-0f06-4a38-b80e-b10634dd4831 tempest-VolumesMetadataTest-608731662 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.504s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:22:40 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-32e9e9d7-0f06-4a38-b80e-b10634dd4831 tempest-VolumesMetadataTest-608731662 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:22:40 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-32e9e9d7-0f06-4a38-b80e-b10634dd4831 tempest-VolumesMetadataTest-608731662 None] Deleted volume successfully. Sep 15 16:22:40 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[505c9677-754d-4fbe-baf8-6c3232759e2e]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:22:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e3b88691-c8b7-456d-b937-285520a50559 tempest-VolumesDeleteCascade-122696450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2aa0024c-7c86-45ef-b58b-62d50bb04ceb.b8208326-9854-43c7-8503-b08d604eb53c {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:22:40 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-32e9e9d7-0f06-4a38-b80e-b10634dd4831 tempest-VolumesMetadataTest-608731662 None] Lock "cinder-af605f11-5890-401a-b88a-d774d25d8e72-delete_volume" released by "delete_volume" :: held 1.870s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:22:40 devstack sudo[94354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2aa0024c-7c86-45ef-b58b-62d50bb04ceb.b8208326-9854-43c7-8503-b08d604eb53c Sep 15 16:22:40 devstack sudo[94354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:22:40 devstack sudo[94354]: pam_unix(sudo:session): session closed for user root Sep 15 16:22:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e3b88691-c8b7-456d-b937-285520a50559 tempest-VolumesDeleteCascade-122696450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2aa0024c-7c86-45ef-b58b-62d50bb04ceb.b8208326-9854-43c7-8503-b08d604eb53c" returned: 0 in 0.551s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:22:40 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-e3b88691-c8b7-456d-b937-285520a50559 tempest-VolumesDeleteCascade-122696450 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2aa0024c-7c86-45ef-b58b-62d50bb04ceb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 16:22:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e3b88691-c8b7-456d-b937-285520a50559 tempest-VolumesDeleteCascade-122696450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2aa0024c-7c86-45ef-b58b-62d50bb04ceb.b8208326-9854-43c7-8503-b08d604eb53c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2aa0024c-7c86-45ef-b58b-62d50bb04ceb.72e33b71-6a93-4208-b675-6493e6c5fe99 1G {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:22:40 devstack sudo[94360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2aa0024c-7c86-45ef-b58b-62d50bb04ceb.b8208326-9854-43c7-8503-b08d604eb53c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2aa0024c-7c86-45ef-b58b-62d50bb04ceb.72e33b71-6a93-4208-b675-6493e6c5fe99 1G Sep 15 16:22:40 devstack sudo[94360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:22:41 devstack sudo[94360]: pam_unix(sudo:session): session closed for user root Sep 15 16:22:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e3b88691-c8b7-456d-b937-285520a50559 tempest-VolumesDeleteCascade-122696450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2aa0024c-7c86-45ef-b58b-62d50bb04ceb.b8208326-9854-43c7-8503-b08d604eb53c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2aa0024c-7c86-45ef-b58b-62d50bb04ceb.72e33b71-6a93-4208-b675-6493e6c5fe99 1G" returned: 0 in 0.775s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:22:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e3b88691-c8b7-456d-b937-285520a50559 tempest-VolumesDeleteCascade-122696450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2aa0024c-7c86-45ef-b58b-62d50bb04ceb.b8208326-9854-43c7-8503-b08d604eb53c -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2aa0024c-7c86-45ef-b58b-62d50bb04ceb.72e33b71-6a93-4208-b675-6493e6c5fe99 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:22:41 devstack sudo[94401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2aa0024c-7c86-45ef-b58b-62d50bb04ceb.b8208326-9854-43c7-8503-b08d604eb53c -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2aa0024c-7c86-45ef-b58b-62d50bb04ceb.72e33b71-6a93-4208-b675-6493e6c5fe99 Sep 15 16:22:41 devstack sudo[94401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:22:41 devstack sudo[94401]: pam_unix(sudo:session): session closed for user root Sep 15 16:22:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e3b88691-c8b7-456d-b937-285520a50559 tempest-VolumesDeleteCascade-122696450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2aa0024c-7c86-45ef-b58b-62d50bb04ceb.b8208326-9854-43c7-8503-b08d604eb53c -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2aa0024c-7c86-45ef-b58b-62d50bb04ceb.72e33b71-6a93-4208-b675-6493e6c5fe99" returned: 0 in 0.387s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:22:41 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-e3b88691-c8b7-456d-b937-285520a50559 tempest-VolumesDeleteCascade-122696450 None] /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2aa0024c-7c86-45ef-b58b-62d50bb04ceb.72e33b71-6a93-4208-b675-6493e6c5fe99 is being set with open permissions: ugo+rw Sep 15 16:22:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e3b88691-c8b7-456d-b937-285520a50559 tempest-VolumesDeleteCascade-122696450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2aa0024c-7c86-45ef-b58b-62d50bb04ceb.72e33b71-6a93-4208-b675-6493e6c5fe99 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:22:42 devstack sudo[94411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2aa0024c-7c86-45ef-b58b-62d50bb04ceb.72e33b71-6a93-4208-b675-6493e6c5fe99 Sep 15 16:22:42 devstack sudo[94411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:22:42 devstack sudo[94411]: pam_unix(sudo:session): session closed for user root Sep 15 16:22:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e3b88691-c8b7-456d-b937-285520a50559 tempest-VolumesDeleteCascade-122696450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2aa0024c-7c86-45ef-b58b-62d50bb04ceb.72e33b71-6a93-4208-b675-6493e6c5fe99" returned: 0 in 0.524s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:22:42 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:SELECT=82,cinder:UPDATE=101,cinder:INSERT=26,cinder:DELETE=5 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 16:22:42 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:UPDATE=109,cinder:SELECT=83,cinder:DELETE=15,cinder:INSERT=22 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 16:22:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-e3b88691-c8b7-456d-b937-285520a50559 tempest-VolumesDeleteCascade-122696450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.424s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:22:42 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-e3b88691-c8b7-456d-b937-285520a50559 tempest-VolumesDeleteCascade-122696450 None] Create snapshot completed successfully Sep 15 16:22:43 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-4afb58af-6b26-4f8b-8ce5-d8fa58d5c816 tempest-VolumesDeleteCascade-122696450 None] Acquiring lock "cinder-2aa0024c-7c86-45ef-b58b-62d50bb04ceb-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:22:43 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-4afb58af-6b26-4f8b-8ce5-d8fa58d5c816 tempest-VolumesDeleteCascade-122696450 None] Lock "cinder-2aa0024c-7c86-45ef-b58b-62d50bb04ceb-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:22:43 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4afb58af-6b26-4f8b-8ce5-d8fa58d5c816 tempest-VolumesDeleteCascade-122696450 None] Performing cascade delete. {{(pid=86082) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 15 16:22:43 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-4afb58af-6b26-4f8b-8ce5-d8fa58d5c816 tempest-VolumesDeleteCascade-122696450 None] Acquiring lock "cinder-72e33b71-6a93-4208-b675-6493e6c5fe99-delete_snapshot" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:22:43 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-4afb58af-6b26-4f8b-8ce5-d8fa58d5c816 tempest-VolumesDeleteCascade-122696450 None] Lock "cinder-72e33b71-6a93-4208-b675-6493e6c5fe99-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:22:43 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-4afb58af-6b26-4f8b-8ce5-d8fa58d5c816 tempest-VolumesDeleteCascade-122696450 None] Acquiring lock "cinder-quobyte-2aa0024c-7c86-45ef-b58b-62d50bb04ceb" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:22:43 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-4afb58af-6b26-4f8b-8ce5-d8fa58d5c816 tempest-VolumesDeleteCascade-122696450 None] Lock "cinder-quobyte-2aa0024c-7c86-45ef-b58b-62d50bb04ceb" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:22:43 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-4afb58af-6b26-4f8b-8ce5-d8fa58d5c816 tempest-VolumesDeleteCascade-122696450 None] Acquiring lock "cinder-quobyte-72e33b71-6a93-4208-b675-6493e6c5fe99" by "_delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:22:43 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-4afb58af-6b26-4f8b-8ce5-d8fa58d5c816 tempest-VolumesDeleteCascade-122696450 None] Lock "cinder-quobyte-72e33b71-6a93-4208-b675-6493e6c5fe99" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:22:43 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-4afb58af-6b26-4f8b-8ce5-d8fa58d5c816 tempest-VolumesDeleteCascade-122696450 None] Deleting offline snapshot 72e33b71-6a93-4208-b675-6493e6c5fe99 of volume 2aa0024c-7c86-45ef-b58b-62d50bb04ceb {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 15 16:22:43 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-4afb58af-6b26-4f8b-8ce5-d8fa58d5c816 tempest-VolumesDeleteCascade-122696450 None] snapshot_file for this snap is: volume-2aa0024c-7c86-45ef-b58b-62d50bb04ceb.72e33b71-6a93-4208-b675-6493e6c5fe99 {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 15 16:22:43 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[357ecf74-fcb5-41f4-b10c-cc6b20254a49]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:22:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4afb58af-6b26-4f8b-8ce5-d8fa58d5c816 tempest-VolumesDeleteCascade-122696450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2aa0024c-7c86-45ef-b58b-62d50bb04ceb.72e33b71-6a93-4208-b675-6493e6c5fe99 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:22:43 devstack sudo[94418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2aa0024c-7c86-45ef-b58b-62d50bb04ceb.72e33b71-6a93-4208-b675-6493e6c5fe99 Sep 15 16:22:43 devstack sudo[94418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:22:44 devstack sudo[94418]: pam_unix(sudo:session): session closed for user root Sep 15 16:22:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4afb58af-6b26-4f8b-8ce5-d8fa58d5c816 tempest-VolumesDeleteCascade-122696450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2aa0024c-7c86-45ef-b58b-62d50bb04ceb.72e33b71-6a93-4208-b675-6493e6c5fe99" returned: 0 in 0.550s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:22:44 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-4afb58af-6b26-4f8b-8ce5-d8fa58d5c816 tempest-VolumesDeleteCascade-122696450 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2aa0024c-7c86-45ef-b58b-62d50bb04ceb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 16:22:44 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab455292-8d9c-44f7-9d30-1483cabef2b5]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:22:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4afb58af-6b26-4f8b-8ce5-d8fa58d5c816 tempest-VolumesDeleteCascade-122696450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2aa0024c-7c86-45ef-b58b-62d50bb04ceb.b8208326-9854-43c7-8503-b08d604eb53c {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:22:44 devstack sudo[94423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2aa0024c-7c86-45ef-b58b-62d50bb04ceb.b8208326-9854-43c7-8503-b08d604eb53c Sep 15 16:22:44 devstack sudo[94423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:22:45 devstack sudo[94423]: pam_unix(sudo:session): session closed for user root Sep 15 16:22:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4afb58af-6b26-4f8b-8ce5-d8fa58d5c816 tempest-VolumesDeleteCascade-122696450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2aa0024c-7c86-45ef-b58b-62d50bb04ceb.b8208326-9854-43c7-8503-b08d604eb53c" returned: 0 in 0.715s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:22:45 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-4afb58af-6b26-4f8b-8ce5-d8fa58d5c816 tempest-VolumesDeleteCascade-122696450 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2aa0024c-7c86-45ef-b58b-62d50bb04ceb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 16:22:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4afb58af-6b26-4f8b-8ce5-d8fa58d5c816 tempest-VolumesDeleteCascade-122696450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2aa0024c-7c86-45ef-b58b-62d50bb04ceb.72e33b71-6a93-4208-b675-6493e6c5fe99 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:22:45 devstack sudo[94437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2aa0024c-7c86-45ef-b58b-62d50bb04ceb.72e33b71-6a93-4208-b675-6493e6c5fe99 Sep 15 16:22:45 devstack sudo[94437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:22:45 devstack sudo[94437]: pam_unix(sudo:session): session closed for user root Sep 15 16:22:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4afb58af-6b26-4f8b-8ce5-d8fa58d5c816 tempest-VolumesDeleteCascade-122696450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2aa0024c-7c86-45ef-b58b-62d50bb04ceb.72e33b71-6a93-4208-b675-6493e6c5fe99" returned: 0 in 0.616s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:22:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4afb58af-6b26-4f8b-8ce5-d8fa58d5c816 tempest-VolumesDeleteCascade-122696450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2aa0024c-7c86-45ef-b58b-62d50bb04ceb.72e33b71-6a93-4208-b675-6493e6c5fe99 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:22:45 devstack sudo[94448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2aa0024c-7c86-45ef-b58b-62d50bb04ceb.72e33b71-6a93-4208-b675-6493e6c5fe99 Sep 15 16:22:45 devstack sudo[94448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:22:46 devstack sudo[94448]: pam_unix(sudo:session): session closed for user root Sep 15 16:22:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4afb58af-6b26-4f8b-8ce5-d8fa58d5c816 tempest-VolumesDeleteCascade-122696450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2aa0024c-7c86-45ef-b58b-62d50bb04ceb.72e33b71-6a93-4208-b675-6493e6c5fe99" returned: 0 in 0.364s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:22:46 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-4afb58af-6b26-4f8b-8ce5-d8fa58d5c816 tempest-VolumesDeleteCascade-122696450 None] Lock "cinder-quobyte-72e33b71-6a93-4208-b675-6493e6c5fe99" released by "_delete_snapshot" :: held 2.415s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:22:46 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-4afb58af-6b26-4f8b-8ce5-d8fa58d5c816 tempest-VolumesDeleteCascade-122696450 None] Lock "cinder-quobyte-2aa0024c-7c86-45ef-b58b-62d50bb04ceb" released by "delete_snapshot" :: held 2.462s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:22:46 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-4afb58af-6b26-4f8b-8ce5-d8fa58d5c816 tempest-VolumesDeleteCascade-122696450 None] Created reservations ['75900bcc-5a43-4283-8138-886ee82aceeb', 'c626c91f-aef2-4473-a3ff-35ea735ce717', '4b1d0047-9305-4d78-a690-85565a7c050d', '100c8f76-df39-4dc0-bf33-5d6abe79f072'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:22:46 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-4afb58af-6b26-4f8b-8ce5-d8fa58d5c816 tempest-VolumesDeleteCascade-122696450 None] Delete snapshot completed successfully. Sep 15 16:22:46 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-4afb58af-6b26-4f8b-8ce5-d8fa58d5c816 tempest-VolumesDeleteCascade-122696450 None] Lock "cinder-72e33b71-6a93-4208-b675-6493e6c5fe99-delete_snapshot" released by "delete_snapshot" :: held 2.748s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:22:46 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-4afb58af-6b26-4f8b-8ce5-d8fa58d5c816 tempest-VolumesDeleteCascade-122696450 None] Acquiring lock "cinder-b8208326-9854-43c7-8503-b08d604eb53c-delete_snapshot" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:22:46 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-4afb58af-6b26-4f8b-8ce5-d8fa58d5c816 tempest-VolumesDeleteCascade-122696450 None] Lock "cinder-b8208326-9854-43c7-8503-b08d604eb53c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:22:46 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-4afb58af-6b26-4f8b-8ce5-d8fa58d5c816 tempest-VolumesDeleteCascade-122696450 None] Acquiring lock "cinder-quobyte-2aa0024c-7c86-45ef-b58b-62d50bb04ceb" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:22:46 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-4afb58af-6b26-4f8b-8ce5-d8fa58d5c816 tempest-VolumesDeleteCascade-122696450 None] Lock "cinder-quobyte-2aa0024c-7c86-45ef-b58b-62d50bb04ceb" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:22:46 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-4afb58af-6b26-4f8b-8ce5-d8fa58d5c816 tempest-VolumesDeleteCascade-122696450 None] Acquiring lock "cinder-quobyte-b8208326-9854-43c7-8503-b08d604eb53c" by "_delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:22:46 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-4afb58af-6b26-4f8b-8ce5-d8fa58d5c816 tempest-VolumesDeleteCascade-122696450 None] Lock "cinder-quobyte-b8208326-9854-43c7-8503-b08d604eb53c" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:22:46 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-4afb58af-6b26-4f8b-8ce5-d8fa58d5c816 tempest-VolumesDeleteCascade-122696450 None] Deleting offline snapshot b8208326-9854-43c7-8503-b08d604eb53c of volume 2aa0024c-7c86-45ef-b58b-62d50bb04ceb {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 15 16:22:46 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-4afb58af-6b26-4f8b-8ce5-d8fa58d5c816 tempest-VolumesDeleteCascade-122696450 None] snapshot_file for this snap is: volume-2aa0024c-7c86-45ef-b58b-62d50bb04ceb.b8208326-9854-43c7-8503-b08d604eb53c {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 15 16:22:46 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad0d2308-fb5a-438f-8dad-03b4c9292ed7]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:22:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4afb58af-6b26-4f8b-8ce5-d8fa58d5c816 tempest-VolumesDeleteCascade-122696450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2aa0024c-7c86-45ef-b58b-62d50bb04ceb.b8208326-9854-43c7-8503-b08d604eb53c {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:22:46 devstack sudo[94475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2aa0024c-7c86-45ef-b58b-62d50bb04ceb.b8208326-9854-43c7-8503-b08d604eb53c Sep 15 16:22:46 devstack sudo[94475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:22:47 devstack sudo[94475]: pam_unix(sudo:session): session closed for user root Sep 15 16:22:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4afb58af-6b26-4f8b-8ce5-d8fa58d5c816 tempest-VolumesDeleteCascade-122696450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2aa0024c-7c86-45ef-b58b-62d50bb04ceb.b8208326-9854-43c7-8503-b08d604eb53c" returned: 0 in 0.597s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:22:47 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-4afb58af-6b26-4f8b-8ce5-d8fa58d5c816 tempest-VolumesDeleteCascade-122696450 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2aa0024c-7c86-45ef-b58b-62d50bb04ceb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 16:22:47 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[026fc9b5-2980-4a34-8ce1-945d76e68566]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:22:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4afb58af-6b26-4f8b-8ce5-d8fa58d5c816 tempest-VolumesDeleteCascade-122696450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2aa0024c-7c86-45ef-b58b-62d50bb04ceb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:22:47 devstack sudo[94480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2aa0024c-7c86-45ef-b58b-62d50bb04ceb Sep 15 16:22:47 devstack sudo[94480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:22:47 devstack sudo[94480]: pam_unix(sudo:session): session closed for user root Sep 15 16:22:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4afb58af-6b26-4f8b-8ce5-d8fa58d5c816 tempest-VolumesDeleteCascade-122696450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2aa0024c-7c86-45ef-b58b-62d50bb04ceb" returned: 0 in 0.444s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:22:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4afb58af-6b26-4f8b-8ce5-d8fa58d5c816 tempest-VolumesDeleteCascade-122696450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2aa0024c-7c86-45ef-b58b-62d50bb04ceb.b8208326-9854-43c7-8503-b08d604eb53c {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:22:47 devstack sudo[94486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2aa0024c-7c86-45ef-b58b-62d50bb04ceb.b8208326-9854-43c7-8503-b08d604eb53c Sep 15 16:22:47 devstack sudo[94486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:22:48 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-d50160df-b65a-4eb2-be7e-5b6d38800619 tempest-VolumesTransfersV357Test-2009975127 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:22:48 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-d50160df-b65a-4eb2-be7e-5b6d38800619 tempest-VolumesTransfersV357Test-2009975127 None] Flow 'volume_create_manager' (9d8a6f6f-0df3-4831-ba2e-e9c9beafe6d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:22:48 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-d50160df-b65a-4eb2-be7e-5b6d38800619 tempest-VolumesTransfersV357Test-2009975127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4c99cba-a5e7-4af5-aafa-69ec0fe250db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:22:48 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-d50160df-b65a-4eb2-be7e-5b6d38800619 tempest-VolumesTransfersV357Test-2009975127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f4c99cba-a5e7-4af5-aafa-69ec0fe250db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:22:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1481142182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2773fabe-0fdc-49b8-87b5-ff38e794cf36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4dcf52be5e44ac9bf26a8f40fb80967',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:22:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:22:48Z,use_quota=True,user_id='276ba4a28ccf4b7a874b9e1f0559668d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:22:48 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-d50160df-b65a-4eb2-be7e-5b6d38800619 tempest-VolumesTransfersV357Test-2009975127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22350a55-30d9-4cab-91dd-e4dec685aba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:22:48 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-d50160df-b65a-4eb2-be7e-5b6d38800619 tempest-VolumesTransfersV357Test-2009975127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22350a55-30d9-4cab-91dd-e4dec685aba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:22:48 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-d50160df-b65a-4eb2-be7e-5b6d38800619 tempest-VolumesTransfersV357Test-2009975127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (605f0837-3294-4ef9-8b65-3ed275e39583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:22:48 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-d50160df-b65a-4eb2-be7e-5b6d38800619 tempest-VolumesTransfersV357Test-2009975127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (605f0837-3294-4ef9-8b65-3ed275e39583) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2773fabe-0fdc-49b8-87b5-ff38e794cf36', 'volume_name': 'volume-2773fabe-0fdc-49b8-87b5-ff38e794cf36', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:22:48 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-d50160df-b65a-4eb2-be7e-5b6d38800619 tempest-VolumesTransfersV357Test-2009975127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (532d4c4b-ca11-4d28-af53-b1a5e251af7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:22:48 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-d50160df-b65a-4eb2-be7e-5b6d38800619 tempest-VolumesTransfersV357Test-2009975127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (532d4c4b-ca11-4d28-af53-b1a5e251af7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:22:48 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-d50160df-b65a-4eb2-be7e-5b6d38800619 tempest-VolumesTransfersV357Test-2009975127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afd8cec1-8478-4534-905c-b72dd0005e16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:22:48 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-d50160df-b65a-4eb2-be7e-5b6d38800619 tempest-VolumesTransfersV357Test-2009975127 None] Volume 2773fabe-0fdc-49b8-87b5-ff38e794cf36: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2773fabe-0fdc-49b8-87b5-ff38e794cf36', 'volume_size': 1} Sep 15 16:22:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-d50160df-b65a-4eb2-be7e-5b6d38800619 tempest-VolumesTransfersV357Test-2009975127 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:22:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-d50160df-b65a-4eb2-be7e-5b6d38800619 tempest-VolumesTransfersV357Test-2009975127 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:22:48 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-d50160df-b65a-4eb2-be7e-5b6d38800619 tempest-VolumesTransfersV357Test-2009975127 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:22:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1481142182',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2773fabe-0fdc-49b8-87b5-ff38e794cf36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4dcf52be5e44ac9bf26a8f40fb80967',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:22:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:22:48Z,use_quota=True,user_id='276ba4a28ccf4b7a874b9e1f0559668d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:22:48 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-d50160df-b65a-4eb2-be7e-5b6d38800619 tempest-VolumesTransfersV357Test-2009975127 None] Creating volume 2773fabe-0fdc-49b8-87b5-ff38e794cf36 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:22:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-d50160df-b65a-4eb2-be7e-5b6d38800619 tempest-VolumesTransfersV357Test-2009975127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:22:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-d50160df-b65a-4eb2-be7e-5b6d38800619 tempest-VolumesTransfersV357Test-2009975127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:22:48 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-d50160df-b65a-4eb2-be7e-5b6d38800619 tempest-VolumesTransfersV357Test-2009975127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:22:48 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-d50160df-b65a-4eb2-be7e-5b6d38800619 tempest-VolumesTransfersV357Test-2009975127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:22:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-d50160df-b65a-4eb2-be7e-5b6d38800619 tempest-VolumesTransfersV357Test-2009975127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:22:48 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-d50160df-b65a-4eb2-be7e-5b6d38800619 tempest-VolumesTransfersV357Test-2009975127 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:22:48 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-d50160df-b65a-4eb2-be7e-5b6d38800619 tempest-VolumesTransfersV357Test-2009975127 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:22:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d50160df-b65a-4eb2-be7e-5b6d38800619 tempest-VolumesTransfersV357Test-2009975127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2773fabe-0fdc-49b8-87b5-ff38e794cf36 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:22:48 devstack sudo[94486]: pam_unix(sudo:session): session closed for user root Sep 15 16:22:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4afb58af-6b26-4f8b-8ce5-d8fa58d5c816 tempest-VolumesDeleteCascade-122696450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2aa0024c-7c86-45ef-b58b-62d50bb04ceb.b8208326-9854-43c7-8503-b08d604eb53c" returned: 0 in 0.449s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:22:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4afb58af-6b26-4f8b-8ce5-d8fa58d5c816 tempest-VolumesDeleteCascade-122696450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2aa0024c-7c86-45ef-b58b-62d50bb04ceb.b8208326-9854-43c7-8503-b08d604eb53c {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:22:48 devstack sudo[94491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2773fabe-0fdc-49b8-87b5-ff38e794cf36 1073741824 Sep 15 16:22:48 devstack sudo[94491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:22:48 devstack sudo[94492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2aa0024c-7c86-45ef-b58b-62d50bb04ceb.b8208326-9854-43c7-8503-b08d604eb53c Sep 15 16:22:48 devstack sudo[94492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:22:48 devstack sudo[94492]: pam_unix(sudo:session): session closed for user root Sep 15 16:22:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4afb58af-6b26-4f8b-8ce5-d8fa58d5c816 tempest-VolumesDeleteCascade-122696450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2aa0024c-7c86-45ef-b58b-62d50bb04ceb.b8208326-9854-43c7-8503-b08d604eb53c" returned: 0 in 0.405s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:22:48 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-4afb58af-6b26-4f8b-8ce5-d8fa58d5c816 tempest-VolumesDeleteCascade-122696450 None] Lock "cinder-quobyte-b8208326-9854-43c7-8503-b08d604eb53c" released by "_delete_snapshot" :: held 2.100s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:22:48 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-4afb58af-6b26-4f8b-8ce5-d8fa58d5c816 tempest-VolumesDeleteCascade-122696450 None] Lock "cinder-quobyte-2aa0024c-7c86-45ef-b58b-62d50bb04ceb" released by "delete_snapshot" :: held 2.162s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:22:48 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-4afb58af-6b26-4f8b-8ce5-d8fa58d5c816 tempest-VolumesDeleteCascade-122696450 None] Created reservations ['3fcd8e97-c8a9-49ed-a50a-8b7bd64ab906', '0e9ec8cb-b277-401b-a2fa-3dabe6a6972c', 'eecaf77e-9406-44c9-b6d1-138fd3f99915', '34a19325-ed6e-47d7-b4c6-eeb12be36ece'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:22:48 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-4afb58af-6b26-4f8b-8ce5-d8fa58d5c816 tempest-VolumesDeleteCascade-122696450 None] Delete snapshot completed successfully. Sep 15 16:22:48 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-4afb58af-6b26-4f8b-8ce5-d8fa58d5c816 tempest-VolumesDeleteCascade-122696450 None] Lock "cinder-b8208326-9854-43c7-8503-b08d604eb53c-delete_snapshot" released by "delete_snapshot" :: held 2.559s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:22:48 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4afb58af-6b26-4f8b-8ce5-d8fa58d5c816 tempest-VolumesDeleteCascade-122696450 None] Snapshots deleted, issuing volume delete {{(pid=86082) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 15 16:22:48 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-4afb58af-6b26-4f8b-8ce5-d8fa58d5c816 tempest-VolumesDeleteCascade-122696450 None] Acquiring lock "cinder-quobyte-2aa0024c-7c86-45ef-b58b-62d50bb04ceb" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:22:49 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-4afb58af-6b26-4f8b-8ce5-d8fa58d5c816 tempest-VolumesDeleteCascade-122696450 None] Lock "cinder-quobyte-2aa0024c-7c86-45ef-b58b-62d50bb04ceb" acquired by "delete_volume" :: waited 0.046s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:22:49 devstack sudo[94491]: pam_unix(sudo:session): session closed for user root Sep 15 16:22:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d50160df-b65a-4eb2-be7e-5b6d38800619 tempest-VolumesTransfersV357Test-2009975127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2773fabe-0fdc-49b8-87b5-ff38e794cf36 1073741824" returned: 0 in 0.979s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:22:49 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f0ff0e6-11e3-4873-9920-b4e51b48d219]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:22:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4afb58af-6b26-4f8b-8ce5-d8fa58d5c816 tempest-VolumesDeleteCascade-122696450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2aa0024c-7c86-45ef-b58b-62d50bb04ceb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:22:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d50160df-b65a-4eb2-be7e-5b6d38800619 tempest-VolumesTransfersV357Test-2009975127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2773fabe-0fdc-49b8-87b5-ff38e794cf36 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:22:49 devstack sudo[94558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2773fabe-0fdc-49b8-87b5-ff38e794cf36 Sep 15 16:22:49 devstack sudo[94558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:22:49 devstack sudo[94555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2aa0024c-7c86-45ef-b58b-62d50bb04ceb Sep 15 16:22:49 devstack sudo[94555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:22:49 devstack sudo[94558]: pam_unix(sudo:session): session closed for user root Sep 15 16:22:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d50160df-b65a-4eb2-be7e-5b6d38800619 tempest-VolumesTransfersV357Test-2009975127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2773fabe-0fdc-49b8-87b5-ff38e794cf36" returned: 0 in 0.461s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:22:49 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-d50160df-b65a-4eb2-be7e-5b6d38800619 tempest-VolumesTransfersV357Test-2009975127 None] <== create_volume: return (1605ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:22:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-d50160df-b65a-4eb2-be7e-5b6d38800619 tempest-VolumesTransfersV357Test-2009975127 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.608s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:22:49 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-d50160df-b65a-4eb2-be7e-5b6d38800619 tempest-VolumesTransfersV357Test-2009975127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afd8cec1-8478-4534-905c-b72dd0005e16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2773fabe-0fdc-49b8-87b5-ff38e794cf36', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:22:49 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-d50160df-b65a-4eb2-be7e-5b6d38800619 tempest-VolumesTransfersV357Test-2009975127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af2d27cd-28d6-4bcc-b192-e0a38f71cb80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:22:49 devstack sudo[94555]: pam_unix(sudo:session): session closed for user root Sep 15 16:22:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4afb58af-6b26-4f8b-8ce5-d8fa58d5c816 tempest-VolumesDeleteCascade-122696450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2aa0024c-7c86-45ef-b58b-62d50bb04ceb" returned: 0 in 0.628s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:22:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4afb58af-6b26-4f8b-8ce5-d8fa58d5c816 tempest-VolumesDeleteCascade-122696450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2aa0024c-7c86-45ef-b58b-62d50bb04ceb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:22:49 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-d50160df-b65a-4eb2-be7e-5b6d38800619 tempest-VolumesTransfersV357Test-2009975127 None] Volume volume-2773fabe-0fdc-49b8-87b5-ff38e794cf36 (2773fabe-0fdc-49b8-87b5-ff38e794cf36): created successfully Sep 15 16:22:49 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-d50160df-b65a-4eb2-be7e-5b6d38800619 tempest-VolumesTransfersV357Test-2009975127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af2d27cd-28d6-4bcc-b192-e0a38f71cb80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:22:49 devstack sudo[94572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2aa0024c-7c86-45ef-b58b-62d50bb04ceb Sep 15 16:22:49 devstack sudo[94572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:22:49 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-d50160df-b65a-4eb2-be7e-5b6d38800619 tempest-VolumesTransfersV357Test-2009975127 None] Flow 'volume_create_manager' (9d8a6f6f-0df3-4831-ba2e-e9c9beafe6d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:22:49 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-d50160df-b65a-4eb2-be7e-5b6d38800619 tempest-VolumesTransfersV357Test-2009975127 None] Created volume successfully. Sep 15 16:22:50 devstack sudo[94572]: pam_unix(sudo:session): session closed for user root Sep 15 16:22:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4afb58af-6b26-4f8b-8ce5-d8fa58d5c816 tempest-VolumesDeleteCascade-122696450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2aa0024c-7c86-45ef-b58b-62d50bb04ceb" returned: 0 in 0.345s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:22:50 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-4afb58af-6b26-4f8b-8ce5-d8fa58d5c816 tempest-VolumesDeleteCascade-122696450 None] Lock "cinder-quobyte-2aa0024c-7c86-45ef-b58b-62d50bb04ceb" released by "delete_volume" :: held 1.137s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:22:50 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-4afb58af-6b26-4f8b-8ce5-d8fa58d5c816 tempest-VolumesDeleteCascade-122696450 None] Created reservations ['8ac4a416-5dea-47d8-89e3-721e169fbf48', '91f4cc8f-2578-4faf-ac5b-f7d9340afb74', 'ff4d429d-5ff1-43fc-a615-e6c52c8a1380', 'f548be25-abad-4e43-8d8a-bb7882607aca'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:22:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-4afb58af-6b26-4f8b-8ce5-d8fa58d5c816 tempest-VolumesDeleteCascade-122696450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:22:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-4afb58af-6b26-4f8b-8ce5-d8fa58d5c816 tempest-VolumesDeleteCascade-122696450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:22:50 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-4afb58af-6b26-4f8b-8ce5-d8fa58d5c816 tempest-VolumesDeleteCascade-122696450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:22:50 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-4afb58af-6b26-4f8b-8ce5-d8fa58d5c816 tempest-VolumesDeleteCascade-122696450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:22:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-4afb58af-6b26-4f8b-8ce5-d8fa58d5c816 tempest-VolumesDeleteCascade-122696450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:22:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4afb58af-6b26-4f8b-8ce5-d8fa58d5c816 tempest-VolumesDeleteCascade-122696450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:22:50 devstack sudo[94578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:22:50 devstack sudo[94578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:22:50 devstack sudo[94578]: pam_unix(sudo:session): session closed for user root Sep 15 16:22:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4afb58af-6b26-4f8b-8ce5-d8fa58d5c816 tempest-VolumesDeleteCascade-122696450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.355s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:22:50 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-4afb58af-6b26-4f8b-8ce5-d8fa58d5c816 tempest-VolumesDeleteCascade-122696450 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:22:50 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-4afb58af-6b26-4f8b-8ce5-d8fa58d5c816 tempest-VolumesDeleteCascade-122696450 None] Deleted volume successfully. Sep 15 16:22:50 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-4afb58af-6b26-4f8b-8ce5-d8fa58d5c816 tempest-VolumesDeleteCascade-122696450 None] Lock "cinder-2aa0024c-7c86-45ef-b58b-62d50bb04ceb-delete_volume" released by "delete_volume" :: held 7.260s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:22:51 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-0a53ad9d-c251-4a51-9e77-56cd82b1d9f3 tempest-VolumesTransfersV357Test-551629479 None] Transfer volume completed successfully. Sep 15 16:22:52 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f7961bc7-cc78-4c71-803f-ed1452e00941 tempest-VolumesTransfersV357Test-1061686192 None] Acquiring lock "cinder-2773fabe-0fdc-49b8-87b5-ff38e794cf36-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:22:52 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f7961bc7-cc78-4c71-803f-ed1452e00941 tempest-VolumesTransfersV357Test-1061686192 None] Lock "cinder-2773fabe-0fdc-49b8-87b5-ff38e794cf36-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:22:52 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f7961bc7-cc78-4c71-803f-ed1452e00941 tempest-VolumesTransfersV357Test-1061686192 None] Acquiring lock "cinder-quobyte-2773fabe-0fdc-49b8-87b5-ff38e794cf36" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:22:52 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f7961bc7-cc78-4c71-803f-ed1452e00941 tempest-VolumesTransfersV357Test-1061686192 None] Lock "cinder-quobyte-2773fabe-0fdc-49b8-87b5-ff38e794cf36" acquired by "delete_volume" :: waited 0.037s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:22:52 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e70d458-1a83-465a-b294-cdbc401a4c20]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:22:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f7961bc7-cc78-4c71-803f-ed1452e00941 tempest-VolumesTransfersV357Test-1061686192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2773fabe-0fdc-49b8-87b5-ff38e794cf36 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:22:52 devstack sudo[94582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2773fabe-0fdc-49b8-87b5-ff38e794cf36 Sep 15 16:22:52 devstack sudo[94582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:22:52 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-f20ab3c7-0540-4289-9d5d-c0898f1edf6e tempest-VolumesDeleteCascade-122696450 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:22:52 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f20ab3c7-0540-4289-9d5d-c0898f1edf6e tempest-VolumesDeleteCascade-122696450 None] Flow 'volume_create_manager' (cacfd9bd-1a8f-4b56-b8c2-8699a105f5c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:22:52 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f20ab3c7-0540-4289-9d5d-c0898f1edf6e tempest-VolumesDeleteCascade-122696450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad763a22-b5c1-48fc-b47a-a9fdb12ca486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:22:52 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f20ab3c7-0540-4289-9d5d-c0898f1edf6e tempest-VolumesDeleteCascade-122696450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad763a22-b5c1-48fc-b47a-a9fdb12ca486) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:22:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1254433295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bb88568-04ca-4656-8258-cc15dc319565,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc863f6b48e94cbb98508c3164aef4f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:22:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:22:53Z,use_quota=True,user_id='9b763b7f6a4d4ec1a507466dc055742e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:22:52 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f20ab3c7-0540-4289-9d5d-c0898f1edf6e tempest-VolumesDeleteCascade-122696450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87bb2578-0b27-48e6-b751-2ac7105cb28a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:22:52 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f20ab3c7-0540-4289-9d5d-c0898f1edf6e tempest-VolumesDeleteCascade-122696450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87bb2578-0b27-48e6-b751-2ac7105cb28a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:22:52 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f20ab3c7-0540-4289-9d5d-c0898f1edf6e tempest-VolumesDeleteCascade-122696450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1aa06470-d57f-412e-ad26-fe9d6adc1606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:22:52 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f20ab3c7-0540-4289-9d5d-c0898f1edf6e tempest-VolumesDeleteCascade-122696450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1aa06470-d57f-412e-ad26-fe9d6adc1606) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6bb88568-04ca-4656-8258-cc15dc319565', 'volume_name': 'volume-6bb88568-04ca-4656-8258-cc15dc319565', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:22:52 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f20ab3c7-0540-4289-9d5d-c0898f1edf6e tempest-VolumesDeleteCascade-122696450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49d6e547-9db6-419f-b98f-763e29077244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:22:52 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f20ab3c7-0540-4289-9d5d-c0898f1edf6e tempest-VolumesDeleteCascade-122696450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49d6e547-9db6-419f-b98f-763e29077244) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:22:52 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f20ab3c7-0540-4289-9d5d-c0898f1edf6e tempest-VolumesDeleteCascade-122696450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d65d3c50-cd1c-4a0e-bec8-56dc0f2c0152) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:22:52 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-f20ab3c7-0540-4289-9d5d-c0898f1edf6e tempest-VolumesDeleteCascade-122696450 None] Volume 6bb88568-04ca-4656-8258-cc15dc319565: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6bb88568-04ca-4656-8258-cc15dc319565', 'volume_size': 1} Sep 15 16:22:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f20ab3c7-0540-4289-9d5d-c0898f1edf6e tempest-VolumesDeleteCascade-122696450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:22:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f20ab3c7-0540-4289-9d5d-c0898f1edf6e tempest-VolumesDeleteCascade-122696450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:22:52 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-f20ab3c7-0540-4289-9d5d-c0898f1edf6e tempest-VolumesDeleteCascade-122696450 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:22:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1254433295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bb88568-04ca-4656-8258-cc15dc319565,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc863f6b48e94cbb98508c3164aef4f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:22:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:22:53Z,use_quota=True,user_id='9b763b7f6a4d4ec1a507466dc055742e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:22:52 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-f20ab3c7-0540-4289-9d5d-c0898f1edf6e tempest-VolumesDeleteCascade-122696450 None] Creating volume 6bb88568-04ca-4656-8258-cc15dc319565 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:22:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f20ab3c7-0540-4289-9d5d-c0898f1edf6e tempest-VolumesDeleteCascade-122696450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:22:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f20ab3c7-0540-4289-9d5d-c0898f1edf6e tempest-VolumesDeleteCascade-122696450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:22:52 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-f20ab3c7-0540-4289-9d5d-c0898f1edf6e tempest-VolumesDeleteCascade-122696450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:22:52 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-f20ab3c7-0540-4289-9d5d-c0898f1edf6e tempest-VolumesDeleteCascade-122696450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:22:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f20ab3c7-0540-4289-9d5d-c0898f1edf6e tempest-VolumesDeleteCascade-122696450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:22:52 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-f20ab3c7-0540-4289-9d5d-c0898f1edf6e tempest-VolumesDeleteCascade-122696450 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:22:52 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-f20ab3c7-0540-4289-9d5d-c0898f1edf6e tempest-VolumesDeleteCascade-122696450 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:22:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f20ab3c7-0540-4289-9d5d-c0898f1edf6e tempest-VolumesDeleteCascade-122696450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6bb88568-04ca-4656-8258-cc15dc319565 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:22:52 devstack sudo[94588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6bb88568-04ca-4656-8258-cc15dc319565 1073741824 Sep 15 16:22:52 devstack sudo[94588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:22:52 devstack sudo[94582]: pam_unix(sudo:session): session closed for user root Sep 15 16:22:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f7961bc7-cc78-4c71-803f-ed1452e00941 tempest-VolumesTransfersV357Test-1061686192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2773fabe-0fdc-49b8-87b5-ff38e794cf36" returned: 0 in 0.575s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:22:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f7961bc7-cc78-4c71-803f-ed1452e00941 tempest-VolumesTransfersV357Test-1061686192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2773fabe-0fdc-49b8-87b5-ff38e794cf36 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:22:52 devstack sudo[94590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2773fabe-0fdc-49b8-87b5-ff38e794cf36 Sep 15 16:22:52 devstack sudo[94590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:22:53 devstack sudo[94590]: pam_unix(sudo:session): session closed for user root Sep 15 16:22:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f7961bc7-cc78-4c71-803f-ed1452e00941 tempest-VolumesTransfersV357Test-1061686192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2773fabe-0fdc-49b8-87b5-ff38e794cf36" returned: 0 in 0.287s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:22:53 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f7961bc7-cc78-4c71-803f-ed1452e00941 tempest-VolumesTransfersV357Test-1061686192 None] Lock "cinder-quobyte-2773fabe-0fdc-49b8-87b5-ff38e794cf36" released by "delete_volume" :: held 0.933s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:22:53 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-f7961bc7-cc78-4c71-803f-ed1452e00941 tempest-VolumesTransfersV357Test-1061686192 None] Created reservations ['7932b7b8-48cc-44f5-8cbc-de71eba07d1d', '85742734-e197-448c-adac-d05bfbc555fa', '416c19a8-da85-49fa-bd6f-c0cb873974e0', '49a03708-33dc-4400-a3fa-d3e6fea3bf74'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:22:53 devstack sudo[94588]: pam_unix(sudo:session): session closed for user root Sep 15 16:22:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f20ab3c7-0540-4289-9d5d-c0898f1edf6e tempest-VolumesDeleteCascade-122696450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6bb88568-04ca-4656-8258-cc15dc319565 1073741824" returned: 0 in 0.555s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:22:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f7961bc7-cc78-4c71-803f-ed1452e00941 tempest-VolumesTransfersV357Test-1061686192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:22:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f7961bc7-cc78-4c71-803f-ed1452e00941 tempest-VolumesTransfersV357Test-1061686192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:22:53 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-f7961bc7-cc78-4c71-803f-ed1452e00941 tempest-VolumesTransfersV357Test-1061686192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:22:53 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-f7961bc7-cc78-4c71-803f-ed1452e00941 tempest-VolumesTransfersV357Test-1061686192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:22:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f7961bc7-cc78-4c71-803f-ed1452e00941 tempest-VolumesTransfersV357Test-1061686192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:22:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f7961bc7-cc78-4c71-803f-ed1452e00941 tempest-VolumesTransfersV357Test-1061686192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:22:53 devstack sudo[94597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:22:53 devstack sudo[94597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:22:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f20ab3c7-0540-4289-9d5d-c0898f1edf6e tempest-VolumesDeleteCascade-122696450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6bb88568-04ca-4656-8258-cc15dc319565 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:22:53 devstack sudo[94599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6bb88568-04ca-4656-8258-cc15dc319565 Sep 15 16:22:53 devstack sudo[94599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:22:53 devstack sudo[94597]: pam_unix(sudo:session): session closed for user root Sep 15 16:22:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f7961bc7-cc78-4c71-803f-ed1452e00941 tempest-VolumesTransfersV357Test-1061686192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.335s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:22:53 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-f7961bc7-cc78-4c71-803f-ed1452e00941 tempest-VolumesTransfersV357Test-1061686192 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:22:53 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-f7961bc7-cc78-4c71-803f-ed1452e00941 tempest-VolumesTransfersV357Test-1061686192 None] Deleted volume successfully. Sep 15 16:22:53 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f7961bc7-cc78-4c71-803f-ed1452e00941 tempest-VolumesTransfersV357Test-1061686192 None] Lock "cinder-2773fabe-0fdc-49b8-87b5-ff38e794cf36-delete_volume" released by "delete_volume" :: held 1.652s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:22:53 devstack sudo[94599]: pam_unix(sudo:session): session closed for user root Sep 15 16:22:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f20ab3c7-0540-4289-9d5d-c0898f1edf6e tempest-VolumesDeleteCascade-122696450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6bb88568-04ca-4656-8258-cc15dc319565" returned: 0 in 0.357s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:22:53 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-f20ab3c7-0540-4289-9d5d-c0898f1edf6e tempest-VolumesDeleteCascade-122696450 None] <== create_volume: return (1021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:22:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f20ab3c7-0540-4289-9d5d-c0898f1edf6e tempest-VolumesDeleteCascade-122696450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.024s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:22:53 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f20ab3c7-0540-4289-9d5d-c0898f1edf6e tempest-VolumesDeleteCascade-122696450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d65d3c50-cd1c-4a0e-bec8-56dc0f2c0152) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6bb88568-04ca-4656-8258-cc15dc319565', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:22:53 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f20ab3c7-0540-4289-9d5d-c0898f1edf6e tempest-VolumesDeleteCascade-122696450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9ef2742-98b3-4ffd-89c8-9f5ea56aa67c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:22:53 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-f20ab3c7-0540-4289-9d5d-c0898f1edf6e tempest-VolumesDeleteCascade-122696450 None] Volume volume-6bb88568-04ca-4656-8258-cc15dc319565 (6bb88568-04ca-4656-8258-cc15dc319565): created successfully Sep 15 16:22:53 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f20ab3c7-0540-4289-9d5d-c0898f1edf6e tempest-VolumesDeleteCascade-122696450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9ef2742-98b3-4ffd-89c8-9f5ea56aa67c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:22:53 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f20ab3c7-0540-4289-9d5d-c0898f1edf6e tempest-VolumesDeleteCascade-122696450 None] Flow 'volume_create_manager' (cacfd9bd-1a8f-4b56-b8c2-8699a105f5c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:22:53 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-f20ab3c7-0540-4289-9d5d-c0898f1edf6e tempest-VolumesDeleteCascade-122696450 None] Created volume successfully. Sep 15 16:22:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-48cdb1bb-0539-4e04-bd83-800fb0154717 tempest-VolumesDeleteCascade-122696450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:22:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-48cdb1bb-0539-4e04-bd83-800fb0154717 tempest-VolumesDeleteCascade-122696450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:22:55 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-48cdb1bb-0539-4e04-bd83-800fb0154717 tempest-VolumesDeleteCascade-122696450 None] Creating offline snapshot a32b0d32-af1e-4623-9648-dddf177492ae of volume 6bb88568-04ca-4656-8258-cc15dc319565 {{(pid=86082) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 15 16:22:55 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb0a3861-69f1-4860-8f15-22dfd9c870ce tempest-VolumesTransfersV357Test-2009975127 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:22:55 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-fb0a3861-69f1-4860-8f15-22dfd9c870ce tempest-VolumesTransfersV357Test-2009975127 None] Flow 'volume_create_manager' (bc2ff412-4371-434f-829a-697684c5bdbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:22:55 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-fb0a3861-69f1-4860-8f15-22dfd9c870ce tempest-VolumesTransfersV357Test-2009975127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66130f7d-0f96-4433-8a4b-781c70ec3e1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:22:55 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[28ade0fd-2b61-4783-a698-901236ebdd6b]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:22:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-48cdb1bb-0539-4e04-bd83-800fb0154717 tempest-VolumesDeleteCascade-122696450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6bb88568-04ca-4656-8258-cc15dc319565 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:22:55 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-fb0a3861-69f1-4860-8f15-22dfd9c870ce tempest-VolumesTransfersV357Test-2009975127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66130f7d-0f96-4433-8a4b-781c70ec3e1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:22:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1878387537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2641d21e-10fa-4bf7-ab8c-2d764d500a56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4dcf52be5e44ac9bf26a8f40fb80967',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:22:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:22:55Z,use_quota=True,user_id='276ba4a28ccf4b7a874b9e1f0559668d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:22:55 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-fb0a3861-69f1-4860-8f15-22dfd9c870ce tempest-VolumesTransfersV357Test-2009975127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d8cf127-448d-4ec4-b83e-0601b38a7777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:22:55 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-fb0a3861-69f1-4860-8f15-22dfd9c870ce tempest-VolumesTransfersV357Test-2009975127 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d8cf127-448d-4ec4-b83e-0601b38a7777) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:22:55 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-fb0a3861-69f1-4860-8f15-22dfd9c870ce tempest-VolumesTransfersV357Test-2009975127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d165a42-43a8-4c5d-87ba-64a1bdeaf2ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:22:55 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-fb0a3861-69f1-4860-8f15-22dfd9c870ce tempest-VolumesTransfersV357Test-2009975127 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d165a42-43a8-4c5d-87ba-64a1bdeaf2ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2641d21e-10fa-4bf7-ab8c-2d764d500a56', 'volume_name': 'volume-2641d21e-10fa-4bf7-ab8c-2d764d500a56', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:22:55 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-fb0a3861-69f1-4860-8f15-22dfd9c870ce tempest-VolumesTransfersV357Test-2009975127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cde78a4-4a12-4853-ae68-f69c80e37bf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:22:55 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-fb0a3861-69f1-4860-8f15-22dfd9c870ce tempest-VolumesTransfersV357Test-2009975127 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cde78a4-4a12-4853-ae68-f69c80e37bf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:22:55 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-fb0a3861-69f1-4860-8f15-22dfd9c870ce tempest-VolumesTransfersV357Test-2009975127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b660558d-f066-4e70-a5f9-b89a9f25d811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:22:55 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-fb0a3861-69f1-4860-8f15-22dfd9c870ce tempest-VolumesTransfersV357Test-2009975127 None] Volume 2641d21e-10fa-4bf7-ab8c-2d764d500a56: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2641d21e-10fa-4bf7-ab8c-2d764d500a56', 'volume_size': 1} Sep 15 16:22:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-fb0a3861-69f1-4860-8f15-22dfd9c870ce tempest-VolumesTransfersV357Test-2009975127 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:22:55 devstack sudo[94604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6bb88568-04ca-4656-8258-cc15dc319565 Sep 15 16:22:55 devstack sudo[94604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:22:55 devstack sudo[94604]: pam_unix(sudo:session): session closed for user root Sep 15 16:22:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-48cdb1bb-0539-4e04-bd83-800fb0154717 tempest-VolumesDeleteCascade-122696450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6bb88568-04ca-4656-8258-cc15dc319565" returned: 0 in 0.379s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:22:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-48cdb1bb-0539-4e04-bd83-800fb0154717 tempest-VolumesDeleteCascade-122696450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6bb88568-04ca-4656-8258-cc15dc319565,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6bb88568-04ca-4656-8258-cc15dc319565.a32b0d32-af1e-4623-9648-dddf177492ae 1G {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:22:55 devstack sudo[94609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6bb88568-04ca-4656-8258-cc15dc319565,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6bb88568-04ca-4656-8258-cc15dc319565.a32b0d32-af1e-4623-9648-dddf177492ae 1G Sep 15 16:22:55 devstack sudo[94609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:22:56 devstack sudo[94609]: pam_unix(sudo:session): session closed for user root Sep 15 16:22:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-48cdb1bb-0539-4e04-bd83-800fb0154717 tempest-VolumesDeleteCascade-122696450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6bb88568-04ca-4656-8258-cc15dc319565,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6bb88568-04ca-4656-8258-cc15dc319565.a32b0d32-af1e-4623-9648-dddf177492ae 1G" returned: 0 in 0.482s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:22:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-48cdb1bb-0539-4e04-bd83-800fb0154717 tempest-VolumesDeleteCascade-122696450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6bb88568-04ca-4656-8258-cc15dc319565 -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6bb88568-04ca-4656-8258-cc15dc319565.a32b0d32-af1e-4623-9648-dddf177492ae {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:22:56 devstack sudo[94615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6bb88568-04ca-4656-8258-cc15dc319565 -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6bb88568-04ca-4656-8258-cc15dc319565.a32b0d32-af1e-4623-9648-dddf177492ae Sep 15 16:22:56 devstack sudo[94615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:22:56 devstack sudo[94615]: pam_unix(sudo:session): session closed for user root Sep 15 16:22:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-48cdb1bb-0539-4e04-bd83-800fb0154717 tempest-VolumesDeleteCascade-122696450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6bb88568-04ca-4656-8258-cc15dc319565 -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6bb88568-04ca-4656-8258-cc15dc319565.a32b0d32-af1e-4623-9648-dddf177492ae" returned: 0 in 0.364s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:22:56 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-48cdb1bb-0539-4e04-bd83-800fb0154717 tempest-VolumesDeleteCascade-122696450 None] /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6bb88568-04ca-4656-8258-cc15dc319565.a32b0d32-af1e-4623-9648-dddf177492ae is being set with open permissions: ugo+rw Sep 15 16:22:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-48cdb1bb-0539-4e04-bd83-800fb0154717 tempest-VolumesDeleteCascade-122696450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6bb88568-04ca-4656-8258-cc15dc319565.a32b0d32-af1e-4623-9648-dddf177492ae {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:22:56 devstack sudo[94621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6bb88568-04ca-4656-8258-cc15dc319565.a32b0d32-af1e-4623-9648-dddf177492ae Sep 15 16:22:56 devstack sudo[94621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:22:56 devstack sudo[94621]: pam_unix(sudo:session): session closed for user root Sep 15 16:22:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-48cdb1bb-0539-4e04-bd83-800fb0154717 tempest-VolumesDeleteCascade-122696450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6bb88568-04ca-4656-8258-cc15dc319565.a32b0d32-af1e-4623-9648-dddf177492ae" returned: 0 in 0.278s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:22:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-48cdb1bb-0539-4e04-bd83-800fb0154717 tempest-VolumesDeleteCascade-122696450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6bb88568-04ca-4656-8258-cc15dc319565.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:22:56 devstack sudo[94624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6bb88568-04ca-4656-8258-cc15dc319565.info Sep 15 16:22:56 devstack sudo[94624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:22:57 devstack sudo[94624]: pam_unix(sudo:session): session closed for user root Sep 15 16:22:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-48cdb1bb-0539-4e04-bd83-800fb0154717 tempest-VolumesDeleteCascade-122696450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6bb88568-04ca-4656-8258-cc15dc319565.info" returned: 0 in 0.254s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:22:57 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-48cdb1bb-0539-4e04-bd83-800fb0154717 tempest-VolumesDeleteCascade-122696450 None] /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6bb88568-04ca-4656-8258-cc15dc319565.info is being set with open permissions: ugo+rw Sep 15 16:22:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-48cdb1bb-0539-4e04-bd83-800fb0154717 tempest-VolumesDeleteCascade-122696450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6bb88568-04ca-4656-8258-cc15dc319565.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:22:57 devstack sudo[94627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6bb88568-04ca-4656-8258-cc15dc319565.info Sep 15 16:22:57 devstack sudo[94627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:22:57 devstack sudo[94627]: pam_unix(sudo:session): session closed for user root Sep 15 16:22:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-48cdb1bb-0539-4e04-bd83-800fb0154717 tempest-VolumesDeleteCascade-122696450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6bb88568-04ca-4656-8258-cc15dc319565.info" returned: 0 in 0.283s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:22:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-48cdb1bb-0539-4e04-bd83-800fb0154717 tempest-VolumesDeleteCascade-122696450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.175s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:22:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-fb0a3861-69f1-4860-8f15-22dfd9c870ce tempest-VolumesTransfersV357Test-2009975127 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.041s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:22:57 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-fb0a3861-69f1-4860-8f15-22dfd9c870ce tempest-VolumesTransfersV357Test-2009975127 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:22:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1878387537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2641d21e-10fa-4bf7-ab8c-2d764d500a56,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4dcf52be5e44ac9bf26a8f40fb80967',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:22:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:22:55Z,use_quota=True,user_id='276ba4a28ccf4b7a874b9e1f0559668d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:22:57 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-fb0a3861-69f1-4860-8f15-22dfd9c870ce tempest-VolumesTransfersV357Test-2009975127 None] Creating volume 2641d21e-10fa-4bf7-ab8c-2d764d500a56 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:22:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-fb0a3861-69f1-4860-8f15-22dfd9c870ce tempest-VolumesTransfersV357Test-2009975127 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:22:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-fb0a3861-69f1-4860-8f15-22dfd9c870ce tempest-VolumesTransfersV357Test-2009975127 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:22:57 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-fb0a3861-69f1-4860-8f15-22dfd9c870ce tempest-VolumesTransfersV357Test-2009975127 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:22:57 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-fb0a3861-69f1-4860-8f15-22dfd9c870ce tempest-VolumesTransfersV357Test-2009975127 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:22:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-fb0a3861-69f1-4860-8f15-22dfd9c870ce tempest-VolumesTransfersV357Test-2009975127 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:22:57 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-fb0a3861-69f1-4860-8f15-22dfd9c870ce tempest-VolumesTransfersV357Test-2009975127 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:22:57 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-fb0a3861-69f1-4860-8f15-22dfd9c870ce tempest-VolumesTransfersV357Test-2009975127 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:22:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-fb0a3861-69f1-4860-8f15-22dfd9c870ce tempest-VolumesTransfersV357Test-2009975127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2641d21e-10fa-4bf7-ab8c-2d764d500a56 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:22:57 devstack sudo[94630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2641d21e-10fa-4bf7-ab8c-2d764d500a56 1073741824 Sep 15 16:22:57 devstack sudo[94630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:22:57 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-48cdb1bb-0539-4e04-bd83-800fb0154717 tempest-VolumesDeleteCascade-122696450 None] Create snapshot completed successfully Sep 15 16:22:57 devstack sudo[94630]: pam_unix(sudo:session): session closed for user root Sep 15 16:22:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-fb0a3861-69f1-4860-8f15-22dfd9c870ce tempest-VolumesTransfersV357Test-2009975127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2641d21e-10fa-4bf7-ab8c-2d764d500a56 1073741824" returned: 0 in 0.564s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:22:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-fb0a3861-69f1-4860-8f15-22dfd9c870ce tempest-VolumesTransfersV357Test-2009975127 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2641d21e-10fa-4bf7-ab8c-2d764d500a56 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:22:58 devstack sudo[94639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2641d21e-10fa-4bf7-ab8c-2d764d500a56 Sep 15 16:22:58 devstack sudo[94639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:22:58 devstack sudo[94639]: pam_unix(sudo:session): session closed for user root Sep 15 16:22:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-fb0a3861-69f1-4860-8f15-22dfd9c870ce tempest-VolumesTransfersV357Test-2009975127 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2641d21e-10fa-4bf7-ab8c-2d764d500a56" returned: 0 in 0.415s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:22:58 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-fb0a3861-69f1-4860-8f15-22dfd9c870ce tempest-VolumesTransfersV357Test-2009975127 None] <== create_volume: return (1047ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:22:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-fb0a3861-69f1-4860-8f15-22dfd9c870ce tempest-VolumesTransfersV357Test-2009975127 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.070s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:22:58 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-fb0a3861-69f1-4860-8f15-22dfd9c870ce tempest-VolumesTransfersV357Test-2009975127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b660558d-f066-4e70-a5f9-b89a9f25d811) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2641d21e-10fa-4bf7-ab8c-2d764d500a56', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:22:58 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-fb0a3861-69f1-4860-8f15-22dfd9c870ce tempest-VolumesTransfersV357Test-2009975127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab82abd0-9e19-4eea-9a75-dd3728f44dee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:22:58 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-fb0a3861-69f1-4860-8f15-22dfd9c870ce tempest-VolumesTransfersV357Test-2009975127 None] Volume volume-2641d21e-10fa-4bf7-ab8c-2d764d500a56 (2641d21e-10fa-4bf7-ab8c-2d764d500a56): created successfully Sep 15 16:22:58 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-fb0a3861-69f1-4860-8f15-22dfd9c870ce tempest-VolumesTransfersV357Test-2009975127 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab82abd0-9e19-4eea-9a75-dd3728f44dee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:22:58 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-fb0a3861-69f1-4860-8f15-22dfd9c870ce tempest-VolumesTransfersV357Test-2009975127 None] Flow 'volume_create_manager' (bc2ff412-4371-434f-829a-697684c5bdbe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:22:58 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-fb0a3861-69f1-4860-8f15-22dfd9c870ce tempest-VolumesTransfersV357Test-2009975127 None] Created volume successfully. Sep 15 16:22:59 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa038bcd-73bd-41d9-b995-c39f932fc1bb tempest-VolumesDeleteCascade-122696450 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:22:59 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-aa038bcd-73bd-41d9-b995-c39f932fc1bb tempest-VolumesDeleteCascade-122696450 None] Flow 'volume_create_manager' (4df50b8e-155e-47cc-a823-7f351544da45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:22:59 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-aa038bcd-73bd-41d9-b995-c39f932fc1bb tempest-VolumesDeleteCascade-122696450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2bc0c02-1456-42bb-9c79-63af55454b5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:22:59 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-aa038bcd-73bd-41d9-b995-c39f932fc1bb tempest-VolumesDeleteCascade-122696450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2bc0c02-1456-42bb-9c79-63af55454b5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:22:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-226251149',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ed1ddcc-1b46-4604-a66d-e5cb1cfeb1f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc863f6b48e94cbb98508c3164aef4f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:22:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a32b0d32-af1e-4623-9648-dddf177492ae,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:22:59Z,use_quota=True,user_id='9b763b7f6a4d4ec1a507466dc055742e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:22:59 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-aa038bcd-73bd-41d9-b995-c39f932fc1bb tempest-VolumesDeleteCascade-122696450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee250e6e-8664-41d9-be54-3016d916f176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:22:59 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-aa038bcd-73bd-41d9-b995-c39f932fc1bb tempest-VolumesDeleteCascade-122696450 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee250e6e-8664-41d9-be54-3016d916f176) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:22:59 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-aa038bcd-73bd-41d9-b995-c39f932fc1bb tempest-VolumesDeleteCascade-122696450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34745466-7a5e-4a1f-b528-ae1c3cc69ea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:22:59 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-aa038bcd-73bd-41d9-b995-c39f932fc1bb tempest-VolumesDeleteCascade-122696450 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34745466-7a5e-4a1f-b528-ae1c3cc69ea1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '5ed1ddcc-1b46-4604-a66d-e5cb1cfeb1f2', 'volume_name': 'volume-5ed1ddcc-1b46-4604-a66d-e5cb1cfeb1f2', 'volume_size': 1, 'snapshot_id': 'a32b0d32-af1e-4623-9648-dddf177492ae'}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:22:59 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-aa038bcd-73bd-41d9-b995-c39f932fc1bb tempest-VolumesDeleteCascade-122696450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fd083fe-ec20-4178-bb9a-16cf6ba8464f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:22:59 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-aa038bcd-73bd-41d9-b995-c39f932fc1bb tempest-VolumesDeleteCascade-122696450 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fd083fe-ec20-4178-bb9a-16cf6ba8464f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:22:59 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-aa038bcd-73bd-41d9-b995-c39f932fc1bb tempest-VolumesDeleteCascade-122696450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4aac4394-2cbd-4568-9985-c436f6bcf5a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:22:59 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-aa038bcd-73bd-41d9-b995-c39f932fc1bb tempest-VolumesDeleteCascade-122696450 None] Volume 5ed1ddcc-1b46-4604-a66d-e5cb1cfeb1f2: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-5ed1ddcc-1b46-4604-a66d-e5cb1cfeb1f2', 'volume_size': 1, 'snapshot_id': 'a32b0d32-af1e-4623-9648-dddf177492ae'} Sep 15 16:22:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-aa038bcd-73bd-41d9-b995-c39f932fc1bb tempest-VolumesDeleteCascade-122696450 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:22:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-aa038bcd-73bd-41d9-b995-c39f932fc1bb tempest-VolumesDeleteCascade-122696450 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:22:59 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-aa038bcd-73bd-41d9-b995-c39f932fc1bb tempest-VolumesDeleteCascade-122696450 None] Acquiring lock "cinder-quobyte-a32b0d32-af1e-4623-9648-dddf177492ae-5ed1ddcc-1b46-4604-a66d-e5cb1cfeb1f2" by "_create_volume_from_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:22:59 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-aa038bcd-73bd-41d9-b995-c39f932fc1bb tempest-VolumesDeleteCascade-122696450 None] Lock "cinder-quobyte-a32b0d32-af1e-4623-9648-dddf177492ae-5ed1ddcc-1b46-4604-a66d-e5cb1cfeb1f2" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:22:59 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-aa038bcd-73bd-41d9-b995-c39f932fc1bb tempest-VolumesDeleteCascade-122696450 None] Creating volume 5ed1ddcc-1b46-4604-a66d-e5cb1cfeb1f2 from snapshot a32b0d32-af1e-4623-9648-dddf177492ae {{(pid=86082) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 15 16:22:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-aa038bcd-73bd-41d9-b995-c39f932fc1bb tempest-VolumesDeleteCascade-122696450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:22:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-aa038bcd-73bd-41d9-b995-c39f932fc1bb tempest-VolumesDeleteCascade-122696450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:22:59 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-aa038bcd-73bd-41d9-b995-c39f932fc1bb tempest-VolumesDeleteCascade-122696450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:22:59 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-aa038bcd-73bd-41d9-b995-c39f932fc1bb tempest-VolumesDeleteCascade-122696450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:22:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-aa038bcd-73bd-41d9-b995-c39f932fc1bb tempest-VolumesDeleteCascade-122696450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:22:59 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-aa038bcd-73bd-41d9-b995-c39f932fc1bb tempest-VolumesDeleteCascade-122696450 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:22:59 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-aa038bcd-73bd-41d9-b995-c39f932fc1bb tempest-VolumesDeleteCascade-122696450 None] Acquiring lock "cinder-quobyte-5ed1ddcc-1b46-4604-a66d-e5cb1cfeb1f2" by "_copy_volume_from_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:22:59 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-aa038bcd-73bd-41d9-b995-c39f932fc1bb tempest-VolumesDeleteCascade-122696450 None] Lock "cinder-quobyte-5ed1ddcc-1b46-4604-a66d-e5cb1cfeb1f2" acquired by "_copy_volume_from_snapshot" :: waited 0.041s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:22:59 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-aa038bcd-73bd-41d9-b995-c39f932fc1bb tempest-VolumesDeleteCascade-122696450 None] snapshot: a32b0d32-af1e-4623-9648-dddf177492ae, volume: 5ed1ddcc-1b46-4604-a66d-e5cb1cfeb1f2, {{(pid=86082) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 15 16:22:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-aa038bcd-73bd-41d9-b995-c39f932fc1bb tempest-VolumesDeleteCascade-122696450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:22:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-aa038bcd-73bd-41d9-b995-c39f932fc1bb tempest-VolumesDeleteCascade-122696450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:22:59 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-aa038bcd-73bd-41d9-b995-c39f932fc1bb tempest-VolumesDeleteCascade-122696450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:22:59 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-aa038bcd-73bd-41d9-b995-c39f932fc1bb tempest-VolumesDeleteCascade-122696450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:22:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-aa038bcd-73bd-41d9-b995-c39f932fc1bb tempest-VolumesDeleteCascade-122696450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:22:59 devstack cinder-volume[86082]: DEBUG oslo_service.periodic_task [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86082) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 15 16:22:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:22:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:22:59 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:22:59 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:22:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:22:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:22:59 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[83ba51ca-eae7-4a26-af68-f53582ab2838]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:22:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-aa038bcd-73bd-41d9-b995-c39f932fc1bb tempest-VolumesDeleteCascade-122696450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6bb88568-04ca-4656-8258-cc15dc319565.a32b0d32-af1e-4623-9648-dddf177492ae {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:22:59 devstack sudo[94668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:22:59 devstack sudo[94668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:23:00 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-ae0ed2ca-10ce-4bd2-9541-4a9dd3dcb964 tempest-VolumesTransfersV357Test-1061686192 None] Acquiring lock "cinder-2641d21e-10fa-4bf7-ab8c-2d764d500a56-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:23:00 devstack sudo[94669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6bb88568-04ca-4656-8258-cc15dc319565.a32b0d32-af1e-4623-9648-dddf177492ae Sep 15 16:23:00 devstack sudo[94669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:23:00 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-ae0ed2ca-10ce-4bd2-9541-4a9dd3dcb964 tempest-VolumesTransfersV357Test-1061686192 None] Lock "cinder-2641d21e-10fa-4bf7-ab8c-2d764d500a56-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:23:00 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-ae0ed2ca-10ce-4bd2-9541-4a9dd3dcb964 tempest-VolumesTransfersV357Test-1061686192 None] Acquiring lock "cinder-quobyte-2641d21e-10fa-4bf7-ab8c-2d764d500a56" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:23:00 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-ae0ed2ca-10ce-4bd2-9541-4a9dd3dcb964 tempest-VolumesTransfersV357Test-1061686192 None] Lock "cinder-quobyte-2641d21e-10fa-4bf7-ab8c-2d764d500a56" acquired by "delete_volume" :: waited 0.029s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:23:00 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ed3a549-5921-46fe-b595-e7e8e2bd2a1b]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:23:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ae0ed2ca-10ce-4bd2-9541-4a9dd3dcb964 tempest-VolumesTransfersV357Test-1061686192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2641d21e-10fa-4bf7-ab8c-2d764d500a56 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:23:00 devstack sudo[94668]: pam_unix(sudo:session): session closed for user root Sep 15 16:23:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.625s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:23:00 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:23:00 devstack cinder-volume[86082]: DEBUG oslo_service.periodic_task [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Running periodic task VolumeManager._thread_info {{(pid=86082) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 15 16:23:00 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] thread count: 28 {{(pid=86082) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 15 16:23:00 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] thread info: [<_MainThread(MainThread, started 124875935469696)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86082) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 15 16:23:00 devstack sudo[94669]: pam_unix(sudo:session): session closed for user root Sep 15 16:23:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-aa038bcd-73bd-41d9-b995-c39f932fc1bb tempest-VolumesDeleteCascade-122696450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6bb88568-04ca-4656-8258-cc15dc319565.a32b0d32-af1e-4623-9648-dddf177492ae" returned: 0 in 0.623s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:23:00 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-aa038bcd-73bd-41d9-b995-c39f932fc1bb tempest-VolumesDeleteCascade-122696450 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6bb88568-04ca-4656-8258-cc15dc319565(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 16:23:00 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2489543-d64a-4e69-9d13-f128c9beb6bc]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:23:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-aa038bcd-73bd-41d9-b995-c39f932fc1bb tempest-VolumesDeleteCascade-122696450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6bb88568-04ca-4656-8258-cc15dc319565 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:23:00 devstack sudo[94673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2641d21e-10fa-4bf7-ab8c-2d764d500a56 Sep 15 16:23:00 devstack sudo[94673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:23:00 devstack sudo[94677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6bb88568-04ca-4656-8258-cc15dc319565 Sep 15 16:23:00 devstack sudo[94677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:23:00 devstack sudo[94673]: pam_unix(sudo:session): session closed for user root Sep 15 16:23:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ae0ed2ca-10ce-4bd2-9541-4a9dd3dcb964 tempest-VolumesTransfersV357Test-1061686192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2641d21e-10fa-4bf7-ab8c-2d764d500a56" returned: 0 in 0.685s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:23:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ae0ed2ca-10ce-4bd2-9541-4a9dd3dcb964 tempest-VolumesTransfersV357Test-1061686192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2641d21e-10fa-4bf7-ab8c-2d764d500a56 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:23:01 devstack sudo[94677]: pam_unix(sudo:session): session closed for user root Sep 15 16:23:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-aa038bcd-73bd-41d9-b995-c39f932fc1bb tempest-VolumesDeleteCascade-122696450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6bb88568-04ca-4656-8258-cc15dc319565" returned: 0 in 0.527s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:23:01 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-aa038bcd-73bd-41d9-b995-c39f932fc1bb tempest-VolumesDeleteCascade-122696450 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6bb88568-04ca-4656-8258-cc15dc319565 {{(pid=86082) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 15 16:23:01 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-aa038bcd-73bd-41d9-b995-c39f932fc1bb tempest-VolumesDeleteCascade-122696450 None] Creating direct copy from snapshot {{(pid=86082) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 15 16:23:01 devstack cinder-volume[86082]: DEBUG cinder.utils [None req-aa038bcd-73bd-41d9-b995-c39f932fc1bb tempest-VolumesDeleteCascade-122696450 None] Path /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-5ed1ddcc-1b46-4604-a66d-e5cb1cfeb1f2 not found in is_blk_device check {{(pid=86082) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 15 16:23:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-aa038bcd-73bd-41d9-b995-c39f932fc1bb tempest-VolumesDeleteCascade-122696450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6bb88568-04ca-4656-8258-cc15dc319565 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-5ed1ddcc-1b46-4604-a66d-e5cb1cfeb1f2 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:23:01 devstack sudo[94687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2641d21e-10fa-4bf7-ab8c-2d764d500a56 Sep 15 16:23:01 devstack sudo[94687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:23:01 devstack sudo[94689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6bb88568-04ca-4656-8258-cc15dc319565 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-5ed1ddcc-1b46-4604-a66d-e5cb1cfeb1f2 Sep 15 16:23:01 devstack sudo[94689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:23:01 devstack sudo[94687]: pam_unix(sudo:session): session closed for user root Sep 15 16:23:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ae0ed2ca-10ce-4bd2-9541-4a9dd3dcb964 tempest-VolumesTransfersV357Test-1061686192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2641d21e-10fa-4bf7-ab8c-2d764d500a56" returned: 0 in 0.556s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:23:01 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-ae0ed2ca-10ce-4bd2-9541-4a9dd3dcb964 tempest-VolumesTransfersV357Test-1061686192 None] Lock "cinder-quobyte-2641d21e-10fa-4bf7-ab8c-2d764d500a56" released by "delete_volume" :: held 1.370s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:23:01 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-ae0ed2ca-10ce-4bd2-9541-4a9dd3dcb964 tempest-VolumesTransfersV357Test-1061686192 None] Created reservations ['6068b905-7634-4f81-9c10-6d9a4ab7cb45', '27c1d279-c111-42aa-b060-3fa14810134f', '550906b4-c01e-4048-a1c6-d67dbf28fd5a', '0e1f0043-7b4a-4101-a28e-1bfbae4024ce'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:23:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-ae0ed2ca-10ce-4bd2-9541-4a9dd3dcb964 tempest-VolumesTransfersV357Test-1061686192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:23:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-ae0ed2ca-10ce-4bd2-9541-4a9dd3dcb964 tempest-VolumesTransfersV357Test-1061686192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:23:01 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-ae0ed2ca-10ce-4bd2-9541-4a9dd3dcb964 tempest-VolumesTransfersV357Test-1061686192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:23:01 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-ae0ed2ca-10ce-4bd2-9541-4a9dd3dcb964 tempest-VolumesTransfersV357Test-1061686192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:23:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-ae0ed2ca-10ce-4bd2-9541-4a9dd3dcb964 tempest-VolumesTransfersV357Test-1061686192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:23:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ae0ed2ca-10ce-4bd2-9541-4a9dd3dcb964 tempest-VolumesTransfersV357Test-1061686192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:23:01 devstack sudo[94696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:23:01 devstack sudo[94696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:23:02 devstack sudo[94696]: pam_unix(sudo:session): session closed for user root Sep 15 16:23:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ae0ed2ca-10ce-4bd2-9541-4a9dd3dcb964 tempest-VolumesTransfersV357Test-1061686192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.362s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:23:02 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-ae0ed2ca-10ce-4bd2-9541-4a9dd3dcb964 tempest-VolumesTransfersV357Test-1061686192 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:23:02 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-ae0ed2ca-10ce-4bd2-9541-4a9dd3dcb964 tempest-VolumesTransfersV357Test-1061686192 None] Deleted volume successfully. Sep 15 16:23:02 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-ae0ed2ca-10ce-4bd2-9541-4a9dd3dcb964 tempest-VolumesTransfersV357Test-1061686192 None] Lock "cinder-2641d21e-10fa-4bf7-ab8c-2d764d500a56-delete_volume" released by "delete_volume" :: held 2.052s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:23:06 devstack cinder-volume[86082]: INFO cinder.volume.manager [req-5cd7caf6-f5d3-4ded-af7b-04573daddbf4 req-cd31183b-5229-4bd4-9fe0-1ef49249baf7 tempest-AttachVolumeNegativeTest-612785929 None] Terminate volume connection completed successfully. Sep 15 16:23:06 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-5cd7caf6-f5d3-4ded-af7b-04573daddbf4 req-cd31183b-5229-4bd4-9fe0-1ef49249baf7 tempest-AttachVolumeNegativeTest-612785929 None] Deleting attachment 87e8341b-26b9-4738-a139-34622a027ee5. {{(pid=86082) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 15 16:23:10 devstack sudo[94689]: pam_unix(sudo:session): session closed for user root Sep 15 16:23:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-aa038bcd-73bd-41d9-b995-c39f932fc1bb tempest-VolumesDeleteCascade-122696450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6bb88568-04ca-4656-8258-cc15dc319565 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-5ed1ddcc-1b46-4604-a66d-e5cb1cfeb1f2" returned: 0 in 9.330s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:23:10 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-aa038bcd-73bd-41d9-b995-c39f932fc1bb tempest-VolumesDeleteCascade-122696450 None] Image conversion details: src /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6bb88568-04ca-4656-8258-cc15dc319565, size 1024.00 MB, duration 9.33 sec, destination /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-5ed1ddcc-1b46-4604-a66d-e5cb1cfeb1f2 {{(pid=86082) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 15 16:23:10 devstack cinder-volume[86082]: INFO cinder.image.image_utils [None req-aa038bcd-73bd-41d9-b995-c39f932fc1bb tempest-VolumesDeleteCascade-122696450 None] Converted 1024.00 MB image at 109.74 MB/s Sep 15 16:23:10 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-aa038bcd-73bd-41d9-b995-c39f932fc1bb tempest-VolumesDeleteCascade-122696450 None] /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-5ed1ddcc-1b46-4604-a66d-e5cb1cfeb1f2 is being set with open permissions: ugo+rw Sep 15 16:23:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-aa038bcd-73bd-41d9-b995-c39f932fc1bb tempest-VolumesDeleteCascade-122696450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-5ed1ddcc-1b46-4604-a66d-e5cb1cfeb1f2 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:23:10 devstack sudo[94763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-5ed1ddcc-1b46-4604-a66d-e5cb1cfeb1f2 Sep 15 16:23:10 devstack sudo[94763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:23:10 devstack sudo[94763]: pam_unix(sudo:session): session closed for user root Sep 15 16:23:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-aa038bcd-73bd-41d9-b995-c39f932fc1bb tempest-VolumesDeleteCascade-122696450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-5ed1ddcc-1b46-4604-a66d-e5cb1cfeb1f2" returned: 0 in 0.305s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:23:10 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-aa038bcd-73bd-41d9-b995-c39f932fc1bb tempest-VolumesDeleteCascade-122696450 None] Lock "cinder-quobyte-5ed1ddcc-1b46-4604-a66d-e5cb1cfeb1f2" released by "_copy_volume_from_snapshot" :: held 11.019s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:23:10 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-aa038bcd-73bd-41d9-b995-c39f932fc1bb tempest-VolumesDeleteCascade-122696450 None] Lock "cinder-quobyte-a32b0d32-af1e-4623-9648-dddf177492ae-5ed1ddcc-1b46-4604-a66d-e5cb1cfeb1f2" released by "_create_volume_from_snapshot" :: held 11.169s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:23:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-aa038bcd-73bd-41d9-b995-c39f932fc1bb tempest-VolumesDeleteCascade-122696450 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.192s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:23:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-aa038bcd-73bd-41d9-b995-c39f932fc1bb tempest-VolumesDeleteCascade-122696450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4aac4394-2cbd-4568-9985-c436f6bcf5a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ed1ddcc-1b46-4604-a66d-e5cb1cfeb1f2', 'volume_size': 1, 'snapshot_id': 'a32b0d32-af1e-4623-9648-dddf177492ae'}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:23:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-aa038bcd-73bd-41d9-b995-c39f932fc1bb tempest-VolumesDeleteCascade-122696450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33fdc665-e119-43b2-b437-f84e1e4e4cb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:23:10 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-aa038bcd-73bd-41d9-b995-c39f932fc1bb tempest-VolumesDeleteCascade-122696450 None] Volume volume-5ed1ddcc-1b46-4604-a66d-e5cb1cfeb1f2 (5ed1ddcc-1b46-4604-a66d-e5cb1cfeb1f2): created successfully Sep 15 16:23:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-aa038bcd-73bd-41d9-b995-c39f932fc1bb tempest-VolumesDeleteCascade-122696450 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33fdc665-e119-43b2-b437-f84e1e4e4cb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:23:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-aa038bcd-73bd-41d9-b995-c39f932fc1bb tempest-VolumesDeleteCascade-122696450 None] Flow 'volume_create_manager' (4df50b8e-155e-47cc-a823-7f351544da45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:23:10 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-aa038bcd-73bd-41d9-b995-c39f932fc1bb tempest-VolumesDeleteCascade-122696450 None] Created volume successfully. Sep 15 16:23:12 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-fe3ca1ea-98b6-461e-8ebf-ede33f71a5e5 tempest-VolumesDeleteCascade-122696450 None] Acquiring lock "cinder-6bb88568-04ca-4656-8258-cc15dc319565-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:23:12 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-fe3ca1ea-98b6-461e-8ebf-ede33f71a5e5 tempest-VolumesDeleteCascade-122696450 None] Lock "cinder-6bb88568-04ca-4656-8258-cc15dc319565-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:23:12 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-fe3ca1ea-98b6-461e-8ebf-ede33f71a5e5 tempest-VolumesDeleteCascade-122696450 None] Performing cascade delete. {{(pid=86082) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 15 16:23:12 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-fe3ca1ea-98b6-461e-8ebf-ede33f71a5e5 tempest-VolumesDeleteCascade-122696450 None] Acquiring lock "cinder-a32b0d32-af1e-4623-9648-dddf177492ae-delete_snapshot" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:23:12 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-fe3ca1ea-98b6-461e-8ebf-ede33f71a5e5 tempest-VolumesDeleteCascade-122696450 None] Lock "cinder-a32b0d32-af1e-4623-9648-dddf177492ae-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:23:12 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-fe3ca1ea-98b6-461e-8ebf-ede33f71a5e5 tempest-VolumesDeleteCascade-122696450 None] Acquiring lock "cinder-quobyte-6bb88568-04ca-4656-8258-cc15dc319565" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:23:12 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-fe3ca1ea-98b6-461e-8ebf-ede33f71a5e5 tempest-VolumesDeleteCascade-122696450 None] Lock "cinder-quobyte-6bb88568-04ca-4656-8258-cc15dc319565" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:23:12 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-fe3ca1ea-98b6-461e-8ebf-ede33f71a5e5 tempest-VolumesDeleteCascade-122696450 None] Acquiring lock "cinder-quobyte-a32b0d32-af1e-4623-9648-dddf177492ae" by "_delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:23:12 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-fe3ca1ea-98b6-461e-8ebf-ede33f71a5e5 tempest-VolumesDeleteCascade-122696450 None] Lock "cinder-quobyte-a32b0d32-af1e-4623-9648-dddf177492ae" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:23:12 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-fe3ca1ea-98b6-461e-8ebf-ede33f71a5e5 tempest-VolumesDeleteCascade-122696450 None] Deleting offline snapshot a32b0d32-af1e-4623-9648-dddf177492ae of volume 6bb88568-04ca-4656-8258-cc15dc319565 {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 15 16:23:12 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-fe3ca1ea-98b6-461e-8ebf-ede33f71a5e5 tempest-VolumesDeleteCascade-122696450 None] snapshot_file for this snap is: volume-6bb88568-04ca-4656-8258-cc15dc319565.a32b0d32-af1e-4623-9648-dddf177492ae {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 15 16:23:12 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a9e92a1-e95d-4059-b030-0819019e97fc]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:23:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-fe3ca1ea-98b6-461e-8ebf-ede33f71a5e5 tempest-VolumesDeleteCascade-122696450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6bb88568-04ca-4656-8258-cc15dc319565.a32b0d32-af1e-4623-9648-dddf177492ae {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:23:12 devstack sudo[94803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6bb88568-04ca-4656-8258-cc15dc319565.a32b0d32-af1e-4623-9648-dddf177492ae Sep 15 16:23:12 devstack sudo[94803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:23:12 devstack sudo[94803]: pam_unix(sudo:session): session closed for user root Sep 15 16:23:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-fe3ca1ea-98b6-461e-8ebf-ede33f71a5e5 tempest-VolumesDeleteCascade-122696450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6bb88568-04ca-4656-8258-cc15dc319565.a32b0d32-af1e-4623-9648-dddf177492ae" returned: 0 in 0.429s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:23:12 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-fe3ca1ea-98b6-461e-8ebf-ede33f71a5e5 tempest-VolumesDeleteCascade-122696450 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6bb88568-04ca-4656-8258-cc15dc319565(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 16:23:12 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0b06a86-8ffb-483a-ba99-e9b74242872c]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:23:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-fe3ca1ea-98b6-461e-8ebf-ede33f71a5e5 tempest-VolumesDeleteCascade-122696450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6bb88568-04ca-4656-8258-cc15dc319565 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:23:12 devstack sudo[94808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6bb88568-04ca-4656-8258-cc15dc319565 Sep 15 16:23:12 devstack sudo[94808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:23:13 devstack sudo[94808]: pam_unix(sudo:session): session closed for user root Sep 15 16:23:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-fe3ca1ea-98b6-461e-8ebf-ede33f71a5e5 tempest-VolumesDeleteCascade-122696450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6bb88568-04ca-4656-8258-cc15dc319565" returned: 0 in 0.676s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:23:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-fe3ca1ea-98b6-461e-8ebf-ede33f71a5e5 tempest-VolumesDeleteCascade-122696450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6bb88568-04ca-4656-8258-cc15dc319565.a32b0d32-af1e-4623-9648-dddf177492ae {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:23:13 devstack sudo[94813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6bb88568-04ca-4656-8258-cc15dc319565.a32b0d32-af1e-4623-9648-dddf177492ae Sep 15 16:23:13 devstack sudo[94813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:23:13 devstack sudo[94813]: pam_unix(sudo:session): session closed for user root Sep 15 16:23:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-fe3ca1ea-98b6-461e-8ebf-ede33f71a5e5 tempest-VolumesDeleteCascade-122696450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6bb88568-04ca-4656-8258-cc15dc319565.a32b0d32-af1e-4623-9648-dddf177492ae" returned: 0 in 0.443s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:23:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-fe3ca1ea-98b6-461e-8ebf-ede33f71a5e5 tempest-VolumesDeleteCascade-122696450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6bb88568-04ca-4656-8258-cc15dc319565.a32b0d32-af1e-4623-9648-dddf177492ae {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:23:13 devstack sudo[94819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6bb88568-04ca-4656-8258-cc15dc319565.a32b0d32-af1e-4623-9648-dddf177492ae Sep 15 16:23:13 devstack sudo[94819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:23:14 devstack sudo[94819]: pam_unix(sudo:session): session closed for user root Sep 15 16:23:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-fe3ca1ea-98b6-461e-8ebf-ede33f71a5e5 tempest-VolumesDeleteCascade-122696450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6bb88568-04ca-4656-8258-cc15dc319565.a32b0d32-af1e-4623-9648-dddf177492ae" returned: 0 in 0.280s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:23:14 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-fe3ca1ea-98b6-461e-8ebf-ede33f71a5e5 tempest-VolumesDeleteCascade-122696450 None] Lock "cinder-quobyte-a32b0d32-af1e-4623-9648-dddf177492ae" released by "_delete_snapshot" :: held 2.010s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:23:14 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-fe3ca1ea-98b6-461e-8ebf-ede33f71a5e5 tempest-VolumesDeleteCascade-122696450 None] Lock "cinder-quobyte-6bb88568-04ca-4656-8258-cc15dc319565" released by "delete_snapshot" :: held 2.048s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:23:14 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-fe3ca1ea-98b6-461e-8ebf-ede33f71a5e5 tempest-VolumesDeleteCascade-122696450 None] Created reservations ['53daec97-4592-45bb-93b3-fb1e9c9eab6f', 'fd398c40-4c26-4a20-8c97-92adbd45a003', 'a2e6f2a3-e450-4987-8886-00088980f24f', '96f3109a-1dfb-4472-ba9e-a5550bfbeb31'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:23:14 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-fe3ca1ea-98b6-461e-8ebf-ede33f71a5e5 tempest-VolumesDeleteCascade-122696450 None] Delete snapshot completed successfully. Sep 15 16:23:14 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-fe3ca1ea-98b6-461e-8ebf-ede33f71a5e5 tempest-VolumesDeleteCascade-122696450 None] Lock "cinder-a32b0d32-af1e-4623-9648-dddf177492ae-delete_snapshot" released by "delete_snapshot" :: held 2.336s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:23:14 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-fe3ca1ea-98b6-461e-8ebf-ede33f71a5e5 tempest-VolumesDeleteCascade-122696450 None] Snapshots deleted, issuing volume delete {{(pid=86082) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 15 16:23:14 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-fe3ca1ea-98b6-461e-8ebf-ede33f71a5e5 tempest-VolumesDeleteCascade-122696450 None] Acquiring lock "cinder-quobyte-6bb88568-04ca-4656-8258-cc15dc319565" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:23:14 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-fe3ca1ea-98b6-461e-8ebf-ede33f71a5e5 tempest-VolumesDeleteCascade-122696450 None] Lock "cinder-quobyte-6bb88568-04ca-4656-8258-cc15dc319565" acquired by "delete_volume" :: waited 0.018s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:23:14 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcd51a4d-367d-4df3-864a-222ffe3b8956]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:23:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-fe3ca1ea-98b6-461e-8ebf-ede33f71a5e5 tempest-VolumesDeleteCascade-122696450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6bb88568-04ca-4656-8258-cc15dc319565 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:23:14 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b0886b8-1937-4e82-b28d-93d76cde61c3 tempest-VolumesCloneNegativeTest-852751943 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:23:14 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5b0886b8-1937-4e82-b28d-93d76cde61c3 tempest-VolumesCloneNegativeTest-852751943 None] Flow 'volume_create_manager' (09072f28-67ea-4a52-9828-47f9e1765533) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:23:14 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5b0886b8-1937-4e82-b28d-93d76cde61c3 tempest-VolumesCloneNegativeTest-852751943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f6ee3aa-ebce-4e1b-b5a6-11a79a31490f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:23:14 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5b0886b8-1937-4e82-b28d-93d76cde61c3 tempest-VolumesCloneNegativeTest-852751943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f6ee3aa-ebce-4e1b-b5a6-11a79a31490f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:23:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-546555128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ae54ba0-fbe2-410f-9db7-7f8493dac407,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e009b76372504c6eb8f67c4af8e0114a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:23:15Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:23:15Z,use_quota=True,user_id='e903f315862e436d9dc3e1993ec92694',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:23:14 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5b0886b8-1937-4e82-b28d-93d76cde61c3 tempest-VolumesCloneNegativeTest-852751943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1dc6b8be-f714-49aa-b16d-98ecf8801e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:23:14 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5b0886b8-1937-4e82-b28d-93d76cde61c3 tempest-VolumesCloneNegativeTest-852751943 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1dc6b8be-f714-49aa-b16d-98ecf8801e08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:23:14 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5b0886b8-1937-4e82-b28d-93d76cde61c3 tempest-VolumesCloneNegativeTest-852751943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e8bf6d2-1c27-4291-a04d-7909254c1a30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:23:14 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5b0886b8-1937-4e82-b28d-93d76cde61c3 tempest-VolumesCloneNegativeTest-852751943 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e8bf6d2-1c27-4291-a04d-7909254c1a30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ae54ba0-fbe2-410f-9db7-7f8493dac407', 'volume_name': 'volume-4ae54ba0-fbe2-410f-9db7-7f8493dac407', 'volume_size': 2}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:23:14 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5b0886b8-1937-4e82-b28d-93d76cde61c3 tempest-VolumesCloneNegativeTest-852751943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e80fae48-f4a8-40bd-a14b-1d8ad96292f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:23:14 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5b0886b8-1937-4e82-b28d-93d76cde61c3 tempest-VolumesCloneNegativeTest-852751943 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e80fae48-f4a8-40bd-a14b-1d8ad96292f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:23:14 devstack sudo[94824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6bb88568-04ca-4656-8258-cc15dc319565 Sep 15 16:23:14 devstack sudo[94824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:23:14 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5b0886b8-1937-4e82-b28d-93d76cde61c3 tempest-VolumesCloneNegativeTest-852751943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (690f7964-44ff-4665-a838-a26c6ef9a592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:23:14 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-5b0886b8-1937-4e82-b28d-93d76cde61c3 tempest-VolumesCloneNegativeTest-852751943 None] Volume 4ae54ba0-fbe2-410f-9db7-7f8493dac407: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ae54ba0-fbe2-410f-9db7-7f8493dac407', 'volume_size': 2} Sep 15 16:23:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-5b0886b8-1937-4e82-b28d-93d76cde61c3 tempest-VolumesCloneNegativeTest-852751943 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:23:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-5b0886b8-1937-4e82-b28d-93d76cde61c3 tempest-VolumesCloneNegativeTest-852751943 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:23:14 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-5b0886b8-1937-4e82-b28d-93d76cde61c3 tempest-VolumesCloneNegativeTest-852751943 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:23:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-546555128',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ae54ba0-fbe2-410f-9db7-7f8493dac407,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e009b76372504c6eb8f67c4af8e0114a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:23:15Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:23:15Z,use_quota=True,user_id='e903f315862e436d9dc3e1993ec92694',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:23:14 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-5b0886b8-1937-4e82-b28d-93d76cde61c3 tempest-VolumesCloneNegativeTest-852751943 None] Creating volume 4ae54ba0-fbe2-410f-9db7-7f8493dac407 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:23:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-5b0886b8-1937-4e82-b28d-93d76cde61c3 tempest-VolumesCloneNegativeTest-852751943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:23:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-5b0886b8-1937-4e82-b28d-93d76cde61c3 tempest-VolumesCloneNegativeTest-852751943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:23:14 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-5b0886b8-1937-4e82-b28d-93d76cde61c3 tempest-VolumesCloneNegativeTest-852751943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:23:14 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-5b0886b8-1937-4e82-b28d-93d76cde61c3 tempest-VolumesCloneNegativeTest-852751943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:23:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-5b0886b8-1937-4e82-b28d-93d76cde61c3 tempest-VolumesCloneNegativeTest-852751943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:23:14 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-5b0886b8-1937-4e82-b28d-93d76cde61c3 tempest-VolumesCloneNegativeTest-852751943 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:23:14 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-5b0886b8-1937-4e82-b28d-93d76cde61c3 tempest-VolumesCloneNegativeTest-852751943 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:23:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5b0886b8-1937-4e82-b28d-93d76cde61c3 tempest-VolumesCloneNegativeTest-852751943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-4ae54ba0-fbe2-410f-9db7-7f8493dac407 2147483648 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:23:14 devstack sudo[94826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-4ae54ba0-fbe2-410f-9db7-7f8493dac407 2147483648 Sep 15 16:23:14 devstack sudo[94826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:23:15 devstack sudo[94824]: pam_unix(sudo:session): session closed for user root Sep 15 16:23:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-fe3ca1ea-98b6-461e-8ebf-ede33f71a5e5 tempest-VolumesDeleteCascade-122696450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6bb88568-04ca-4656-8258-cc15dc319565" returned: 0 in 0.486s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:23:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-fe3ca1ea-98b6-461e-8ebf-ede33f71a5e5 tempest-VolumesDeleteCascade-122696450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6bb88568-04ca-4656-8258-cc15dc319565 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:23:15 devstack sudo[94834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6bb88568-04ca-4656-8258-cc15dc319565 Sep 15 16:23:15 devstack sudo[94834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:23:15 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-c21a94d8-be57-41f0-bd6a-52a8f758caef tempest-AttachVolumeTestJSON-1797013884 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:23:15 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c21a94d8-be57-41f0-bd6a-52a8f758caef tempest-AttachVolumeTestJSON-1797013884 None] Flow 'volume_create_manager' (3b0afecf-b21d-4c2b-ae8d-ccf1a0448e62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:23:15 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c21a94d8-be57-41f0-bd6a-52a8f758caef tempest-AttachVolumeTestJSON-1797013884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aeb84e34-1ab2-4aa8-935b-381033ed54e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:23:15 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c21a94d8-be57-41f0-bd6a-52a8f758caef tempest-AttachVolumeTestJSON-1797013884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aeb84e34-1ab2-4aa8-935b-381033ed54e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:23:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-940739443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd4f035a-5e51-4c41-b9c0-a37dd22506d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4074182297cb4184b4a6b5d1aae1cc44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:23:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:23:15Z,use_quota=True,user_id='6e8071e77b4a42e8a3e07a9b3a4737f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:23:15 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c21a94d8-be57-41f0-bd6a-52a8f758caef tempest-AttachVolumeTestJSON-1797013884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (616f00df-e084-42c1-9611-1538e5ae74e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:23:15 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c21a94d8-be57-41f0-bd6a-52a8f758caef tempest-AttachVolumeTestJSON-1797013884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (616f00df-e084-42c1-9611-1538e5ae74e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:23:15 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c21a94d8-be57-41f0-bd6a-52a8f758caef tempest-AttachVolumeTestJSON-1797013884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d81e023c-ab5b-4ab3-be05-8926fb0d7a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:23:15 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c21a94d8-be57-41f0-bd6a-52a8f758caef tempest-AttachVolumeTestJSON-1797013884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d81e023c-ab5b-4ab3-be05-8926fb0d7a6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dd4f035a-5e51-4c41-b9c0-a37dd22506d2', 'volume_name': 'volume-dd4f035a-5e51-4c41-b9c0-a37dd22506d2', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:23:15 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c21a94d8-be57-41f0-bd6a-52a8f758caef tempest-AttachVolumeTestJSON-1797013884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (caf3f8b9-9706-4392-a59e-0d64e581d17d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:23:15 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c21a94d8-be57-41f0-bd6a-52a8f758caef tempest-AttachVolumeTestJSON-1797013884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (caf3f8b9-9706-4392-a59e-0d64e581d17d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:23:15 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c21a94d8-be57-41f0-bd6a-52a8f758caef tempest-AttachVolumeTestJSON-1797013884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e2cffba-4860-4ae2-b8ce-22f76641aae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:23:15 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-c21a94d8-be57-41f0-bd6a-52a8f758caef tempest-AttachVolumeTestJSON-1797013884 None] Volume dd4f035a-5e51-4c41-b9c0-a37dd22506d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dd4f035a-5e51-4c41-b9c0-a37dd22506d2', 'volume_size': 1} Sep 15 16:23:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c21a94d8-be57-41f0-bd6a-52a8f758caef tempest-AttachVolumeTestJSON-1797013884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:23:15 devstack sudo[94826]: pam_unix(sudo:session): session closed for user root Sep 15 16:23:15 devstack sudo[94834]: pam_unix(sudo:session): session closed for user root Sep 15 16:23:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5b0886b8-1937-4e82-b28d-93d76cde61c3 tempest-VolumesCloneNegativeTest-852751943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-4ae54ba0-fbe2-410f-9db7-7f8493dac407 2147483648" returned: 0 in 0.709s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:23:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-fe3ca1ea-98b6-461e-8ebf-ede33f71a5e5 tempest-VolumesDeleteCascade-122696450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6bb88568-04ca-4656-8258-cc15dc319565" returned: 0 in 0.366s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:23:15 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-fe3ca1ea-98b6-461e-8ebf-ede33f71a5e5 tempest-VolumesDeleteCascade-122696450 None] Lock "cinder-quobyte-6bb88568-04ca-4656-8258-cc15dc319565" released by "delete_volume" :: held 0.958s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:23:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5b0886b8-1937-4e82-b28d-93d76cde61c3 tempest-VolumesCloneNegativeTest-852751943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-4ae54ba0-fbe2-410f-9db7-7f8493dac407 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:23:15 devstack sudo[94838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-4ae54ba0-fbe2-410f-9db7-7f8493dac407 Sep 15 16:23:15 devstack sudo[94838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:23:15 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-fe3ca1ea-98b6-461e-8ebf-ede33f71a5e5 tempest-VolumesDeleteCascade-122696450 None] Created reservations ['6d1382fd-6f7d-4072-adcf-7846f1d540f4', 'aa014a3b-35ba-4e4f-89f8-6f4b3d0205d3', '56775eb7-7827-412a-b508-4c4d165a4dd7', 'dc1473ca-b795-4c7d-b102-fae90fb82619'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:23:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-fe3ca1ea-98b6-461e-8ebf-ede33f71a5e5 tempest-VolumesDeleteCascade-122696450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:23:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-fe3ca1ea-98b6-461e-8ebf-ede33f71a5e5 tempest-VolumesDeleteCascade-122696450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:23:15 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-fe3ca1ea-98b6-461e-8ebf-ede33f71a5e5 tempest-VolumesDeleteCascade-122696450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:23:15 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-fe3ca1ea-98b6-461e-8ebf-ede33f71a5e5 tempest-VolumesDeleteCascade-122696450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:23:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-fe3ca1ea-98b6-461e-8ebf-ede33f71a5e5 tempest-VolumesDeleteCascade-122696450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:23:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-fe3ca1ea-98b6-461e-8ebf-ede33f71a5e5 tempest-VolumesDeleteCascade-122696450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:23:15 devstack sudo[94840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:23:15 devstack sudo[94840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:23:15 devstack sudo[94838]: pam_unix(sudo:session): session closed for user root Sep 15 16:23:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5b0886b8-1937-4e82-b28d-93d76cde61c3 tempest-VolumesCloneNegativeTest-852751943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-4ae54ba0-fbe2-410f-9db7-7f8493dac407" returned: 0 in 0.285s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:23:15 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-5b0886b8-1937-4e82-b28d-93d76cde61c3 tempest-VolumesCloneNegativeTest-852751943 None] <== create_volume: return (1068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:23:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-5b0886b8-1937-4e82-b28d-93d76cde61c3 tempest-VolumesCloneNegativeTest-852751943 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.071s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:23:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c21a94d8-be57-41f0-bd6a-52a8f758caef tempest-AttachVolumeTestJSON-1797013884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.413s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:23:15 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c21a94d8-be57-41f0-bd6a-52a8f758caef tempest-AttachVolumeTestJSON-1797013884 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:23:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-940739443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd4f035a-5e51-4c41-b9c0-a37dd22506d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4074182297cb4184b4a6b5d1aae1cc44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:23:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:23:15Z,use_quota=True,user_id='6e8071e77b4a42e8a3e07a9b3a4737f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:23:15 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-c21a94d8-be57-41f0-bd6a-52a8f758caef tempest-AttachVolumeTestJSON-1797013884 None] Creating volume dd4f035a-5e51-4c41-b9c0-a37dd22506d2 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:23:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c21a94d8-be57-41f0-bd6a-52a8f758caef tempest-AttachVolumeTestJSON-1797013884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:23:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c21a94d8-be57-41f0-bd6a-52a8f758caef tempest-AttachVolumeTestJSON-1797013884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:23:15 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c21a94d8-be57-41f0-bd6a-52a8f758caef tempest-AttachVolumeTestJSON-1797013884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:23:15 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c21a94d8-be57-41f0-bd6a-52a8f758caef tempest-AttachVolumeTestJSON-1797013884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:23:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c21a94d8-be57-41f0-bd6a-52a8f758caef tempest-AttachVolumeTestJSON-1797013884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:23:15 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c21a94d8-be57-41f0-bd6a-52a8f758caef tempest-AttachVolumeTestJSON-1797013884 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:23:15 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-c21a94d8-be57-41f0-bd6a-52a8f758caef tempest-AttachVolumeTestJSON-1797013884 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:23:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c21a94d8-be57-41f0-bd6a-52a8f758caef tempest-AttachVolumeTestJSON-1797013884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-dd4f035a-5e51-4c41-b9c0-a37dd22506d2 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:23:15 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5b0886b8-1937-4e82-b28d-93d76cde61c3 tempest-VolumesCloneNegativeTest-852751943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (690f7964-44ff-4665-a838-a26c6ef9a592) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ae54ba0-fbe2-410f-9db7-7f8493dac407', 'volume_size': 2}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:23:15 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5b0886b8-1937-4e82-b28d-93d76cde61c3 tempest-VolumesCloneNegativeTest-852751943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09bd68ea-5a57-4293-9c3e-c3d5777cbe59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:23:15 devstack sudo[94843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-dd4f035a-5e51-4c41-b9c0-a37dd22506d2 1073741824 Sep 15 16:23:15 devstack sudo[94843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:23:15 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-5b0886b8-1937-4e82-b28d-93d76cde61c3 tempest-VolumesCloneNegativeTest-852751943 None] Volume volume-4ae54ba0-fbe2-410f-9db7-7f8493dac407 (4ae54ba0-fbe2-410f-9db7-7f8493dac407): created successfully Sep 15 16:23:15 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5b0886b8-1937-4e82-b28d-93d76cde61c3 tempest-VolumesCloneNegativeTest-852751943 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09bd68ea-5a57-4293-9c3e-c3d5777cbe59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:23:15 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5b0886b8-1937-4e82-b28d-93d76cde61c3 tempest-VolumesCloneNegativeTest-852751943 None] Flow 'volume_create_manager' (09072f28-67ea-4a52-9828-47f9e1765533) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:23:15 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-5b0886b8-1937-4e82-b28d-93d76cde61c3 tempest-VolumesCloneNegativeTest-852751943 None] Created volume successfully. Sep 15 16:23:15 devstack sudo[94840]: pam_unix(sudo:session): session closed for user root Sep 15 16:23:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-fe3ca1ea-98b6-461e-8ebf-ede33f71a5e5 tempest-VolumesDeleteCascade-122696450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.299s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:23:15 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-fe3ca1ea-98b6-461e-8ebf-ede33f71a5e5 tempest-VolumesDeleteCascade-122696450 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:23:15 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-fe3ca1ea-98b6-461e-8ebf-ede33f71a5e5 tempest-VolumesDeleteCascade-122696450 None] Deleted volume successfully. Sep 15 16:23:15 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-fe3ca1ea-98b6-461e-8ebf-ede33f71a5e5 tempest-VolumesDeleteCascade-122696450 None] Lock "cinder-6bb88568-04ca-4656-8258-cc15dc319565-delete_volume" released by "delete_volume" :: held 3.871s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:23:16 devstack sudo[94843]: pam_unix(sudo:session): session closed for user root Sep 15 16:23:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c21a94d8-be57-41f0-bd6a-52a8f758caef tempest-AttachVolumeTestJSON-1797013884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-dd4f035a-5e51-4c41-b9c0-a37dd22506d2 1073741824" returned: 0 in 0.471s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:23:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c21a94d8-be57-41f0-bd6a-52a8f758caef tempest-AttachVolumeTestJSON-1797013884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-dd4f035a-5e51-4c41-b9c0-a37dd22506d2 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:23:16 devstack sudo[94851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-dd4f035a-5e51-4c41-b9c0-a37dd22506d2 Sep 15 16:23:16 devstack sudo[94851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:23:16 devstack sudo[94851]: pam_unix(sudo:session): session closed for user root Sep 15 16:23:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c21a94d8-be57-41f0-bd6a-52a8f758caef tempest-AttachVolumeTestJSON-1797013884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-dd4f035a-5e51-4c41-b9c0-a37dd22506d2" returned: 0 in 0.265s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:23:16 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c21a94d8-be57-41f0-bd6a-52a8f758caef tempest-AttachVolumeTestJSON-1797013884 None] <== create_volume: return (799ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:23:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c21a94d8-be57-41f0-bd6a-52a8f758caef tempest-AttachVolumeTestJSON-1797013884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.803s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:23:16 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c21a94d8-be57-41f0-bd6a-52a8f758caef tempest-AttachVolumeTestJSON-1797013884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e2cffba-4860-4ae2-b8ce-22f76641aae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd4f035a-5e51-4c41-b9c0-a37dd22506d2', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:23:16 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c21a94d8-be57-41f0-bd6a-52a8f758caef tempest-AttachVolumeTestJSON-1797013884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54745e20-996f-4f15-a86d-a0492487b336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:23:16 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-c21a94d8-be57-41f0-bd6a-52a8f758caef tempest-AttachVolumeTestJSON-1797013884 None] Volume volume-dd4f035a-5e51-4c41-b9c0-a37dd22506d2 (dd4f035a-5e51-4c41-b9c0-a37dd22506d2): created successfully Sep 15 16:23:16 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c21a94d8-be57-41f0-bd6a-52a8f758caef tempest-AttachVolumeTestJSON-1797013884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54745e20-996f-4f15-a86d-a0492487b336) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:23:16 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c21a94d8-be57-41f0-bd6a-52a8f758caef tempest-AttachVolumeTestJSON-1797013884 None] Flow 'volume_create_manager' (3b0afecf-b21d-4c2b-ae8d-ccf1a0448e62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:23:16 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-c21a94d8-be57-41f0-bd6a-52a8f758caef tempest-AttachVolumeTestJSON-1797013884 None] Created volume successfully. Sep 15 16:23:16 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-65cb0e4e-4bc9-4a49-9b21-9ed4eae4f571 tempest-VolumesDeleteCascade-122696450 None] Acquiring lock "cinder-5ed1ddcc-1b46-4604-a66d-e5cb1cfeb1f2-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:23:16 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-65cb0e4e-4bc9-4a49-9b21-9ed4eae4f571 tempest-VolumesDeleteCascade-122696450 None] Lock "cinder-5ed1ddcc-1b46-4604-a66d-e5cb1cfeb1f2-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:23:16 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-65cb0e4e-4bc9-4a49-9b21-9ed4eae4f571 tempest-VolumesDeleteCascade-122696450 None] Acquiring lock "cinder-quobyte-5ed1ddcc-1b46-4604-a66d-e5cb1cfeb1f2" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:23:16 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-65cb0e4e-4bc9-4a49-9b21-9ed4eae4f571 tempest-VolumesDeleteCascade-122696450 None] Lock "cinder-quobyte-5ed1ddcc-1b46-4604-a66d-e5cb1cfeb1f2" acquired by "delete_volume" :: waited 0.018s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:23:16 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[268b27fe-e0ab-4729-9580-92f4b6f00c42]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:23:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-65cb0e4e-4bc9-4a49-9b21-9ed4eae4f571 tempest-VolumesDeleteCascade-122696450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-5ed1ddcc-1b46-4604-a66d-e5cb1cfeb1f2 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:23:16 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-41d60320-e6f1-46a4-bed0-953c00651f7c tempest-VolumesCloneNegativeTest-852751943 None] Acquiring lock "cinder-4ae54ba0-fbe2-410f-9db7-7f8493dac407-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:23:16 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-41d60320-e6f1-46a4-bed0-953c00651f7c tempest-VolumesCloneNegativeTest-852751943 None] Lock "cinder-4ae54ba0-fbe2-410f-9db7-7f8493dac407-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:23:16 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-41d60320-e6f1-46a4-bed0-953c00651f7c tempest-VolumesCloneNegativeTest-852751943 None] Acquiring lock "cinder-quobyte-4ae54ba0-fbe2-410f-9db7-7f8493dac407" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:23:16 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-41d60320-e6f1-46a4-bed0-953c00651f7c tempest-VolumesCloneNegativeTest-852751943 None] Lock "cinder-quobyte-4ae54ba0-fbe2-410f-9db7-7f8493dac407" acquired by "delete_volume" :: waited 0.022s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:23:16 devstack sudo[94854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-5ed1ddcc-1b46-4604-a66d-e5cb1cfeb1f2 Sep 15 16:23:16 devstack sudo[94854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:23:16 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e4b1278-8d07-4e27-a586-92f7a401efd6]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:23:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-41d60320-e6f1-46a4-bed0-953c00651f7c tempest-VolumesCloneNegativeTest-852751943 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-4ae54ba0-fbe2-410f-9db7-7f8493dac407 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:23:17 devstack sudo[94856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-4ae54ba0-fbe2-410f-9db7-7f8493dac407 Sep 15 16:23:17 devstack sudo[94856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:23:17 devstack sudo[94854]: pam_unix(sudo:session): session closed for user root Sep 15 16:23:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-65cb0e4e-4bc9-4a49-9b21-9ed4eae4f571 tempest-VolumesDeleteCascade-122696450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-5ed1ddcc-1b46-4604-a66d-e5cb1cfeb1f2" returned: 0 in 0.445s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:23:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-65cb0e4e-4bc9-4a49-9b21-9ed4eae4f571 tempest-VolumesDeleteCascade-122696450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-5ed1ddcc-1b46-4604-a66d-e5cb1cfeb1f2 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:23:17 devstack sudo[94861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-5ed1ddcc-1b46-4604-a66d-e5cb1cfeb1f2 Sep 15 16:23:17 devstack sudo[94861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:23:17 devstack sudo[94856]: pam_unix(sudo:session): session closed for user root Sep 15 16:23:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-41d60320-e6f1-46a4-bed0-953c00651f7c tempest-VolumesCloneNegativeTest-852751943 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-4ae54ba0-fbe2-410f-9db7-7f8493dac407" returned: 0 in 0.437s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:23:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-41d60320-e6f1-46a4-bed0-953c00651f7c tempest-VolumesCloneNegativeTest-852751943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-4ae54ba0-fbe2-410f-9db7-7f8493dac407 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:23:17 devstack sudo[94870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-4ae54ba0-fbe2-410f-9db7-7f8493dac407 Sep 15 16:23:17 devstack sudo[94870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:23:17 devstack sudo[94861]: pam_unix(sudo:session): session closed for user root Sep 15 16:23:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-65cb0e4e-4bc9-4a49-9b21-9ed4eae4f571 tempest-VolumesDeleteCascade-122696450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-5ed1ddcc-1b46-4604-a66d-e5cb1cfeb1f2" returned: 0 in 0.311s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:23:17 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-65cb0e4e-4bc9-4a49-9b21-9ed4eae4f571 tempest-VolumesDeleteCascade-122696450 None] Lock "cinder-quobyte-5ed1ddcc-1b46-4604-a66d-e5cb1cfeb1f2" released by "delete_volume" :: held 0.836s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:23:17 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-65cb0e4e-4bc9-4a49-9b21-9ed4eae4f571 tempest-VolumesDeleteCascade-122696450 None] Created reservations ['050e2193-8824-4745-b7e2-01dc420fd964', 'f329e7a0-3fd5-495e-84fa-52f6df5424df', 'fe66f044-345c-4912-a58c-594373412fd6', 'a670d1d6-9141-4d86-aecb-0e5a439c01a3'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:23:17 devstack sudo[94870]: pam_unix(sudo:session): session closed for user root Sep 15 16:23:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-41d60320-e6f1-46a4-bed0-953c00651f7c tempest-VolumesCloneNegativeTest-852751943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-4ae54ba0-fbe2-410f-9db7-7f8493dac407" returned: 0 in 0.325s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:23:17 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-41d60320-e6f1-46a4-bed0-953c00651f7c tempest-VolumesCloneNegativeTest-852751943 None] Lock "cinder-quobyte-4ae54ba0-fbe2-410f-9db7-7f8493dac407" released by "delete_volume" :: held 0.822s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:23:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-65cb0e4e-4bc9-4a49-9b21-9ed4eae4f571 tempest-VolumesDeleteCascade-122696450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:23:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-65cb0e4e-4bc9-4a49-9b21-9ed4eae4f571 tempest-VolumesDeleteCascade-122696450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:23:17 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-65cb0e4e-4bc9-4a49-9b21-9ed4eae4f571 tempest-VolumesDeleteCascade-122696450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:23:17 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-65cb0e4e-4bc9-4a49-9b21-9ed4eae4f571 tempest-VolumesDeleteCascade-122696450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:23:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-65cb0e4e-4bc9-4a49-9b21-9ed4eae4f571 tempest-VolumesDeleteCascade-122696450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:23:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-65cb0e4e-4bc9-4a49-9b21-9ed4eae4f571 tempest-VolumesDeleteCascade-122696450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:23:17 devstack sudo[94877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:23:17 devstack sudo[94877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:23:17 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-41d60320-e6f1-46a4-bed0-953c00651f7c tempest-VolumesCloneNegativeTest-852751943 None] Created reservations ['3cdeab03-e501-4ac3-9586-5c4c7f18e206', 'b1d0552c-b23b-40ef-ba67-49b108604885', '3319dd1a-b2b4-411d-99d9-44fb958d7ca2', 'fda6cbd5-cc95-45d7-9ee4-dc6f892b2544'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:23:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-41d60320-e6f1-46a4-bed0-953c00651f7c tempest-VolumesCloneNegativeTest-852751943 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:23:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-41d60320-e6f1-46a4-bed0-953c00651f7c tempest-VolumesCloneNegativeTest-852751943 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:23:17 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-41d60320-e6f1-46a4-bed0-953c00651f7c tempest-VolumesCloneNegativeTest-852751943 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:23:18 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-41d60320-e6f1-46a4-bed0-953c00651f7c tempest-VolumesCloneNegativeTest-852751943 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:23:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-41d60320-e6f1-46a4-bed0-953c00651f7c tempest-VolumesCloneNegativeTest-852751943 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:23:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-41d60320-e6f1-46a4-bed0-953c00651f7c tempest-VolumesCloneNegativeTest-852751943 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:23:18 devstack sudo[94879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:23:18 devstack sudo[94879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:23:18 devstack sudo[94877]: pam_unix(sudo:session): session closed for user root Sep 15 16:23:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-65cb0e4e-4bc9-4a49-9b21-9ed4eae4f571 tempest-VolumesDeleteCascade-122696450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.449s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:23:18 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-65cb0e4e-4bc9-4a49-9b21-9ed4eae4f571 tempest-VolumesDeleteCascade-122696450 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:23:18 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-65cb0e4e-4bc9-4a49-9b21-9ed4eae4f571 tempest-VolumesDeleteCascade-122696450 None] Deleted volume successfully. Sep 15 16:23:18 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-65cb0e4e-4bc9-4a49-9b21-9ed4eae4f571 tempest-VolumesDeleteCascade-122696450 None] Lock "cinder-5ed1ddcc-1b46-4604-a66d-e5cb1cfeb1f2-delete_volume" released by "delete_volume" :: held 1.636s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:23:18 devstack sudo[94879]: pam_unix(sudo:session): session closed for user root Sep 15 16:23:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-41d60320-e6f1-46a4-bed0-953c00651f7c tempest-VolumesCloneNegativeTest-852751943 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.449s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:23:18 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-41d60320-e6f1-46a4-bed0-953c00651f7c tempest-VolumesCloneNegativeTest-852751943 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:23:18 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-41d60320-e6f1-46a4-bed0-953c00651f7c tempest-VolumesCloneNegativeTest-852751943 None] Deleted volume successfully. Sep 15 16:23:18 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-41d60320-e6f1-46a4-bed0-953c00651f7c tempest-VolumesCloneNegativeTest-852751943 None] Lock "cinder-4ae54ba0-fbe2-410f-9db7-7f8493dac407-delete_volume" released by "delete_volume" :: held 1.626s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:23:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-1bf22919-1c46-4340-9e28-7f425308416c req-5965cb9e-ef63-4578-b7c0-8f00f2c5e618 tempest-AttachVolumeTestJSON-1797013884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:23:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-1bf22919-1c46-4340-9e28-7f425308416c req-5965cb9e-ef63-4578-b7c0-8f00f2c5e618 tempest-AttachVolumeTestJSON-1797013884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:23:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-1bf22919-1c46-4340-9e28-7f425308416c req-5965cb9e-ef63-4578-b7c0-8f00f2c5e618 tempest-AttachVolumeTestJSON-1797013884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:23:18 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-1bf22919-1c46-4340-9e28-7f425308416c req-5965cb9e-ef63-4578-b7c0-8f00f2c5e618 tempest-AttachVolumeTestJSON-1797013884 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a', 'name': 'volume-dd4f035a-5e51-4c41-b9c0-a37dd22506d2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'da02afba-a974-495e-a102-0fb6b0e02252', 'enforce_multipath': True} {{(pid=86082) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 15 16:23:18 devstack cinder-volume[86082]: INFO cinder.volume.manager [req-1bf22919-1c46-4340-9e28-7f425308416c req-5965cb9e-ef63-4578-b7c0-8f00f2c5e618 tempest-AttachVolumeTestJSON-1797013884 None] attachment_update completed successfully. Sep 15 16:23:21 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d4509ce-695c-4ea4-947f-bec558132c66 tempest-AttachVolumeTestJSON-1797013884 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:23:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5d4509ce-695c-4ea4-947f-bec558132c66 tempest-AttachVolumeTestJSON-1797013884 None] Flow 'volume_create_manager' (aaf09b5f-2556-4a4e-afc5-7ae3bfcdf432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:23:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5d4509ce-695c-4ea4-947f-bec558132c66 tempest-AttachVolumeTestJSON-1797013884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09066e60-2134-4707-8e28-c683079018e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:23:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5d4509ce-695c-4ea4-947f-bec558132c66 tempest-AttachVolumeTestJSON-1797013884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09066e60-2134-4707-8e28-c683079018e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:23:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1660938057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b023ea6e-5dbc-4090-ae1d-42affea3daad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4074182297cb4184b4a6b5d1aae1cc44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:23:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:23:22Z,use_quota=True,user_id='6e8071e77b4a42e8a3e07a9b3a4737f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:23:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5d4509ce-695c-4ea4-947f-bec558132c66 tempest-AttachVolumeTestJSON-1797013884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba9df296-7fa7-4e1c-9706-ae7e378e4b5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:23:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5d4509ce-695c-4ea4-947f-bec558132c66 tempest-AttachVolumeTestJSON-1797013884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba9df296-7fa7-4e1c-9706-ae7e378e4b5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:23:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5d4509ce-695c-4ea4-947f-bec558132c66 tempest-AttachVolumeTestJSON-1797013884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2fdc0e8-e466-4e58-814c-a91cd16d6549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:23:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5d4509ce-695c-4ea4-947f-bec558132c66 tempest-AttachVolumeTestJSON-1797013884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2fdc0e8-e466-4e58-814c-a91cd16d6549) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b023ea6e-5dbc-4090-ae1d-42affea3daad', 'volume_name': 'volume-b023ea6e-5dbc-4090-ae1d-42affea3daad', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:23:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5d4509ce-695c-4ea4-947f-bec558132c66 tempest-AttachVolumeTestJSON-1797013884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10409ca5-2adb-494c-828f-97a13b0383bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:23:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5d4509ce-695c-4ea4-947f-bec558132c66 tempest-AttachVolumeTestJSON-1797013884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10409ca5-2adb-494c-828f-97a13b0383bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:23:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5d4509ce-695c-4ea4-947f-bec558132c66 tempest-AttachVolumeTestJSON-1797013884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cde1a3d9-e0f9-45b5-a912-e19dfa1d90ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:23:21 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-5d4509ce-695c-4ea4-947f-bec558132c66 tempest-AttachVolumeTestJSON-1797013884 None] Volume b023ea6e-5dbc-4090-ae1d-42affea3daad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b023ea6e-5dbc-4090-ae1d-42affea3daad', 'volume_size': 1} Sep 15 16:23:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-5d4509ce-695c-4ea4-947f-bec558132c66 tempest-AttachVolumeTestJSON-1797013884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:23:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-5d4509ce-695c-4ea4-947f-bec558132c66 tempest-AttachVolumeTestJSON-1797013884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:23:21 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-5d4509ce-695c-4ea4-947f-bec558132c66 tempest-AttachVolumeTestJSON-1797013884 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:23:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1660938057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b023ea6e-5dbc-4090-ae1d-42affea3daad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4074182297cb4184b4a6b5d1aae1cc44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:23:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:23:22Z,use_quota=True,user_id='6e8071e77b4a42e8a3e07a9b3a4737f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:23:21 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-5d4509ce-695c-4ea4-947f-bec558132c66 tempest-AttachVolumeTestJSON-1797013884 None] Creating volume b023ea6e-5dbc-4090-ae1d-42affea3daad {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:23:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-5d4509ce-695c-4ea4-947f-bec558132c66 tempest-AttachVolumeTestJSON-1797013884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:23:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-5d4509ce-695c-4ea4-947f-bec558132c66 tempest-AttachVolumeTestJSON-1797013884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:23:21 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-5d4509ce-695c-4ea4-947f-bec558132c66 tempest-AttachVolumeTestJSON-1797013884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:23:21 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-5d4509ce-695c-4ea4-947f-bec558132c66 tempest-AttachVolumeTestJSON-1797013884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:23:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-5d4509ce-695c-4ea4-947f-bec558132c66 tempest-AttachVolumeTestJSON-1797013884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:23:21 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-5d4509ce-695c-4ea4-947f-bec558132c66 tempest-AttachVolumeTestJSON-1797013884 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:23:21 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-5d4509ce-695c-4ea4-947f-bec558132c66 tempest-AttachVolumeTestJSON-1797013884 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:23:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5d4509ce-695c-4ea4-947f-bec558132c66 tempest-AttachVolumeTestJSON-1797013884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b023ea6e-5dbc-4090-ae1d-42affea3daad 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:23:21 devstack sudo[95320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b023ea6e-5dbc-4090-ae1d-42affea3daad 1073741824 Sep 15 16:23:21 devstack sudo[95320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:23:22 devstack sudo[95320]: pam_unix(sudo:session): session closed for user root Sep 15 16:23:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5d4509ce-695c-4ea4-947f-bec558132c66 tempest-AttachVolumeTestJSON-1797013884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b023ea6e-5dbc-4090-ae1d-42affea3daad 1073741824" returned: 0 in 0.670s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:23:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5d4509ce-695c-4ea4-947f-bec558132c66 tempest-AttachVolumeTestJSON-1797013884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b023ea6e-5dbc-4090-ae1d-42affea3daad {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:23:22 devstack sudo[95326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b023ea6e-5dbc-4090-ae1d-42affea3daad Sep 15 16:23:22 devstack sudo[95326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:23:22 devstack sudo[95326]: pam_unix(sudo:session): session closed for user root Sep 15 16:23:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5d4509ce-695c-4ea4-947f-bec558132c66 tempest-AttachVolumeTestJSON-1797013884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b023ea6e-5dbc-4090-ae1d-42affea3daad" returned: 0 in 0.386s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:23:22 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-5d4509ce-695c-4ea4-947f-bec558132c66 tempest-AttachVolumeTestJSON-1797013884 None] <== create_volume: return (1157ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:23:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-5d4509ce-695c-4ea4-947f-bec558132c66 tempest-AttachVolumeTestJSON-1797013884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.160s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:23:22 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5d4509ce-695c-4ea4-947f-bec558132c66 tempest-AttachVolumeTestJSON-1797013884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cde1a3d9-e0f9-45b5-a912-e19dfa1d90ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b023ea6e-5dbc-4090-ae1d-42affea3daad', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:23:22 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5d4509ce-695c-4ea4-947f-bec558132c66 tempest-AttachVolumeTestJSON-1797013884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddd9fbe2-09aa-4663-86e2-677f879f2cbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:23:22 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-5d4509ce-695c-4ea4-947f-bec558132c66 tempest-AttachVolumeTestJSON-1797013884 None] Volume volume-b023ea6e-5dbc-4090-ae1d-42affea3daad (b023ea6e-5dbc-4090-ae1d-42affea3daad): created successfully Sep 15 16:23:22 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5d4509ce-695c-4ea4-947f-bec558132c66 tempest-AttachVolumeTestJSON-1797013884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddd9fbe2-09aa-4663-86e2-677f879f2cbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:23:22 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5d4509ce-695c-4ea4-947f-bec558132c66 tempest-AttachVolumeTestJSON-1797013884 None] Flow 'volume_create_manager' (aaf09b5f-2556-4a4e-afc5-7ae3bfcdf432) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:23:23 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-5d4509ce-695c-4ea4-947f-bec558132c66 tempest-AttachVolumeTestJSON-1797013884 None] Created volume successfully. Sep 15 16:23:24 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-42a4739f-0b9c-44c7-8d4c-bbec48bbd7d0 tempest-VolumesExtendTest-302669752 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:23:24 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-42a4739f-0b9c-44c7-8d4c-bbec48bbd7d0 tempest-VolumesExtendTest-302669752 None] Flow 'volume_create_manager' (cfdef576-cee1-466a-8cde-9506b81d1ed3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:23:24 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-42a4739f-0b9c-44c7-8d4c-bbec48bbd7d0 tempest-VolumesExtendTest-302669752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (357e18a9-444e-489c-ad86-b2aec148f889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:23:24 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-42a4739f-0b9c-44c7-8d4c-bbec48bbd7d0 tempest-VolumesExtendTest-302669752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (357e18a9-444e-489c-ad86-b2aec148f889) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:23:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1504682123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c103ab0-023f-45ea-837d-c5c28d92e637,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84fa7f78c2604e99afe437e21010e628',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:23:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:23:25Z,use_quota=True,user_id='a63b0660614c4d659ff021a83f1fbf2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:23:24 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-42a4739f-0b9c-44c7-8d4c-bbec48bbd7d0 tempest-VolumesExtendTest-302669752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a780e17d-e4a8-44ba-81ea-e2ef84cbae40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:23:24 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-42a4739f-0b9c-44c7-8d4c-bbec48bbd7d0 tempest-VolumesExtendTest-302669752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a780e17d-e4a8-44ba-81ea-e2ef84cbae40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:23:24 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-42a4739f-0b9c-44c7-8d4c-bbec48bbd7d0 tempest-VolumesExtendTest-302669752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8684cde5-3d89-4ed0-a2aa-888009c0c0f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:23:24 devstack cinder-volume[86082]: DEBUG cinder.image.glance [None req-42a4739f-0b9c-44c7-8d4c-bbec48bbd7d0 tempest-VolumesExtendTest-302669752 None] Creating Keystone auth plugin from conf {{(pid=86082) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 15 16:23:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-45eaca89-a815-486c-9da2-92338d0d9a59 req-b3adf93c-f6e2-46d8-9e9a-a5737e891df8 tempest-AttachVolumeTestJSON-1797013884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:23:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-45eaca89-a815-486c-9da2-92338d0d9a59 req-b3adf93c-f6e2-46d8-9e9a-a5737e891df8 tempest-AttachVolumeTestJSON-1797013884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:23:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-45eaca89-a815-486c-9da2-92338d0d9a59 req-b3adf93c-f6e2-46d8-9e9a-a5737e891df8 tempest-AttachVolumeTestJSON-1797013884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.085s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:23:25 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-45eaca89-a815-486c-9da2-92338d0d9a59 req-b3adf93c-f6e2-46d8-9e9a-a5737e891df8 tempest-AttachVolumeTestJSON-1797013884 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a', 'name': 'volume-b023ea6e-5dbc-4090-ae1d-42affea3daad', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '687f2c81-8ce5-4eb1-88e6-ab89e354437e', 'enforce_multipath': True} {{(pid=86082) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 15 16:23:25 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-42a4739f-0b9c-44c7-8d4c-bbec48bbd7d0 tempest-VolumesExtendTest-302669752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8684cde5-3d89-4ed0-a2aa-888009c0c0f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7c103ab0-023f-45ea-837d-c5c28d92e637', 'volume_name': 'volume-7c103ab0-023f-45ea-837d-c5c28d92e637', 'volume_size': 1, 'image_id': '0ea392d9-2af0-468e-bdc1-5e3f34bc52e6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0ea392d9-2af0-468e-bdc1-5e3f34bc52e6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e57b859e1a41428083b6d86ce51f5184', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0ea392d9-2af0-468e-bdc1-5e3f34bc52e6', 'created_at': datetime.datetime(2026, 9, 15, 14, 11, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 15, 14, 11, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0ea392d9-2af0-468e-bdc1-5e3f34bc52e6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:23:25 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-42a4739f-0b9c-44c7-8d4c-bbec48bbd7d0 tempest-VolumesExtendTest-302669752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (060c97e3-f97e-4e4b-b5de-921caaa8ca39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:23:25 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-42a4739f-0b9c-44c7-8d4c-bbec48bbd7d0 tempest-VolumesExtendTest-302669752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (060c97e3-f97e-4e4b-b5de-921caaa8ca39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:23:25 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-42a4739f-0b9c-44c7-8d4c-bbec48bbd7d0 tempest-VolumesExtendTest-302669752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adcb15ef-e881-4ea7-a99c-a0fa68ee0653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:23:25 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-42a4739f-0b9c-44c7-8d4c-bbec48bbd7d0 tempest-VolumesExtendTest-302669752 None] Volume 7c103ab0-023f-45ea-837d-c5c28d92e637: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7c103ab0-023f-45ea-837d-c5c28d92e637', 'volume_size': 1, 'image_id': '0ea392d9-2af0-468e-bdc1-5e3f34bc52e6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0ea392d9-2af0-468e-bdc1-5e3f34bc52e6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e57b859e1a41428083b6d86ce51f5184', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0ea392d9-2af0-468e-bdc1-5e3f34bc52e6', 'created_at': datetime.datetime(2026, 9, 15, 14, 11, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 15, 14, 11, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0ea392d9-2af0-468e-bdc1-5e3f34bc52e6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 15 16:23:25 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-42a4739f-0b9c-44c7-8d4c-bbec48bbd7d0 tempest-VolumesExtendTest-302669752 None] Trying to clone 7c103ab0-023f-45ea-837d-c5c28d92e637 from image 0ea392d9-2af0-468e-bdc1-5e3f34bc52e6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/0ea392d9-2af0-468e-bdc1-5e3f34bc52e6', 'metadata': {}}]). {{(pid=86082) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 15 16:23:25 devstack cinder-volume[86082]: INFO cinder.volume.manager [req-45eaca89-a815-486c-9da2-92338d0d9a59 req-b3adf93c-f6e2-46d8-9e9a-a5737e891df8 tempest-AttachVolumeTestJSON-1797013884 None] attachment_update completed successfully. Sep 15 16:23:26 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-42a4739f-0b9c-44c7-8d4c-bbec48bbd7d0 tempest-VolumesExtendTest-302669752 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0ea392d9-2af0-468e-bdc1-5e3f34bc52e6_cghu01c3devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86082) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 15 16:23:26 devstack cinder-volume[86082]: INFO cinder.image.image_utils [None req-42a4739f-0b9c-44c7-8d4c-bbec48bbd7d0 tempest-VolumesExtendTest-302669752 None] Image download 20.69 MB at 20.69 MB/s Sep 15 16:23:26 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d254e02-b7c4-444a-873f-353ae1edad7a]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:23:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-42a4739f-0b9c-44c7-8d4c-bbec48bbd7d0 tempest-VolumesExtendTest-302669752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ea392d9-2af0-468e-bdc1-5e3f34bc52e6_cghu01c3devstack@QuobyteHD {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:23:26 devstack sudo[95416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ea392d9-2af0-468e-bdc1-5e3f34bc52e6_cghu01c3devstack@QuobyteHD Sep 15 16:23:26 devstack sudo[95416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:23:26 devstack sudo[95416]: pam_unix(sudo:session): session closed for user root Sep 15 16:23:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-42a4739f-0b9c-44c7-8d4c-bbec48bbd7d0 tempest-VolumesExtendTest-302669752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ea392d9-2af0-468e-bdc1-5e3f34bc52e6_cghu01c3devstack@QuobyteHD" returned: 0 in 0.673s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:23:26 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-42a4739f-0b9c-44c7-8d4c-bbec48bbd7d0 tempest-VolumesExtendTest-302669752 None] Temporary image 0ea392d9-2af0-468e-bdc1-5e3f34bc52e6 is fetched for user a63b0660614c4d659ff021a83f1fbf2d. {{(pid=86082) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 15 16:23:27 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bf595e1-9ba6-43f8-b806-a2b57e0902bb]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:23:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-42a4739f-0b9c-44c7-8d4c-bbec48bbd7d0 tempest-VolumesExtendTest-302669752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ea392d9-2af0-468e-bdc1-5e3f34bc52e6_cghu01c3devstack@QuobyteHD {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:23:27 devstack sudo[95422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ea392d9-2af0-468e-bdc1-5e3f34bc52e6_cghu01c3devstack@QuobyteHD Sep 15 16:23:27 devstack sudo[95422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:23:27 devstack sudo[95422]: pam_unix(sudo:session): session closed for user root Sep 15 16:23:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-42a4739f-0b9c-44c7-8d4c-bbec48bbd7d0 tempest-VolumesExtendTest-302669752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ea392d9-2af0-468e-bdc1-5e3f34bc52e6_cghu01c3devstack@QuobyteHD" returned: 0 in 0.451s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:23:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-42a4739f-0b9c-44c7-8d4c-bbec48bbd7d0 tempest-VolumesExtendTest-302669752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:23:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-42a4739f-0b9c-44c7-8d4c-bbec48bbd7d0 tempest-VolumesExtendTest-302669752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:23:27 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-42a4739f-0b9c-44c7-8d4c-bbec48bbd7d0 tempest-VolumesExtendTest-302669752 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:23:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1504682123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c103ab0-023f-45ea-837d-c5c28d92e637,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84fa7f78c2604e99afe437e21010e628',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:23:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:23:25Z,use_quota=True,user_id='a63b0660614c4d659ff021a83f1fbf2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:23:27 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-42a4739f-0b9c-44c7-8d4c-bbec48bbd7d0 tempest-VolumesExtendTest-302669752 None] Creating volume 7c103ab0-023f-45ea-837d-c5c28d92e637 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:23:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-42a4739f-0b9c-44c7-8d4c-bbec48bbd7d0 tempest-VolumesExtendTest-302669752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:23:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-42a4739f-0b9c-44c7-8d4c-bbec48bbd7d0 tempest-VolumesExtendTest-302669752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:23:27 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-42a4739f-0b9c-44c7-8d4c-bbec48bbd7d0 tempest-VolumesExtendTest-302669752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:23:27 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-42a4739f-0b9c-44c7-8d4c-bbec48bbd7d0 tempest-VolumesExtendTest-302669752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:23:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-42a4739f-0b9c-44c7-8d4c-bbec48bbd7d0 tempest-VolumesExtendTest-302669752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:23:27 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-42a4739f-0b9c-44c7-8d4c-bbec48bbd7d0 tempest-VolumesExtendTest-302669752 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:23:27 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-42a4739f-0b9c-44c7-8d4c-bbec48bbd7d0 tempest-VolumesExtendTest-302669752 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:23:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-42a4739f-0b9c-44c7-8d4c-bbec48bbd7d0 tempest-VolumesExtendTest-302669752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-7c103ab0-023f-45ea-837d-c5c28d92e637 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:23:27 devstack sudo[95430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-7c103ab0-023f-45ea-837d-c5c28d92e637 1073741824 Sep 15 16:23:27 devstack sudo[95430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:23:28 devstack sudo[95430]: pam_unix(sudo:session): session closed for user root Sep 15 16:23:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-42a4739f-0b9c-44c7-8d4c-bbec48bbd7d0 tempest-VolumesExtendTest-302669752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-7c103ab0-023f-45ea-837d-c5c28d92e637 1073741824" returned: 0 in 0.746s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:23:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-42a4739f-0b9c-44c7-8d4c-bbec48bbd7d0 tempest-VolumesExtendTest-302669752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-7c103ab0-023f-45ea-837d-c5c28d92e637 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:23:28 devstack sudo[95438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-7c103ab0-023f-45ea-837d-c5c28d92e637 Sep 15 16:23:28 devstack sudo[95438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:23:28 devstack cinder-volume[86082]: INFO cinder.volume.manager [req-a34756bf-dcb1-417e-8649-73fc90ff96ee req-ac839a78-5010-4f6a-9142-4c3ea3039fd2 tempest-AttachVolumeTestJSON-1797013884 None] Terminate volume connection completed successfully. Sep 15 16:23:28 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-a34756bf-dcb1-417e-8649-73fc90ff96ee req-ac839a78-5010-4f6a-9142-4c3ea3039fd2 tempest-AttachVolumeTestJSON-1797013884 None] Deleting attachment da02afba-a974-495e-a102-0fb6b0e02252. {{(pid=86082) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 15 16:23:28 devstack sudo[95438]: pam_unix(sudo:session): session closed for user root Sep 15 16:23:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-42a4739f-0b9c-44c7-8d4c-bbec48bbd7d0 tempest-VolumesExtendTest-302669752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-7c103ab0-023f-45ea-837d-c5c28d92e637" returned: 0 in 0.340s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:23:28 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-42a4739f-0b9c-44c7-8d4c-bbec48bbd7d0 tempest-VolumesExtendTest-302669752 None] <== create_volume: return (1151ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:23:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-42a4739f-0b9c-44c7-8d4c-bbec48bbd7d0 tempest-VolumesExtendTest-302669752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.155s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:23:28 devstack cinder-volume[86082]: DEBUG cinder.volume.volume_utils [None req-42a4739f-0b9c-44c7-8d4c-bbec48bbd7d0 tempest-VolumesExtendTest-302669752 None] Attempting download of 0ea392d9-2af0-468e-bdc1-5e3f34bc52e6 ((None, [{'url': 'file:///opt/stack/data/glance/images/0ea392d9-2af0-468e-bdc1-5e3f34bc52e6', 'metadata': {}}])) to volume 7c103ab0-023f-45ea-837d-c5c28d92e637. {{(pid=86082) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 15 16:23:28 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[70368c0d-87ce-4f2f-8151-4ceb038d65e1]: (4, 'raw') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:23:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-42a4739f-0b9c-44c7-8d4c-bbec48bbd7d0 tempest-VolumesExtendTest-302669752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0ea392d9-2af0-468e-bdc1-5e3f34bc52e6_3h04pppj {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:23:29 devstack sudo[95442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0ea392d9-2af0-468e-bdc1-5e3f34bc52e6_3h04pppj Sep 15 16:23:29 devstack sudo[95442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:23:29 devstack sudo[95442]: pam_unix(sudo:session): session closed for user root Sep 15 16:23:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-42a4739f-0b9c-44c7-8d4c-bbec48bbd7d0 tempest-VolumesExtendTest-302669752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0ea392d9-2af0-468e-bdc1-5e3f34bc52e6_3h04pppj" returned: 0 in 0.544s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:23:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-42a4739f-0b9c-44c7-8d4c-bbec48bbd7d0 tempest-VolumesExtendTest-302669752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0ea392d9-2af0-468e-bdc1-5e3f34bc52e6_3h04pppj {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:23:29 devstack sudo[95446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0ea392d9-2af0-468e-bdc1-5e3f34bc52e6_3h04pppj Sep 15 16:23:29 devstack sudo[95446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:23:30 devstack sudo[95446]: pam_unix(sudo:session): session closed for user root Sep 15 16:23:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-42a4739f-0b9c-44c7-8d4c-bbec48bbd7d0 tempest-VolumesExtendTest-302669752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0ea392d9-2af0-468e-bdc1-5e3f34bc52e6_3h04pppj" returned: 1 in 0.683s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:23:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-42a4739f-0b9c-44c7-8d4c-bbec48bbd7d0 tempest-VolumesExtendTest-302669752 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0ea392d9-2af0-468e-bdc1-5e3f34bc52e6_3h04pppj' failed. Not Retrying. {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 15 16:23:30 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[a68c33d5-8967-40c3-b7d0-5999d7db51cc]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:23:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-42a4739f-0b9c-44c7-8d4c-bbec48bbd7d0 tempest-VolumesExtendTest-302669752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ea392d9-2af0-468e-bdc1-5e3f34bc52e6_cghu01c3devstack@QuobyteHD {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:23:30 devstack sudo[95451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ea392d9-2af0-468e-bdc1-5e3f34bc52e6_cghu01c3devstack@QuobyteHD Sep 15 16:23:30 devstack sudo[95451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:23:30 devstack cinder-volume[86082]: INFO cinder.volume.manager [req-769e3ff7-f7f2-4213-acf9-161295528cc3 req-67fc654f-829d-483b-b2f8-1ce19f411dad tempest-AttachVolumeTestJSON-1797013884 None] Terminate volume connection completed successfully. Sep 15 16:23:30 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-769e3ff7-f7f2-4213-acf9-161295528cc3 req-67fc654f-829d-483b-b2f8-1ce19f411dad tempest-AttachVolumeTestJSON-1797013884 None] Deleting attachment 687f2c81-8ce5-4eb1-88e6-ab89e354437e. {{(pid=86082) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 15 16:23:30 devstack sudo[95451]: pam_unix(sudo:session): session closed for user root Sep 15 16:23:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-42a4739f-0b9c-44c7-8d4c-bbec48bbd7d0 tempest-VolumesExtendTest-302669752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ea392d9-2af0-468e-bdc1-5e3f34bc52e6_cghu01c3devstack@QuobyteHD" returned: 0 in 0.624s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:23:30 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-42a4739f-0b9c-44c7-8d4c-bbec48bbd7d0 tempest-VolumesExtendTest-302669752 None] 0ea392d9-2af0-468e-bdc1-5e3f34bc52e6 was qcow2, converting to qcow2 {{(pid=86082) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 15 16:23:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-42a4739f-0b9c-44c7-8d4c-bbec48bbd7d0 tempest-VolumesExtendTest-302669752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0ea392d9-2af0-468e-bdc1-5e3f34bc52e6_cghu01c3devstack@QuobyteHD /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-7c103ab0-023f-45ea-837d-c5c28d92e637 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:23:30 devstack sudo[95490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0ea392d9-2af0-468e-bdc1-5e3f34bc52e6_cghu01c3devstack@QuobyteHD /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-7c103ab0-023f-45ea-837d-c5c28d92e637 Sep 15 16:23:30 devstack sudo[95490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:23:33 devstack sudo[95490]: pam_unix(sudo:session): session closed for user root Sep 15 16:23:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-42a4739f-0b9c-44c7-8d4c-bbec48bbd7d0 tempest-VolumesExtendTest-302669752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0ea392d9-2af0-468e-bdc1-5e3f34bc52e6_cghu01c3devstack@QuobyteHD /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-7c103ab0-023f-45ea-837d-c5c28d92e637" returned: 0 in 3.219s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:23:33 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-42a4739f-0b9c-44c7-8d4c-bbec48bbd7d0 tempest-VolumesExtendTest-302669752 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0ea392d9-2af0-468e-bdc1-5e3f34bc52e6_cghu01c3devstack@QuobyteHD, size 112.00 MB, duration 3.22 sec, destination /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-7c103ab0-023f-45ea-837d-c5c28d92e637 {{(pid=86082) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 15 16:23:33 devstack cinder-volume[86082]: INFO cinder.image.image_utils [None req-42a4739f-0b9c-44c7-8d4c-bbec48bbd7d0 tempest-VolumesExtendTest-302669752 None] Converted 112.00 MB image at 34.77 MB/s Sep 15 16:23:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-42a4739f-0b9c-44c7-8d4c-bbec48bbd7d0 tempest-VolumesExtendTest-302669752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-7c103ab0-023f-45ea-837d-c5c28d92e637 1G {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:23:34 devstack sudo[95519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-7c103ab0-023f-45ea-837d-c5c28d92e637 1G Sep 15 16:23:34 devstack sudo[95519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:23:34 devstack sudo[95519]: pam_unix(sudo:session): session closed for user root Sep 15 16:23:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-42a4739f-0b9c-44c7-8d4c-bbec48bbd7d0 tempest-VolumesExtendTest-302669752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-7c103ab0-023f-45ea-837d-c5c28d92e637 1G" returned: 0 in 0.515s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:23:34 devstack cinder-volume[86082]: DEBUG cinder.volume.volume_utils [None req-42a4739f-0b9c-44c7-8d4c-bbec48bbd7d0 tempest-VolumesExtendTest-302669752 None] Downloaded image 0ea392d9-2af0-468e-bdc1-5e3f34bc52e6 ((None, [{'url': 'file:///opt/stack/data/glance/images/0ea392d9-2af0-468e-bdc1-5e3f34bc52e6', 'metadata': {}}])) to volume 7c103ab0-023f-45ea-837d-c5c28d92e637 successfully. {{(pid=86082) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 15 16:23:34 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-42a4739f-0b9c-44c7-8d4c-bbec48bbd7d0 tempest-VolumesExtendTest-302669752 None] Temporary image 0ea392d9-2af0-468e-bdc1-5e3f34bc52e6 for user a63b0660614c4d659ff021a83f1fbf2d is deleted. {{(pid=86082) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 15 16:23:34 devstack cinder-volume[86082]: DEBUG cinder.volume.volume_utils [None req-42a4739f-0b9c-44c7-8d4c-bbec48bbd7d0 tempest-VolumesExtendTest-302669752 None] Marking volume 7c103ab0-023f-45ea-837d-c5c28d92e637 as bootable. {{(pid=86082) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 15 16:23:34 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-42a4739f-0b9c-44c7-8d4c-bbec48bbd7d0 tempest-VolumesExtendTest-302669752 None] Copying metadata from image 0ea392d9-2af0-468e-bdc1-5e3f34bc52e6 to 7c103ab0-023f-45ea-837d-c5c28d92e637. {{(pid=86082) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 15 16:23:34 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-42a4739f-0b9c-44c7-8d4c-bbec48bbd7d0 tempest-VolumesExtendTest-302669752 None] Creating volume glance metadata for volume 7c103ab0-023f-45ea-837d-c5c28d92e637 backed by image 0ea392d9-2af0-468e-bdc1-5e3f34bc52e6 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '0ea392d9-2af0-468e-bdc1-5e3f34bc52e6', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86082) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 15 16:23:34 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-42a4739f-0b9c-44c7-8d4c-bbec48bbd7d0 tempest-VolumesExtendTest-302669752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adcb15ef-e881-4ea7-a99c-a0fa68ee0653) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c103ab0-023f-45ea-837d-c5c28d92e637', 'volume_size': 1, 'image_id': '0ea392d9-2af0-468e-bdc1-5e3f34bc52e6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0ea392d9-2af0-468e-bdc1-5e3f34bc52e6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e57b859e1a41428083b6d86ce51f5184', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0ea392d9-2af0-468e-bdc1-5e3f34bc52e6', 'created_at': datetime.datetime(2026, 9, 15, 14, 11, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 15, 14, 11, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0ea392d9-2af0-468e-bdc1-5e3f34bc52e6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:23:34 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-42a4739f-0b9c-44c7-8d4c-bbec48bbd7d0 tempest-VolumesExtendTest-302669752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf8ffde4-25dd-4026-9d37-8109309489fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:23:34 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-42a4739f-0b9c-44c7-8d4c-bbec48bbd7d0 tempest-VolumesExtendTest-302669752 None] Volume volume-7c103ab0-023f-45ea-837d-c5c28d92e637 (7c103ab0-023f-45ea-837d-c5c28d92e637): created successfully Sep 15 16:23:34 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-42a4739f-0b9c-44c7-8d4c-bbec48bbd7d0 tempest-VolumesExtendTest-302669752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf8ffde4-25dd-4026-9d37-8109309489fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:23:34 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-42a4739f-0b9c-44c7-8d4c-bbec48bbd7d0 tempest-VolumesExtendTest-302669752 None] Flow 'volume_create_manager' (cfdef576-cee1-466a-8cde-9506b81d1ed3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:23:34 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-42a4739f-0b9c-44c7-8d4c-bbec48bbd7d0 tempest-VolumesExtendTest-302669752 None] Created volume successfully. Sep 15 16:23:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-d47631f8-1f2e-4a76-9ddc-3291295c66d9 tempest-VolumesExtendTest-302669752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:23:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-d47631f8-1f2e-4a76-9ddc-3291295c66d9 tempest-VolumesExtendTest-302669752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:23:36 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab1d8f92-d597-4413-abb8-6b4c57a48a0b]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:23:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d47631f8-1f2e-4a76-9ddc-3291295c66d9 tempest-VolumesExtendTest-302669752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-7c103ab0-023f-45ea-837d-c5c28d92e637 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:23:36 devstack sudo[95525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-7c103ab0-023f-45ea-837d-c5c28d92e637 Sep 15 16:23:36 devstack sudo[95525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:23:36 devstack sudo[95525]: pam_unix(sudo:session): session closed for user root Sep 15 16:23:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d47631f8-1f2e-4a76-9ddc-3291295c66d9 tempest-VolumesExtendTest-302669752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-7c103ab0-023f-45ea-837d-c5c28d92e637" returned: 0 in 0.658s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:23:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d47631f8-1f2e-4a76-9ddc-3291295c66d9 tempest-VolumesExtendTest-302669752 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-7c103ab0-023f-45ea-837d-c5c28d92e637 2G {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:23:36 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-adb80e10-70e6-471c-ae0c-4d0ac34f6570 tempest-AttachVolumeTestJSON-1797013884 None] Acquiring lock "cinder-b023ea6e-5dbc-4090-ae1d-42affea3daad-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:23:36 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-adb80e10-70e6-471c-ae0c-4d0ac34f6570 tempest-AttachVolumeTestJSON-1797013884 None] Lock "cinder-b023ea6e-5dbc-4090-ae1d-42affea3daad-delete_volume" acquired by "delete_volume" :: waited 0.080s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:23:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d47631f8-1f2e-4a76-9ddc-3291295c66d9 tempest-VolumesExtendTest-302669752 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-7c103ab0-023f-45ea-837d-c5c28d92e637 2G" returned: 0 in 0.162s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:23:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-d47631f8-1f2e-4a76-9ddc-3291295c66d9 tempest-VolumesExtendTest-302669752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.846s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:23:36 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-adb80e10-70e6-471c-ae0c-4d0ac34f6570 tempest-AttachVolumeTestJSON-1797013884 None] Acquiring lock "cinder-quobyte-b023ea6e-5dbc-4090-ae1d-42affea3daad" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:23:36 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-d47631f8-1f2e-4a76-9ddc-3291295c66d9 tempest-VolumesExtendTest-302669752 None] Extend volume completed successfully. Sep 15 16:23:37 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-adb80e10-70e6-471c-ae0c-4d0ac34f6570 tempest-AttachVolumeTestJSON-1797013884 None] Lock "cinder-quobyte-b023ea6e-5dbc-4090-ae1d-42affea3daad" acquired by "delete_volume" :: waited 0.030s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:23:37 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9632349-d389-4215-bcdb-84f7d8121e82]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:23:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-adb80e10-70e6-471c-ae0c-4d0ac34f6570 tempest-AttachVolumeTestJSON-1797013884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b023ea6e-5dbc-4090-ae1d-42affea3daad {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:23:37 devstack sudo[95537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b023ea6e-5dbc-4090-ae1d-42affea3daad Sep 15 16:23:37 devstack sudo[95537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:23:37 devstack sudo[95537]: pam_unix(sudo:session): session closed for user root Sep 15 16:23:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-adb80e10-70e6-471c-ae0c-4d0ac34f6570 tempest-AttachVolumeTestJSON-1797013884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b023ea6e-5dbc-4090-ae1d-42affea3daad" returned: 0 in 0.563s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:23:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-adb80e10-70e6-471c-ae0c-4d0ac34f6570 tempest-AttachVolumeTestJSON-1797013884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b023ea6e-5dbc-4090-ae1d-42affea3daad {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:23:37 devstack sudo[95542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b023ea6e-5dbc-4090-ae1d-42affea3daad Sep 15 16:23:37 devstack sudo[95542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:23:37 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-d9916293-558d-42de-97fa-f47a3a9d89d3 tempest-VolumesExtendTest-302669752 None] Acquiring lock "cinder-7c103ab0-023f-45ea-837d-c5c28d92e637-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:23:37 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-d9916293-558d-42de-97fa-f47a3a9d89d3 tempest-VolumesExtendTest-302669752 None] Lock "cinder-7c103ab0-023f-45ea-837d-c5c28d92e637-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:23:37 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-d9916293-558d-42de-97fa-f47a3a9d89d3 tempest-VolumesExtendTest-302669752 None] Acquiring lock "cinder-quobyte-7c103ab0-023f-45ea-837d-c5c28d92e637" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:23:37 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-d9916293-558d-42de-97fa-f47a3a9d89d3 tempest-VolumesExtendTest-302669752 None] Lock "cinder-quobyte-7c103ab0-023f-45ea-837d-c5c28d92e637" acquired by "delete_volume" :: waited 0.019s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:23:37 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fccf715-a2e5-4e6b-a0bb-a26d6223331c]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:23:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d9916293-558d-42de-97fa-f47a3a9d89d3 tempest-VolumesExtendTest-302669752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-7c103ab0-023f-45ea-837d-c5c28d92e637 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:23:37 devstack sudo[95544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-7c103ab0-023f-45ea-837d-c5c28d92e637 Sep 15 16:23:37 devstack sudo[95544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:23:38 devstack sudo[95542]: pam_unix(sudo:session): session closed for user root Sep 15 16:23:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-adb80e10-70e6-471c-ae0c-4d0ac34f6570 tempest-AttachVolumeTestJSON-1797013884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b023ea6e-5dbc-4090-ae1d-42affea3daad" returned: 0 in 0.434s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:23:38 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-adb80e10-70e6-471c-ae0c-4d0ac34f6570 tempest-AttachVolumeTestJSON-1797013884 None] Lock "cinder-quobyte-b023ea6e-5dbc-4090-ae1d-42affea3daad" released by "delete_volume" :: held 1.060s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:23:38 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-adb80e10-70e6-471c-ae0c-4d0ac34f6570 tempest-AttachVolumeTestJSON-1797013884 None] Created reservations ['0faafa4b-702c-42d1-89e7-b0db4a2a5f3c', '6c03ec47-aa9b-400a-b499-aaeec6fe8e79', '850853ad-d8fc-444c-a8b5-5cca4c09f847', '73477c28-d65c-4e60-90f7-355ce8caa0b7'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:23:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-adb80e10-70e6-471c-ae0c-4d0ac34f6570 tempest-AttachVolumeTestJSON-1797013884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:23:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-adb80e10-70e6-471c-ae0c-4d0ac34f6570 tempest-AttachVolumeTestJSON-1797013884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:23:38 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-adb80e10-70e6-471c-ae0c-4d0ac34f6570 tempest-AttachVolumeTestJSON-1797013884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:23:38 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-adb80e10-70e6-471c-ae0c-4d0ac34f6570 tempest-AttachVolumeTestJSON-1797013884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:23:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-adb80e10-70e6-471c-ae0c-4d0ac34f6570 tempest-AttachVolumeTestJSON-1797013884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:23:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-adb80e10-70e6-471c-ae0c-4d0ac34f6570 tempest-AttachVolumeTestJSON-1797013884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:23:38 devstack sudo[95549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:23:38 devstack sudo[95549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:23:38 devstack sudo[95544]: pam_unix(sudo:session): session closed for user root Sep 15 16:23:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d9916293-558d-42de-97fa-f47a3a9d89d3 tempest-VolumesExtendTest-302669752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-7c103ab0-023f-45ea-837d-c5c28d92e637" returned: 0 in 0.536s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:23:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d9916293-558d-42de-97fa-f47a3a9d89d3 tempest-VolumesExtendTest-302669752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-7c103ab0-023f-45ea-837d-c5c28d92e637 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:23:38 devstack sudo[95552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-7c103ab0-023f-45ea-837d-c5c28d92e637 Sep 15 16:23:38 devstack sudo[95552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:23:38 devstack sudo[95549]: pam_unix(sudo:session): session closed for user root Sep 15 16:23:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-adb80e10-70e6-471c-ae0c-4d0ac34f6570 tempest-AttachVolumeTestJSON-1797013884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.315s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:23:38 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-adb80e10-70e6-471c-ae0c-4d0ac34f6570 tempest-AttachVolumeTestJSON-1797013884 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:23:38 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-adb80e10-70e6-471c-ae0c-4d0ac34f6570 tempest-AttachVolumeTestJSON-1797013884 None] Deleted volume successfully. Sep 15 16:23:38 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-adb80e10-70e6-471c-ae0c-4d0ac34f6570 tempest-AttachVolumeTestJSON-1797013884 None] Lock "cinder-b023ea6e-5dbc-4090-ae1d-42affea3daad-delete_volume" released by "delete_volume" :: held 1.755s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:23:38 devstack sudo[95552]: pam_unix(sudo:session): session closed for user root Sep 15 16:23:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d9916293-558d-42de-97fa-f47a3a9d89d3 tempest-VolumesExtendTest-302669752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-7c103ab0-023f-45ea-837d-c5c28d92e637" returned: 0 in 0.380s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:23:38 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-d9916293-558d-42de-97fa-f47a3a9d89d3 tempest-VolumesExtendTest-302669752 None] Lock "cinder-quobyte-7c103ab0-023f-45ea-837d-c5c28d92e637" released by "delete_volume" :: held 0.990s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:23:38 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-d9916293-558d-42de-97fa-f47a3a9d89d3 tempest-VolumesExtendTest-302669752 None] Created reservations ['e1bb6cbe-19ea-4a03-b631-c383304ab9d7', '7704950d-6118-41d9-b46f-6302e7bcd391', 'e9484f02-9b55-4865-995d-210d92f336e4', '321f453f-3116-4e26-a27b-637a7b5c018c'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:23:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-d9916293-558d-42de-97fa-f47a3a9d89d3 tempest-VolumesExtendTest-302669752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:23:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-d9916293-558d-42de-97fa-f47a3a9d89d3 tempest-VolumesExtendTest-302669752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:23:38 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-d9916293-558d-42de-97fa-f47a3a9d89d3 tempest-VolumesExtendTest-302669752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:23:38 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-d9916293-558d-42de-97fa-f47a3a9d89d3 tempest-VolumesExtendTest-302669752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:23:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-d9916293-558d-42de-97fa-f47a3a9d89d3 tempest-VolumesExtendTest-302669752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:23:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d9916293-558d-42de-97fa-f47a3a9d89d3 tempest-VolumesExtendTest-302669752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:23:38 devstack sudo[95575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:23:38 devstack sudo[95575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:23:39 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-5c430d09-6ba1-4f50-82b4-ab11722c6175 tempest-AttachVolumeTestJSON-1797013884 None] Acquiring lock "cinder-dd4f035a-5e51-4c41-b9c0-a37dd22506d2-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:23:39 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-5c430d09-6ba1-4f50-82b4-ab11722c6175 tempest-AttachVolumeTestJSON-1797013884 None] Lock "cinder-dd4f035a-5e51-4c41-b9c0-a37dd22506d2-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:23:39 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-5c430d09-6ba1-4f50-82b4-ab11722c6175 tempest-AttachVolumeTestJSON-1797013884 None] Acquiring lock "cinder-quobyte-dd4f035a-5e51-4c41-b9c0-a37dd22506d2" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:23:39 devstack sudo[95575]: pam_unix(sudo:session): session closed for user root Sep 15 16:23:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d9916293-558d-42de-97fa-f47a3a9d89d3 tempest-VolumesExtendTest-302669752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.361s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:23:39 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-d9916293-558d-42de-97fa-f47a3a9d89d3 tempest-VolumesExtendTest-302669752 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:23:39 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-5c430d09-6ba1-4f50-82b4-ab11722c6175 tempest-AttachVolumeTestJSON-1797013884 None] Lock "cinder-quobyte-dd4f035a-5e51-4c41-b9c0-a37dd22506d2" acquired by "delete_volume" :: waited 0.033s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:23:39 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-d9916293-558d-42de-97fa-f47a3a9d89d3 tempest-VolumesExtendTest-302669752 None] Deleted volume successfully. Sep 15 16:23:39 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[b905f7c8-41ac-4066-a9f0-8e0504f962c6]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:23:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5c430d09-6ba1-4f50-82b4-ab11722c6175 tempest-AttachVolumeTestJSON-1797013884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-dd4f035a-5e51-4c41-b9c0-a37dd22506d2 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:23:39 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-d9916293-558d-42de-97fa-f47a3a9d89d3 tempest-VolumesExtendTest-302669752 None] Lock "cinder-7c103ab0-023f-45ea-837d-c5c28d92e637-delete_volume" released by "delete_volume" :: held 1.683s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:23:39 devstack sudo[95578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-dd4f035a-5e51-4c41-b9c0-a37dd22506d2 Sep 15 16:23:39 devstack sudo[95578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:23:39 devstack sudo[95578]: pam_unix(sudo:session): session closed for user root Sep 15 16:23:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5c430d09-6ba1-4f50-82b4-ab11722c6175 tempest-AttachVolumeTestJSON-1797013884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-dd4f035a-5e51-4c41-b9c0-a37dd22506d2" returned: 0 in 0.413s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:23:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5c430d09-6ba1-4f50-82b4-ab11722c6175 tempest-AttachVolumeTestJSON-1797013884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-dd4f035a-5e51-4c41-b9c0-a37dd22506d2 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:23:39 devstack sudo[95583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-dd4f035a-5e51-4c41-b9c0-a37dd22506d2 Sep 15 16:23:39 devstack sudo[95583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:23:40 devstack sudo[95583]: pam_unix(sudo:session): session closed for user root Sep 15 16:23:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5c430d09-6ba1-4f50-82b4-ab11722c6175 tempest-AttachVolumeTestJSON-1797013884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-dd4f035a-5e51-4c41-b9c0-a37dd22506d2" returned: 0 in 0.268s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:23:40 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-5c430d09-6ba1-4f50-82b4-ab11722c6175 tempest-AttachVolumeTestJSON-1797013884 None] Lock "cinder-quobyte-dd4f035a-5e51-4c41-b9c0-a37dd22506d2" released by "delete_volume" :: held 0.743s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:23:40 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-5c430d09-6ba1-4f50-82b4-ab11722c6175 tempest-AttachVolumeTestJSON-1797013884 None] Created reservations ['4ca2d371-7348-4e6b-ac76-d2129355dcf2', '69fb58c1-bb44-44b3-9d0e-b8f3df304b4f', '03d1b0cc-8b20-4889-89bf-8edb878914e7', '3a872ee5-d22f-4358-8e5d-c7d3a61d6cc3'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:23:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-5c430d09-6ba1-4f50-82b4-ab11722c6175 tempest-AttachVolumeTestJSON-1797013884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:23:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-5c430d09-6ba1-4f50-82b4-ab11722c6175 tempest-AttachVolumeTestJSON-1797013884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:23:40 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-5c430d09-6ba1-4f50-82b4-ab11722c6175 tempest-AttachVolumeTestJSON-1797013884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:23:40 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-5c430d09-6ba1-4f50-82b4-ab11722c6175 tempest-AttachVolumeTestJSON-1797013884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:23:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-5c430d09-6ba1-4f50-82b4-ab11722c6175 tempest-AttachVolumeTestJSON-1797013884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:23:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5c430d09-6ba1-4f50-82b4-ab11722c6175 tempest-AttachVolumeTestJSON-1797013884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:23:40 devstack sudo[95586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:23:40 devstack sudo[95586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:23:40 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3a1715c-8738-4395-934f-b978befb8d71 tempest-VolumesExtendTest-302669752 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:23:40 devstack sudo[95586]: pam_unix(sudo:session): session closed for user root Sep 15 16:23:40 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b3a1715c-8738-4395-934f-b978befb8d71 tempest-VolumesExtendTest-302669752 None] Flow 'volume_create_manager' (85d53cd5-9f2c-41a6-ab27-78ba5addfab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:23:40 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b3a1715c-8738-4395-934f-b978befb8d71 tempest-VolumesExtendTest-302669752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (910a035f-213d-4c22-898f-015659c611c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:23:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5c430d09-6ba1-4f50-82b4-ab11722c6175 tempest-AttachVolumeTestJSON-1797013884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.382s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:23:40 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-5c430d09-6ba1-4f50-82b4-ab11722c6175 tempest-AttachVolumeTestJSON-1797013884 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:23:40 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-547ba089-b3b6-4f9e-b875-76e2d330452d tempest-AttachVolumeTestJSON-1797013884 None] Acquiring lock "cinder-23be684f-34c0-4ce2-9e13-1be7eac89e5a-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:23:40 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-5c430d09-6ba1-4f50-82b4-ab11722c6175 tempest-AttachVolumeTestJSON-1797013884 None] Deleted volume successfully. Sep 15 16:23:40 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b3a1715c-8738-4395-934f-b978befb8d71 tempest-VolumesExtendTest-302669752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (910a035f-213d-4c22-898f-015659c611c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:23:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-974737689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6513a4f-932f-4a38-b26f-5a0f13bcd81d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84fa7f78c2604e99afe437e21010e628',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:23:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:23:40Z,use_quota=True,user_id='a63b0660614c4d659ff021a83f1fbf2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:23:40 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b3a1715c-8738-4395-934f-b978befb8d71 tempest-VolumesExtendTest-302669752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2c9770f-a91d-4aaa-80ce-8cb22d202d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:23:40 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b3a1715c-8738-4395-934f-b978befb8d71 tempest-VolumesExtendTest-302669752 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2c9770f-a91d-4aaa-80ce-8cb22d202d1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:23:40 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b3a1715c-8738-4395-934f-b978befb8d71 tempest-VolumesExtendTest-302669752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (216af525-546c-48f2-9f5b-d8ab75202191) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:23:40 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b3a1715c-8738-4395-934f-b978befb8d71 tempest-VolumesExtendTest-302669752 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (216af525-546c-48f2-9f5b-d8ab75202191) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6513a4f-932f-4a38-b26f-5a0f13bcd81d', 'volume_name': 'volume-a6513a4f-932f-4a38-b26f-5a0f13bcd81d', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:23:40 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b3a1715c-8738-4395-934f-b978befb8d71 tempest-VolumesExtendTest-302669752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2b09c89-1f06-438b-bd44-223391194d2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:23:40 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b3a1715c-8738-4395-934f-b978befb8d71 tempest-VolumesExtendTest-302669752 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2b09c89-1f06-438b-bd44-223391194d2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:23:40 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b3a1715c-8738-4395-934f-b978befb8d71 tempest-VolumesExtendTest-302669752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9aecc9c7-0483-40f7-b021-638f853e1cca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:23:40 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-b3a1715c-8738-4395-934f-b978befb8d71 tempest-VolumesExtendTest-302669752 None] Volume a6513a4f-932f-4a38-b26f-5a0f13bcd81d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6513a4f-932f-4a38-b26f-5a0f13bcd81d', 'volume_size': 1} Sep 15 16:23:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b3a1715c-8738-4395-934f-b978befb8d71 tempest-VolumesExtendTest-302669752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:23:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b3a1715c-8738-4395-934f-b978befb8d71 tempest-VolumesExtendTest-302669752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:23:40 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-b3a1715c-8738-4395-934f-b978befb8d71 tempest-VolumesExtendTest-302669752 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:23:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-974737689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6513a4f-932f-4a38-b26f-5a0f13bcd81d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84fa7f78c2604e99afe437e21010e628',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:23:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:23:40Z,use_quota=True,user_id='a63b0660614c4d659ff021a83f1fbf2d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:23:40 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-b3a1715c-8738-4395-934f-b978befb8d71 tempest-VolumesExtendTest-302669752 None] Creating volume a6513a4f-932f-4a38-b26f-5a0f13bcd81d {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:23:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b3a1715c-8738-4395-934f-b978befb8d71 tempest-VolumesExtendTest-302669752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:23:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b3a1715c-8738-4395-934f-b978befb8d71 tempest-VolumesExtendTest-302669752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:23:40 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-b3a1715c-8738-4395-934f-b978befb8d71 tempest-VolumesExtendTest-302669752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:23:40 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-b3a1715c-8738-4395-934f-b978befb8d71 tempest-VolumesExtendTest-302669752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:23:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b3a1715c-8738-4395-934f-b978befb8d71 tempest-VolumesExtendTest-302669752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:23:40 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-b3a1715c-8738-4395-934f-b978befb8d71 tempest-VolumesExtendTest-302669752 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:23:40 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-b3a1715c-8738-4395-934f-b978befb8d71 tempest-VolumesExtendTest-302669752 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:23:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b3a1715c-8738-4395-934f-b978befb8d71 tempest-VolumesExtendTest-302669752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a6513a4f-932f-4a38-b26f-5a0f13bcd81d 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:23:40 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-547ba089-b3b6-4f9e-b875-76e2d330452d tempest-AttachVolumeTestJSON-1797013884 None] Lock "cinder-23be684f-34c0-4ce2-9e13-1be7eac89e5a-delete_volume" acquired by "delete_volume" :: waited 0.201s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:23:40 devstack sudo[95589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a6513a4f-932f-4a38-b26f-5a0f13bcd81d 1073741824 Sep 15 16:23:40 devstack sudo[95589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:23:40 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-5c430d09-6ba1-4f50-82b4-ab11722c6175 tempest-AttachVolumeTestJSON-1797013884 None] Lock "cinder-dd4f035a-5e51-4c41-b9c0-a37dd22506d2-delete_volume" released by "delete_volume" :: held 1.593s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:23:40 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-547ba089-b3b6-4f9e-b875-76e2d330452d tempest-AttachVolumeTestJSON-1797013884 None] Acquiring lock "cinder-quobyte-23be684f-34c0-4ce2-9e13-1be7eac89e5a" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:23:40 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-547ba089-b3b6-4f9e-b875-76e2d330452d tempest-AttachVolumeTestJSON-1797013884 None] Lock "cinder-quobyte-23be684f-34c0-4ce2-9e13-1be7eac89e5a" acquired by "delete_volume" :: waited 0.022s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:23:40 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[820a2a16-82fb-441a-9b53-203f94dba2f6]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:23:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-547ba089-b3b6-4f9e-b875-76e2d330452d tempest-AttachVolumeTestJSON-1797013884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-23be684f-34c0-4ce2-9e13-1be7eac89e5a {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:23:41 devstack sudo[95592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-23be684f-34c0-4ce2-9e13-1be7eac89e5a Sep 15 16:23:41 devstack sudo[95592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:23:41 devstack sudo[95589]: pam_unix(sudo:session): session closed for user root Sep 15 16:23:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b3a1715c-8738-4395-934f-b978befb8d71 tempest-VolumesExtendTest-302669752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a6513a4f-932f-4a38-b26f-5a0f13bcd81d 1073741824" returned: 0 in 0.776s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:23:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b3a1715c-8738-4395-934f-b978befb8d71 tempest-VolumesExtendTest-302669752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a6513a4f-932f-4a38-b26f-5a0f13bcd81d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:23:41 devstack sudo[95592]: pam_unix(sudo:session): session closed for user root Sep 15 16:23:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-547ba089-b3b6-4f9e-b875-76e2d330452d tempest-AttachVolumeTestJSON-1797013884 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-23be684f-34c0-4ce2-9e13-1be7eac89e5a" returned: 0 in 0.661s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:23:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-547ba089-b3b6-4f9e-b875-76e2d330452d tempest-AttachVolumeTestJSON-1797013884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-23be684f-34c0-4ce2-9e13-1be7eac89e5a {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:23:41 devstack sudo[95609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a6513a4f-932f-4a38-b26f-5a0f13bcd81d Sep 15 16:23:41 devstack sudo[95609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:23:41 devstack sudo[95610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-23be684f-34c0-4ce2-9e13-1be7eac89e5a Sep 15 16:23:41 devstack sudo[95610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:23:41 devstack sudo[95609]: pam_unix(sudo:session): session closed for user root Sep 15 16:23:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b3a1715c-8738-4395-934f-b978befb8d71 tempest-VolumesExtendTest-302669752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a6513a4f-932f-4a38-b26f-5a0f13bcd81d" returned: 0 in 0.296s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:23:41 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-b3a1715c-8738-4395-934f-b978befb8d71 tempest-VolumesExtendTest-302669752 None] <== create_volume: return (1157ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:23:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b3a1715c-8738-4395-934f-b978befb8d71 tempest-VolumesExtendTest-302669752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.164s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:23:41 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b3a1715c-8738-4395-934f-b978befb8d71 tempest-VolumesExtendTest-302669752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9aecc9c7-0483-40f7-b021-638f853e1cca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6513a4f-932f-4a38-b26f-5a0f13bcd81d', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:23:41 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b3a1715c-8738-4395-934f-b978befb8d71 tempest-VolumesExtendTest-302669752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1093cab-0898-4aa3-944b-9c393568bcff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:23:41 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-b3a1715c-8738-4395-934f-b978befb8d71 tempest-VolumesExtendTest-302669752 None] Volume volume-a6513a4f-932f-4a38-b26f-5a0f13bcd81d (a6513a4f-932f-4a38-b26f-5a0f13bcd81d): created successfully Sep 15 16:23:41 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b3a1715c-8738-4395-934f-b978befb8d71 tempest-VolumesExtendTest-302669752 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1093cab-0898-4aa3-944b-9c393568bcff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:23:41 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b3a1715c-8738-4395-934f-b978befb8d71 tempest-VolumesExtendTest-302669752 None] Flow 'volume_create_manager' (85d53cd5-9f2c-41a6-ab27-78ba5addfab0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:23:41 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-b3a1715c-8738-4395-934f-b978befb8d71 tempest-VolumesExtendTest-302669752 None] Created volume successfully. Sep 15 16:23:41 devstack sudo[95610]: pam_unix(sudo:session): session closed for user root Sep 15 16:23:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-547ba089-b3b6-4f9e-b875-76e2d330452d tempest-AttachVolumeTestJSON-1797013884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-23be684f-34c0-4ce2-9e13-1be7eac89e5a" returned: 0 in 0.347s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:23:41 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-547ba089-b3b6-4f9e-b875-76e2d330452d tempest-AttachVolumeTestJSON-1797013884 None] Lock "cinder-quobyte-23be684f-34c0-4ce2-9e13-1be7eac89e5a" released by "delete_volume" :: held 1.073s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:23:42 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-547ba089-b3b6-4f9e-b875-76e2d330452d tempest-AttachVolumeTestJSON-1797013884 None] Created reservations ['85d4487c-7a5f-43a5-90aa-cf65eab17405', 'e867741d-5738-44ed-b911-2f098f2888e8', 'ae06a605-144c-47a0-9bd4-ac30329858a7', '88166f97-535d-4b8d-9da9-87f0df252000'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:23:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-547ba089-b3b6-4f9e-b875-76e2d330452d tempest-AttachVolumeTestJSON-1797013884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:23:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-547ba089-b3b6-4f9e-b875-76e2d330452d tempest-AttachVolumeTestJSON-1797013884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:23:42 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-547ba089-b3b6-4f9e-b875-76e2d330452d tempest-AttachVolumeTestJSON-1797013884 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:23:42 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-547ba089-b3b6-4f9e-b875-76e2d330452d tempest-AttachVolumeTestJSON-1797013884 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:23:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-547ba089-b3b6-4f9e-b875-76e2d330452d tempest-AttachVolumeTestJSON-1797013884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:23:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-547ba089-b3b6-4f9e-b875-76e2d330452d tempest-AttachVolumeTestJSON-1797013884 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:23:42 devstack sudo[95615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:23:42 devstack sudo[95615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:23:42 devstack sudo[95615]: pam_unix(sudo:session): session closed for user root Sep 15 16:23:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-547ba089-b3b6-4f9e-b875-76e2d330452d tempest-AttachVolumeTestJSON-1797013884 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.263s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:23:42 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-547ba089-b3b6-4f9e-b875-76e2d330452d tempest-AttachVolumeTestJSON-1797013884 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:23:42 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-547ba089-b3b6-4f9e-b875-76e2d330452d tempest-AttachVolumeTestJSON-1797013884 None] Deleted volume successfully. Sep 15 16:23:42 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-547ba089-b3b6-4f9e-b875-76e2d330452d tempest-AttachVolumeTestJSON-1797013884 None] Lock "cinder-23be684f-34c0-4ce2-9e13-1be7eac89e5a-delete_volume" released by "delete_volume" :: held 1.578s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:23:42 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:SELECT=115,cinder:UPDATE=133,cinder:INSERT=37,cinder:DELETE=7 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 16:23:42 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:SELECT=117,cinder:UPDATE=134,cinder:DELETE=14,cinder:INSERT=38 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 16:23:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b57f5bc8-1249-4631-b8d3-aabf00502f90 tempest-VolumesExtendTest-302669752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:23:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b57f5bc8-1249-4631-b8d3-aabf00502f90 tempest-VolumesExtendTest-302669752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:23:42 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-b57f5bc8-1249-4631-b8d3-aabf00502f90 tempest-VolumesExtendTest-302669752 None] Creating offline snapshot 2e557ad7-a949-4ac3-9ee7-3c397884658b of volume a6513a4f-932f-4a38-b26f-5a0f13bcd81d {{(pid=86082) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 15 16:23:42 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6abdb38-73ce-4177-a282-0fc0cef10c8b]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:23:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b57f5bc8-1249-4631-b8d3-aabf00502f90 tempest-VolumesExtendTest-302669752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a6513a4f-932f-4a38-b26f-5a0f13bcd81d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:23:43 devstack sudo[95618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a6513a4f-932f-4a38-b26f-5a0f13bcd81d Sep 15 16:23:43 devstack sudo[95618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:23:43 devstack sudo[95618]: pam_unix(sudo:session): session closed for user root Sep 15 16:23:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b57f5bc8-1249-4631-b8d3-aabf00502f90 tempest-VolumesExtendTest-302669752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a6513a4f-932f-4a38-b26f-5a0f13bcd81d" returned: 0 in 0.437s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:23:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b57f5bc8-1249-4631-b8d3-aabf00502f90 tempest-VolumesExtendTest-302669752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a6513a4f-932f-4a38-b26f-5a0f13bcd81d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a6513a4f-932f-4a38-b26f-5a0f13bcd81d.2e557ad7-a949-4ac3-9ee7-3c397884658b 1G {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:23:43 devstack sudo[95623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a6513a4f-932f-4a38-b26f-5a0f13bcd81d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a6513a4f-932f-4a38-b26f-5a0f13bcd81d.2e557ad7-a949-4ac3-9ee7-3c397884658b 1G Sep 15 16:23:43 devstack sudo[95623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:23:43 devstack sudo[95623]: pam_unix(sudo:session): session closed for user root Sep 15 16:23:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b57f5bc8-1249-4631-b8d3-aabf00502f90 tempest-VolumesExtendTest-302669752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a6513a4f-932f-4a38-b26f-5a0f13bcd81d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a6513a4f-932f-4a38-b26f-5a0f13bcd81d.2e557ad7-a949-4ac3-9ee7-3c397884658b 1G" returned: 0 in 0.480s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:23:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b57f5bc8-1249-4631-b8d3-aabf00502f90 tempest-VolumesExtendTest-302669752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6513a4f-932f-4a38-b26f-5a0f13bcd81d -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a6513a4f-932f-4a38-b26f-5a0f13bcd81d.2e557ad7-a949-4ac3-9ee7-3c397884658b {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:23:43 devstack sudo[95629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6513a4f-932f-4a38-b26f-5a0f13bcd81d -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a6513a4f-932f-4a38-b26f-5a0f13bcd81d.2e557ad7-a949-4ac3-9ee7-3c397884658b Sep 15 16:23:43 devstack sudo[95629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:23:44 devstack sudo[95629]: pam_unix(sudo:session): session closed for user root Sep 15 16:23:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b57f5bc8-1249-4631-b8d3-aabf00502f90 tempest-VolumesExtendTest-302669752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6513a4f-932f-4a38-b26f-5a0f13bcd81d -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a6513a4f-932f-4a38-b26f-5a0f13bcd81d.2e557ad7-a949-4ac3-9ee7-3c397884658b" returned: 0 in 0.340s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:23:44 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-b57f5bc8-1249-4631-b8d3-aabf00502f90 tempest-VolumesExtendTest-302669752 None] /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a6513a4f-932f-4a38-b26f-5a0f13bcd81d.2e557ad7-a949-4ac3-9ee7-3c397884658b is being set with open permissions: ugo+rw Sep 15 16:23:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b57f5bc8-1249-4631-b8d3-aabf00502f90 tempest-VolumesExtendTest-302669752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a6513a4f-932f-4a38-b26f-5a0f13bcd81d.2e557ad7-a949-4ac3-9ee7-3c397884658b {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:23:44 devstack sudo[95634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a6513a4f-932f-4a38-b26f-5a0f13bcd81d.2e557ad7-a949-4ac3-9ee7-3c397884658b Sep 15 16:23:44 devstack sudo[95634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:23:44 devstack sudo[95634]: pam_unix(sudo:session): session closed for user root Sep 15 16:23:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b57f5bc8-1249-4631-b8d3-aabf00502f90 tempest-VolumesExtendTest-302669752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a6513a4f-932f-4a38-b26f-5a0f13bcd81d.2e557ad7-a949-4ac3-9ee7-3c397884658b" returned: 0 in 0.249s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:23:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b57f5bc8-1249-4631-b8d3-aabf00502f90 tempest-VolumesExtendTest-302669752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a6513a4f-932f-4a38-b26f-5a0f13bcd81d.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:23:44 devstack sudo[95637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a6513a4f-932f-4a38-b26f-5a0f13bcd81d.info Sep 15 16:23:44 devstack sudo[95637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:23:44 devstack sudo[95637]: pam_unix(sudo:session): session closed for user root Sep 15 16:23:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b57f5bc8-1249-4631-b8d3-aabf00502f90 tempest-VolumesExtendTest-302669752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a6513a4f-932f-4a38-b26f-5a0f13bcd81d.info" returned: 0 in 0.321s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:23:44 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-b57f5bc8-1249-4631-b8d3-aabf00502f90 tempest-VolumesExtendTest-302669752 None] /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a6513a4f-932f-4a38-b26f-5a0f13bcd81d.info is being set with open permissions: ugo+rw Sep 15 16:23:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b57f5bc8-1249-4631-b8d3-aabf00502f90 tempest-VolumesExtendTest-302669752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a6513a4f-932f-4a38-b26f-5a0f13bcd81d.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:23:44 devstack sudo[95641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a6513a4f-932f-4a38-b26f-5a0f13bcd81d.info Sep 15 16:23:44 devstack sudo[95641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:23:45 devstack sudo[95641]: pam_unix(sudo:session): session closed for user root Sep 15 16:23:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b57f5bc8-1249-4631-b8d3-aabf00502f90 tempest-VolumesExtendTest-302669752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a6513a4f-932f-4a38-b26f-5a0f13bcd81d.info" returned: 0 in 0.262s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:23:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b57f5bc8-1249-4631-b8d3-aabf00502f90 tempest-VolumesExtendTest-302669752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.222s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:23:45 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-b57f5bc8-1249-4631-b8d3-aabf00502f90 tempest-VolumesExtendTest-302669752 None] Create snapshot completed successfully Sep 15 16:23:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-113d0ccd-5e31-47bb-93ba-077968c2b7ec tempest-VolumesExtendTest-302669752 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:23:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-113d0ccd-5e31-47bb-93ba-077968c2b7ec tempest-VolumesExtendTest-302669752 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.003s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:23:46 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e251cd8-f62b-4bbb-bc6f-d79bb06713cc]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:23:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-113d0ccd-5e31-47bb-93ba-077968c2b7ec tempest-VolumesExtendTest-302669752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a6513a4f-932f-4a38-b26f-5a0f13bcd81d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:23:46 devstack sudo[95644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a6513a4f-932f-4a38-b26f-5a0f13bcd81d Sep 15 16:23:46 devstack sudo[95644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:23:46 devstack sudo[95644]: pam_unix(sudo:session): session closed for user root Sep 15 16:23:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-113d0ccd-5e31-47bb-93ba-077968c2b7ec tempest-VolumesExtendTest-302669752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a6513a4f-932f-4a38-b26f-5a0f13bcd81d" returned: 0 in 0.407s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:23:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-113d0ccd-5e31-47bb-93ba-077968c2b7ec tempest-VolumesExtendTest-302669752 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a6513a4f-932f-4a38-b26f-5a0f13bcd81d.2e557ad7-a949-4ac3-9ee7-3c397884658b 2G {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:23:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-113d0ccd-5e31-47bb-93ba-077968c2b7ec tempest-VolumesExtendTest-302669752 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a6513a4f-932f-4a38-b26f-5a0f13bcd81d.2e557ad7-a949-4ac3-9ee7-3c397884658b 2G" returned: 0 in 0.233s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:23:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-113d0ccd-5e31-47bb-93ba-077968c2b7ec tempest-VolumesExtendTest-302669752 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.682s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:23:46 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-113d0ccd-5e31-47bb-93ba-077968c2b7ec tempest-VolumesExtendTest-302669752 None] Extend volume completed successfully. Sep 15 16:23:47 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-3de5fbfc-94fd-4189-b2ef-83a3f1bc114c tempest-VolumesExtendTest-302669752 None] Acquiring lock "cinder-2e557ad7-a949-4ac3-9ee7-3c397884658b-delete_snapshot" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:23:47 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-3de5fbfc-94fd-4189-b2ef-83a3f1bc114c tempest-VolumesExtendTest-302669752 None] Lock "cinder-2e557ad7-a949-4ac3-9ee7-3c397884658b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:23:47 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-3de5fbfc-94fd-4189-b2ef-83a3f1bc114c tempest-VolumesExtendTest-302669752 None] Acquiring lock "cinder-quobyte-a6513a4f-932f-4a38-b26f-5a0f13bcd81d" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:23:47 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-3de5fbfc-94fd-4189-b2ef-83a3f1bc114c tempest-VolumesExtendTest-302669752 None] Lock "cinder-quobyte-a6513a4f-932f-4a38-b26f-5a0f13bcd81d" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:23:47 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-3de5fbfc-94fd-4189-b2ef-83a3f1bc114c tempest-VolumesExtendTest-302669752 None] Acquiring lock "cinder-quobyte-2e557ad7-a949-4ac3-9ee7-3c397884658b" by "_delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:23:47 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-3de5fbfc-94fd-4189-b2ef-83a3f1bc114c tempest-VolumesExtendTest-302669752 None] Lock "cinder-quobyte-2e557ad7-a949-4ac3-9ee7-3c397884658b" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:23:47 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-3de5fbfc-94fd-4189-b2ef-83a3f1bc114c tempest-VolumesExtendTest-302669752 None] Deleting offline snapshot 2e557ad7-a949-4ac3-9ee7-3c397884658b of volume a6513a4f-932f-4a38-b26f-5a0f13bcd81d {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 15 16:23:47 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-3de5fbfc-94fd-4189-b2ef-83a3f1bc114c tempest-VolumesExtendTest-302669752 None] snapshot_file for this snap is: volume-a6513a4f-932f-4a38-b26f-5a0f13bcd81d.2e557ad7-a949-4ac3-9ee7-3c397884658b {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 15 16:23:47 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[a90deb10-1b8e-468b-9e3a-07febd2a1053]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:23:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3de5fbfc-94fd-4189-b2ef-83a3f1bc114c tempest-VolumesExtendTest-302669752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a6513a4f-932f-4a38-b26f-5a0f13bcd81d.2e557ad7-a949-4ac3-9ee7-3c397884658b {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:23:47 devstack sudo[95654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a6513a4f-932f-4a38-b26f-5a0f13bcd81d.2e557ad7-a949-4ac3-9ee7-3c397884658b Sep 15 16:23:47 devstack sudo[95654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:23:48 devstack sudo[95654]: pam_unix(sudo:session): session closed for user root Sep 15 16:23:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3de5fbfc-94fd-4189-b2ef-83a3f1bc114c tempest-VolumesExtendTest-302669752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a6513a4f-932f-4a38-b26f-5a0f13bcd81d.2e557ad7-a949-4ac3-9ee7-3c397884658b" returned: 0 in 0.565s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:23:48 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-3de5fbfc-94fd-4189-b2ef-83a3f1bc114c tempest-VolumesExtendTest-302669752 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a6513a4f-932f-4a38-b26f-5a0f13bcd81d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 16:23:48 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d90fba4-b83b-499b-8a0a-2202c3a008d3]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:23:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3de5fbfc-94fd-4189-b2ef-83a3f1bc114c tempest-VolumesExtendTest-302669752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a6513a4f-932f-4a38-b26f-5a0f13bcd81d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:23:48 devstack sudo[95660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a6513a4f-932f-4a38-b26f-5a0f13bcd81d Sep 15 16:23:48 devstack sudo[95660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:23:48 devstack sudo[95660]: pam_unix(sudo:session): session closed for user root Sep 15 16:23:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3de5fbfc-94fd-4189-b2ef-83a3f1bc114c tempest-VolumesExtendTest-302669752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a6513a4f-932f-4a38-b26f-5a0f13bcd81d" returned: 0 in 0.638s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:23:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3de5fbfc-94fd-4189-b2ef-83a3f1bc114c tempest-VolumesExtendTest-302669752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a6513a4f-932f-4a38-b26f-5a0f13bcd81d.2e557ad7-a949-4ac3-9ee7-3c397884658b {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:23:48 devstack sudo[95666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a6513a4f-932f-4a38-b26f-5a0f13bcd81d.2e557ad7-a949-4ac3-9ee7-3c397884658b Sep 15 16:23:48 devstack sudo[95666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:23:49 devstack sudo[95666]: pam_unix(sudo:session): session closed for user root Sep 15 16:23:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3de5fbfc-94fd-4189-b2ef-83a3f1bc114c tempest-VolumesExtendTest-302669752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a6513a4f-932f-4a38-b26f-5a0f13bcd81d.2e557ad7-a949-4ac3-9ee7-3c397884658b" returned: 0 in 0.612s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:23:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3de5fbfc-94fd-4189-b2ef-83a3f1bc114c tempest-VolumesExtendTest-302669752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a6513a4f-932f-4a38-b26f-5a0f13bcd81d.2e557ad7-a949-4ac3-9ee7-3c397884658b {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:23:49 devstack sudo[95672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a6513a4f-932f-4a38-b26f-5a0f13bcd81d.2e557ad7-a949-4ac3-9ee7-3c397884658b Sep 15 16:23:49 devstack sudo[95672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:23:49 devstack sudo[95672]: pam_unix(sudo:session): session closed for user root Sep 15 16:23:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3de5fbfc-94fd-4189-b2ef-83a3f1bc114c tempest-VolumesExtendTest-302669752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a6513a4f-932f-4a38-b26f-5a0f13bcd81d.2e557ad7-a949-4ac3-9ee7-3c397884658b" returned: 0 in 0.298s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:23:49 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-3de5fbfc-94fd-4189-b2ef-83a3f1bc114c tempest-VolumesExtendTest-302669752 None] Lock "cinder-quobyte-2e557ad7-a949-4ac3-9ee7-3c397884658b" released by "_delete_snapshot" :: held 2.289s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:23:49 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-3de5fbfc-94fd-4189-b2ef-83a3f1bc114c tempest-VolumesExtendTest-302669752 None] Lock "cinder-quobyte-a6513a4f-932f-4a38-b26f-5a0f13bcd81d" released by "delete_snapshot" :: held 2.331s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:23:49 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-3de5fbfc-94fd-4189-b2ef-83a3f1bc114c tempest-VolumesExtendTest-302669752 None] Created reservations ['ee71e594-9d90-458f-ac76-06cf956df4d7', '2cfa68f0-9072-4ae5-896d-ec1055412265', '2b26fa90-0fb4-4b3c-9167-7bad440b9022', '195cdb41-8b94-4932-aad1-e11c32135f8d'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:23:50 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-3de5fbfc-94fd-4189-b2ef-83a3f1bc114c tempest-VolumesExtendTest-302669752 None] Delete snapshot completed successfully. Sep 15 16:23:50 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-3de5fbfc-94fd-4189-b2ef-83a3f1bc114c tempest-VolumesExtendTest-302669752 None] Lock "cinder-2e557ad7-a949-4ac3-9ee7-3c397884658b-delete_snapshot" released by "delete_snapshot" :: held 2.631s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:23:50 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-575a7260-53a6-450c-b5d0-4083f648a438 tempest-VolumesExtendTest-302669752 None] Acquiring lock "cinder-a6513a4f-932f-4a38-b26f-5a0f13bcd81d-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:23:50 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-575a7260-53a6-450c-b5d0-4083f648a438 tempest-VolumesExtendTest-302669752 None] Lock "cinder-a6513a4f-932f-4a38-b26f-5a0f13bcd81d-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:23:51 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-575a7260-53a6-450c-b5d0-4083f648a438 tempest-VolumesExtendTest-302669752 None] Acquiring lock "cinder-quobyte-a6513a4f-932f-4a38-b26f-5a0f13bcd81d" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:23:51 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-575a7260-53a6-450c-b5d0-4083f648a438 tempest-VolumesExtendTest-302669752 None] Lock "cinder-quobyte-a6513a4f-932f-4a38-b26f-5a0f13bcd81d" acquired by "delete_volume" :: waited 0.025s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:23:51 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[44c91fa5-fc5a-4d69-92d6-1727cb970f8c]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:23:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-575a7260-53a6-450c-b5d0-4083f648a438 tempest-VolumesExtendTest-302669752 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a6513a4f-932f-4a38-b26f-5a0f13bcd81d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:23:51 devstack sudo[95678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a6513a4f-932f-4a38-b26f-5a0f13bcd81d Sep 15 16:23:51 devstack sudo[95678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:23:51 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e25029f-84a4-4379-a27a-705dbf7fc9c7 tempest-AttachVolumeNegativeTest-612785929 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:23:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8e25029f-84a4-4379-a27a-705dbf7fc9c7 tempest-AttachVolumeNegativeTest-612785929 None] Flow 'volume_create_manager' (53319823-3c58-420a-88bf-5cf1ab53754b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:23:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8e25029f-84a4-4379-a27a-705dbf7fc9c7 tempest-AttachVolumeNegativeTest-612785929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7944aa98-097c-4a01-9b3e-64384e32d303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:23:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8e25029f-84a4-4379-a27a-705dbf7fc9c7 tempest-AttachVolumeNegativeTest-612785929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7944aa98-097c-4a01-9b3e-64384e32d303) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:23:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1776846830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=901c541d-0907-40dc-a029-269b4af14148,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef4cf00d20054e2aa09d80608ec2688a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:23:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:23:51Z,use_quota=True,user_id='8fdca69cd06d4561a61b26546e2e803b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:23:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8e25029f-84a4-4379-a27a-705dbf7fc9c7 tempest-AttachVolumeNegativeTest-612785929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e2053dc-266d-4f14-8af8-4a620e5d95b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:23:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8e25029f-84a4-4379-a27a-705dbf7fc9c7 tempest-AttachVolumeNegativeTest-612785929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e2053dc-266d-4f14-8af8-4a620e5d95b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:23:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8e25029f-84a4-4379-a27a-705dbf7fc9c7 tempest-AttachVolumeNegativeTest-612785929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2717ceeb-1358-4871-86c3-39f20d4fd5e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:23:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8e25029f-84a4-4379-a27a-705dbf7fc9c7 tempest-AttachVolumeNegativeTest-612785929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2717ceeb-1358-4871-86c3-39f20d4fd5e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '901c541d-0907-40dc-a029-269b4af14148', 'volume_name': 'volume-901c541d-0907-40dc-a029-269b4af14148', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:23:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8e25029f-84a4-4379-a27a-705dbf7fc9c7 tempest-AttachVolumeNegativeTest-612785929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (597101ed-a60e-421d-bc4f-0feaa58a4e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:23:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8e25029f-84a4-4379-a27a-705dbf7fc9c7 tempest-AttachVolumeNegativeTest-612785929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (597101ed-a60e-421d-bc4f-0feaa58a4e77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:23:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8e25029f-84a4-4379-a27a-705dbf7fc9c7 tempest-AttachVolumeNegativeTest-612785929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68b85477-88f5-4816-9a31-bcd712d536ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:23:51 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-8e25029f-84a4-4379-a27a-705dbf7fc9c7 tempest-AttachVolumeNegativeTest-612785929 None] Volume 901c541d-0907-40dc-a029-269b4af14148: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-901c541d-0907-40dc-a029-269b4af14148', 'volume_size': 1} Sep 15 16:23:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-8e25029f-84a4-4379-a27a-705dbf7fc9c7 tempest-AttachVolumeNegativeTest-612785929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:23:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-8e25029f-84a4-4379-a27a-705dbf7fc9c7 tempest-AttachVolumeNegativeTest-612785929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:23:51 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-8e25029f-84a4-4379-a27a-705dbf7fc9c7 tempest-AttachVolumeNegativeTest-612785929 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:23:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1776846830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=901c541d-0907-40dc-a029-269b4af14148,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef4cf00d20054e2aa09d80608ec2688a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:23:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:23:51Z,use_quota=True,user_id='8fdca69cd06d4561a61b26546e2e803b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:23:51 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-8e25029f-84a4-4379-a27a-705dbf7fc9c7 tempest-AttachVolumeNegativeTest-612785929 None] Creating volume 901c541d-0907-40dc-a029-269b4af14148 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:23:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-8e25029f-84a4-4379-a27a-705dbf7fc9c7 tempest-AttachVolumeNegativeTest-612785929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:23:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-8e25029f-84a4-4379-a27a-705dbf7fc9c7 tempest-AttachVolumeNegativeTest-612785929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:23:51 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-8e25029f-84a4-4379-a27a-705dbf7fc9c7 tempest-AttachVolumeNegativeTest-612785929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:23:51 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-8e25029f-84a4-4379-a27a-705dbf7fc9c7 tempest-AttachVolumeNegativeTest-612785929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:23:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-8e25029f-84a4-4379-a27a-705dbf7fc9c7 tempest-AttachVolumeNegativeTest-612785929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:23:51 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-8e25029f-84a4-4379-a27a-705dbf7fc9c7 tempest-AttachVolumeNegativeTest-612785929 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:23:51 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-8e25029f-84a4-4379-a27a-705dbf7fc9c7 tempest-AttachVolumeNegativeTest-612785929 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:23:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8e25029f-84a4-4379-a27a-705dbf7fc9c7 tempest-AttachVolumeNegativeTest-612785929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-901c541d-0907-40dc-a029-269b4af14148 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:23:51 devstack sudo[95681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-901c541d-0907-40dc-a029-269b4af14148 1073741824 Sep 15 16:23:51 devstack sudo[95681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:23:51 devstack sudo[95678]: pam_unix(sudo:session): session closed for user root Sep 15 16:23:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-575a7260-53a6-450c-b5d0-4083f648a438 tempest-VolumesExtendTest-302669752 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a6513a4f-932f-4a38-b26f-5a0f13bcd81d" returned: 0 in 0.502s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:23:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-575a7260-53a6-450c-b5d0-4083f648a438 tempest-VolumesExtendTest-302669752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a6513a4f-932f-4a38-b26f-5a0f13bcd81d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:23:51 devstack sudo[95685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a6513a4f-932f-4a38-b26f-5a0f13bcd81d Sep 15 16:23:51 devstack sudo[95685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:23:52 devstack sudo[95685]: pam_unix(sudo:session): session closed for user root Sep 15 16:23:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-575a7260-53a6-450c-b5d0-4083f648a438 tempest-VolumesExtendTest-302669752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a6513a4f-932f-4a38-b26f-5a0f13bcd81d" returned: 0 in 0.428s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:23:52 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-575a7260-53a6-450c-b5d0-4083f648a438 tempest-VolumesExtendTest-302669752 None] Lock "cinder-quobyte-a6513a4f-932f-4a38-b26f-5a0f13bcd81d" released by "delete_volume" :: held 1.056s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:23:52 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-575a7260-53a6-450c-b5d0-4083f648a438 tempest-VolumesExtendTest-302669752 None] Created reservations ['c4b6a91c-2975-4f6c-9e5d-d1bf339cfc0d', 'e4b7f70b-30f5-4d8d-8109-0ff219250912', '7de1b8dd-1b27-45c7-81a4-49a3ed3bbe5a', '30bd3252-a4fe-4f84-87ea-7e5cbfe3f913'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:23:52 devstack sudo[95681]: pam_unix(sudo:session): session closed for user root Sep 15 16:23:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8e25029f-84a4-4379-a27a-705dbf7fc9c7 tempest-AttachVolumeNegativeTest-612785929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-901c541d-0907-40dc-a029-269b4af14148 1073741824" returned: 0 in 0.674s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:23:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8e25029f-84a4-4379-a27a-705dbf7fc9c7 tempest-AttachVolumeNegativeTest-612785929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-901c541d-0907-40dc-a029-269b4af14148 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:23:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-575a7260-53a6-450c-b5d0-4083f648a438 tempest-VolumesExtendTest-302669752 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:23:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-575a7260-53a6-450c-b5d0-4083f648a438 tempest-VolumesExtendTest-302669752 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:23:52 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-575a7260-53a6-450c-b5d0-4083f648a438 tempest-VolumesExtendTest-302669752 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:23:52 devstack sudo[95693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-901c541d-0907-40dc-a029-269b4af14148 Sep 15 16:23:52 devstack sudo[95693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:23:52 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-575a7260-53a6-450c-b5d0-4083f648a438 tempest-VolumesExtendTest-302669752 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:23:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-575a7260-53a6-450c-b5d0-4083f648a438 tempest-VolumesExtendTest-302669752 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:23:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-575a7260-53a6-450c-b5d0-4083f648a438 tempest-VolumesExtendTest-302669752 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:23:52 devstack sudo[95695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:23:52 devstack sudo[95695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:23:52 devstack sudo[95693]: pam_unix(sudo:session): session closed for user root Sep 15 16:23:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8e25029f-84a4-4379-a27a-705dbf7fc9c7 tempest-AttachVolumeNegativeTest-612785929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-901c541d-0907-40dc-a029-269b4af14148" returned: 0 in 0.385s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:23:52 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-8e25029f-84a4-4379-a27a-705dbf7fc9c7 tempest-AttachVolumeNegativeTest-612785929 None] <== create_volume: return (1156ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:23:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-8e25029f-84a4-4379-a27a-705dbf7fc9c7 tempest-AttachVolumeNegativeTest-612785929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.158s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:23:52 devstack sudo[95695]: pam_unix(sudo:session): session closed for user root Sep 15 16:23:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-575a7260-53a6-450c-b5d0-4083f648a438 tempest-VolumesExtendTest-302669752 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.335s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:23:52 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-575a7260-53a6-450c-b5d0-4083f648a438 tempest-VolumesExtendTest-302669752 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:23:52 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-575a7260-53a6-450c-b5d0-4083f648a438 tempest-VolumesExtendTest-302669752 None] Deleted volume successfully. Sep 15 16:23:52 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8e25029f-84a4-4379-a27a-705dbf7fc9c7 tempest-AttachVolumeNegativeTest-612785929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68b85477-88f5-4816-9a31-bcd712d536ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-901c541d-0907-40dc-a029-269b4af14148', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:23:52 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8e25029f-84a4-4379-a27a-705dbf7fc9c7 tempest-AttachVolumeNegativeTest-612785929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f06e250-74ea-41d4-aa4b-44a940eaff69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:23:52 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-8e25029f-84a4-4379-a27a-705dbf7fc9c7 tempest-AttachVolumeNegativeTest-612785929 None] Volume volume-901c541d-0907-40dc-a029-269b4af14148 (901c541d-0907-40dc-a029-269b4af14148): created successfully Sep 15 16:23:52 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8e25029f-84a4-4379-a27a-705dbf7fc9c7 tempest-AttachVolumeNegativeTest-612785929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f06e250-74ea-41d4-aa4b-44a940eaff69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:23:52 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8e25029f-84a4-4379-a27a-705dbf7fc9c7 tempest-AttachVolumeNegativeTest-612785929 None] Flow 'volume_create_manager' (53319823-3c58-420a-88bf-5cf1ab53754b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:23:52 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-575a7260-53a6-450c-b5d0-4083f648a438 tempest-VolumesExtendTest-302669752 None] Lock "cinder-a6513a4f-932f-4a38-b26f-5a0f13bcd81d-delete_volume" released by "delete_volume" :: held 1.853s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:23:52 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-8e25029f-84a4-4379-a27a-705dbf7fc9c7 tempest-AttachVolumeNegativeTest-612785929 None] Created volume successfully. Sep 15 16:23:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-122086b6-5072-480c-ab32-a3eb573a7d6f req-1e0cece7-1550-495a-ba1b-803711f47317 tempest-AttachVolumeNegativeTest-612785929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:23:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-122086b6-5072-480c-ab32-a3eb573a7d6f req-1e0cece7-1550-495a-ba1b-803711f47317 tempest-AttachVolumeNegativeTest-612785929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:23:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-122086b6-5072-480c-ab32-a3eb573a7d6f req-1e0cece7-1550-495a-ba1b-803711f47317 tempest-AttachVolumeNegativeTest-612785929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:23:54 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-122086b6-5072-480c-ab32-a3eb573a7d6f req-1e0cece7-1550-495a-ba1b-803711f47317 tempest-AttachVolumeNegativeTest-612785929 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a', 'name': 'volume-901c541d-0907-40dc-a029-269b4af14148', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6ccab68e-8672-41f8-9817-06d552b373ce', 'enforce_multipath': True} {{(pid=86082) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 15 16:23:54 devstack cinder-volume[86082]: INFO cinder.volume.manager [req-122086b6-5072-480c-ab32-a3eb573a7d6f req-1e0cece7-1550-495a-ba1b-803711f47317 tempest-AttachVolumeNegativeTest-612785929 None] attachment_update completed successfully. Sep 15 16:23:57 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [req-fb11380a-b006-415f-8140-d45662de1af7 req-27b7e83f-9230-476d-b5a2-a6f1be6434ef tempest-VolumesSnapshotsTestJSON-1522789859 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:23:57 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-fb11380a-b006-415f-8140-d45662de1af7 req-27b7e83f-9230-476d-b5a2-a6f1be6434ef tempest-VolumesSnapshotsTestJSON-1522789859 None] Flow 'volume_create_manager' (6c28a654-72e0-434a-9c47-31aac8f78324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:23:57 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-fb11380a-b006-415f-8140-d45662de1af7 req-27b7e83f-9230-476d-b5a2-a6f1be6434ef tempest-VolumesSnapshotsTestJSON-1522789859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56fb0dab-9981-4a09-8b72-dac2419ea4e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:23:57 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-fb11380a-b006-415f-8140-d45662de1af7 req-27b7e83f-9230-476d-b5a2-a6f1be6434ef tempest-VolumesSnapshotsTestJSON-1522789859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56fb0dab-9981-4a09-8b72-dac2419ea4e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:23:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-810720168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3ff6808-d8b7-4b9c-99f6-14a4265e45da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='585783a845664a3b8abee6421c1677bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:23:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:23:57Z,use_quota=True,user_id='f99db291468c454db12f05bc05b1db31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:23:57 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-fb11380a-b006-415f-8140-d45662de1af7 req-27b7e83f-9230-476d-b5a2-a6f1be6434ef tempest-VolumesSnapshotsTestJSON-1522789859 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60cbb3e4-2301-4146-ac90-bd04e0863169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:23:57 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-fb11380a-b006-415f-8140-d45662de1af7 req-27b7e83f-9230-476d-b5a2-a6f1be6434ef tempest-VolumesSnapshotsTestJSON-1522789859 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60cbb3e4-2301-4146-ac90-bd04e0863169) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:23:57 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-fb11380a-b006-415f-8140-d45662de1af7 req-27b7e83f-9230-476d-b5a2-a6f1be6434ef tempest-VolumesSnapshotsTestJSON-1522789859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dee24e1a-5840-4e20-b23d-ea707e44e970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:23:57 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-fb11380a-b006-415f-8140-d45662de1af7 req-27b7e83f-9230-476d-b5a2-a6f1be6434ef tempest-VolumesSnapshotsTestJSON-1522789859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dee24e1a-5840-4e20-b23d-ea707e44e970) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3ff6808-d8b7-4b9c-99f6-14a4265e45da', 'volume_name': 'volume-c3ff6808-d8b7-4b9c-99f6-14a4265e45da', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:23:57 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-fb11380a-b006-415f-8140-d45662de1af7 req-27b7e83f-9230-476d-b5a2-a6f1be6434ef tempest-VolumesSnapshotsTestJSON-1522789859 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cac57b5-d8e2-4692-8247-163de0d9d336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:23:57 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-fb11380a-b006-415f-8140-d45662de1af7 req-27b7e83f-9230-476d-b5a2-a6f1be6434ef tempest-VolumesSnapshotsTestJSON-1522789859 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cac57b5-d8e2-4692-8247-163de0d9d336) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:23:57 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-fb11380a-b006-415f-8140-d45662de1af7 req-27b7e83f-9230-476d-b5a2-a6f1be6434ef tempest-VolumesSnapshotsTestJSON-1522789859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9418e3f-f1cc-4d5f-8d56-3a7e6a224409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:23:57 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [req-fb11380a-b006-415f-8140-d45662de1af7 req-27b7e83f-9230-476d-b5a2-a6f1be6434ef tempest-VolumesSnapshotsTestJSON-1522789859 None] Volume c3ff6808-d8b7-4b9c-99f6-14a4265e45da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3ff6808-d8b7-4b9c-99f6-14a4265e45da', 'volume_size': 1} Sep 15 16:23:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-fb11380a-b006-415f-8140-d45662de1af7 req-27b7e83f-9230-476d-b5a2-a6f1be6434ef tempest-VolumesSnapshotsTestJSON-1522789859 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:23:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-fb11380a-b006-415f-8140-d45662de1af7 req-27b7e83f-9230-476d-b5a2-a6f1be6434ef tempest-VolumesSnapshotsTestJSON-1522789859 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:23:57 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [req-fb11380a-b006-415f-8140-d45662de1af7 req-27b7e83f-9230-476d-b5a2-a6f1be6434ef tempest-VolumesSnapshotsTestJSON-1522789859 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:23:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-810720168',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3ff6808-d8b7-4b9c-99f6-14a4265e45da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='585783a845664a3b8abee6421c1677bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:23:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:23:57Z,use_quota=True,user_id='f99db291468c454db12f05bc05b1db31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:23:57 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [req-fb11380a-b006-415f-8140-d45662de1af7 req-27b7e83f-9230-476d-b5a2-a6f1be6434ef tempest-VolumesSnapshotsTestJSON-1522789859 None] Creating volume c3ff6808-d8b7-4b9c-99f6-14a4265e45da {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:23:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-fb11380a-b006-415f-8140-d45662de1af7 req-27b7e83f-9230-476d-b5a2-a6f1be6434ef tempest-VolumesSnapshotsTestJSON-1522789859 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:23:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-fb11380a-b006-415f-8140-d45662de1af7 req-27b7e83f-9230-476d-b5a2-a6f1be6434ef tempest-VolumesSnapshotsTestJSON-1522789859 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:23:57 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [req-fb11380a-b006-415f-8140-d45662de1af7 req-27b7e83f-9230-476d-b5a2-a6f1be6434ef tempest-VolumesSnapshotsTestJSON-1522789859 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:23:57 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [req-fb11380a-b006-415f-8140-d45662de1af7 req-27b7e83f-9230-476d-b5a2-a6f1be6434ef tempest-VolumesSnapshotsTestJSON-1522789859 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:23:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-fb11380a-b006-415f-8140-d45662de1af7 req-27b7e83f-9230-476d-b5a2-a6f1be6434ef tempest-VolumesSnapshotsTestJSON-1522789859 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:23:57 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [req-fb11380a-b006-415f-8140-d45662de1af7 req-27b7e83f-9230-476d-b5a2-a6f1be6434ef tempest-VolumesSnapshotsTestJSON-1522789859 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:23:57 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [req-fb11380a-b006-415f-8140-d45662de1af7 req-27b7e83f-9230-476d-b5a2-a6f1be6434ef tempest-VolumesSnapshotsTestJSON-1522789859 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:23:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [req-fb11380a-b006-415f-8140-d45662de1af7 req-27b7e83f-9230-476d-b5a2-a6f1be6434ef tempest-VolumesSnapshotsTestJSON-1522789859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c3ff6808-d8b7-4b9c-99f6-14a4265e45da 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:23:57 devstack sudo[96124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c3ff6808-d8b7-4b9c-99f6-14a4265e45da 1073741824 Sep 15 16:23:57 devstack sudo[96124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:23:57 devstack cinder-volume[86082]: INFO cinder.volume.manager [req-e9afc488-93ce-4539-8dec-bef078ad10f4 req-90c9e305-f167-4d1d-aba7-6b51a3cc36d3 tempest-AttachVolumeNegativeTest-612785929 None] Terminate volume connection completed successfully. Sep 15 16:23:57 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-e9afc488-93ce-4539-8dec-bef078ad10f4 req-90c9e305-f167-4d1d-aba7-6b51a3cc36d3 tempest-AttachVolumeNegativeTest-612785929 None] Deleting attachment 6ccab68e-8672-41f8-9817-06d552b373ce. {{(pid=86082) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 15 16:23:57 devstack sudo[96124]: pam_unix(sudo:session): session closed for user root Sep 15 16:23:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [req-fb11380a-b006-415f-8140-d45662de1af7 req-27b7e83f-9230-476d-b5a2-a6f1be6434ef tempest-VolumesSnapshotsTestJSON-1522789859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c3ff6808-d8b7-4b9c-99f6-14a4265e45da 1073741824" returned: 0 in 0.681s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:23:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [req-fb11380a-b006-415f-8140-d45662de1af7 req-27b7e83f-9230-476d-b5a2-a6f1be6434ef tempest-VolumesSnapshotsTestJSON-1522789859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c3ff6808-d8b7-4b9c-99f6-14a4265e45da {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:23:58 devstack sudo[96155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c3ff6808-d8b7-4b9c-99f6-14a4265e45da Sep 15 16:23:58 devstack sudo[96155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:23:58 devstack sudo[96155]: pam_unix(sudo:session): session closed for user root Sep 15 16:23:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [req-fb11380a-b006-415f-8140-d45662de1af7 req-27b7e83f-9230-476d-b5a2-a6f1be6434ef tempest-VolumesSnapshotsTestJSON-1522789859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c3ff6808-d8b7-4b9c-99f6-14a4265e45da" returned: 0 in 0.367s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:23:58 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [req-fb11380a-b006-415f-8140-d45662de1af7 req-27b7e83f-9230-476d-b5a2-a6f1be6434ef tempest-VolumesSnapshotsTestJSON-1522789859 None] <== create_volume: return (1131ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:23:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-fb11380a-b006-415f-8140-d45662de1af7 req-27b7e83f-9230-476d-b5a2-a6f1be6434ef tempest-VolumesSnapshotsTestJSON-1522789859 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.133s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:23:58 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-fb11380a-b006-415f-8140-d45662de1af7 req-27b7e83f-9230-476d-b5a2-a6f1be6434ef tempest-VolumesSnapshotsTestJSON-1522789859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9418e3f-f1cc-4d5f-8d56-3a7e6a224409) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3ff6808-d8b7-4b9c-99f6-14a4265e45da', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:23:58 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-fb11380a-b006-415f-8140-d45662de1af7 req-27b7e83f-9230-476d-b5a2-a6f1be6434ef tempest-VolumesSnapshotsTestJSON-1522789859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be72a26e-29e2-489c-b203-c8416d2f373d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:23:58 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [req-fb11380a-b006-415f-8140-d45662de1af7 req-27b7e83f-9230-476d-b5a2-a6f1be6434ef tempest-VolumesSnapshotsTestJSON-1522789859 None] Volume volume-c3ff6808-d8b7-4b9c-99f6-14a4265e45da (c3ff6808-d8b7-4b9c-99f6-14a4265e45da): created successfully Sep 15 16:23:58 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-fb11380a-b006-415f-8140-d45662de1af7 req-27b7e83f-9230-476d-b5a2-a6f1be6434ef tempest-VolumesSnapshotsTestJSON-1522789859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be72a26e-29e2-489c-b203-c8416d2f373d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:23:58 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-fb11380a-b006-415f-8140-d45662de1af7 req-27b7e83f-9230-476d-b5a2-a6f1be6434ef tempest-VolumesSnapshotsTestJSON-1522789859 None] Flow 'volume_create_manager' (6c28a654-72e0-434a-9c47-31aac8f78324) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:23:58 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-77c6bd1f-165f-42db-a669-8da71bb68304 tempest-TestInstancesWithCinderVolumes-1798748222 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:23:58 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-77c6bd1f-165f-42db-a669-8da71bb68304 tempest-TestInstancesWithCinderVolumes-1798748222 None] Flow 'volume_create_manager' (1c4dba30-298f-4bc9-a6c7-cc5a3b3245f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:23:58 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-77c6bd1f-165f-42db-a669-8da71bb68304 tempest-TestInstancesWithCinderVolumes-1798748222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38a4e618-bb27-49ae-ac48-e6c1fcfd0aff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:23:58 devstack cinder-volume[86082]: INFO cinder.volume.manager [req-fb11380a-b006-415f-8140-d45662de1af7 req-27b7e83f-9230-476d-b5a2-a6f1be6434ef tempest-VolumesSnapshotsTestJSON-1522789859 None] Created volume successfully. Sep 15 16:23:58 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-77c6bd1f-165f-42db-a669-8da71bb68304 tempest-TestInstancesWithCinderVolumes-1798748222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38a4e618-bb27-49ae-ac48-e6c1fcfd0aff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:23:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1312503340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca88091b-1150-43b1-8661-0fea45cc3e17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f23d7dcf47c04cd38f24c4049b1921c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:23:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:23:58Z,use_quota=True,user_id='4899c765a5394087b5edb35fb6d6378e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac781369-ee42-4486-9852-422b7d2443a8),volume_type_id=ac781369-ee42-4486-9852-422b7d2443a8)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:23:58 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-77c6bd1f-165f-42db-a669-8da71bb68304 tempest-TestInstancesWithCinderVolumes-1798748222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30d727a7-a1f8-424a-a32a-ddebcd9f680c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:23:58 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-77c6bd1f-165f-42db-a669-8da71bb68304 tempest-TestInstancesWithCinderVolumes-1798748222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30d727a7-a1f8-424a-a32a-ddebcd9f680c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:23:58 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-77c6bd1f-165f-42db-a669-8da71bb68304 tempest-TestInstancesWithCinderVolumes-1798748222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01caf9d5-a8c1-4170-959d-13f4b72b9da0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:23:58 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-77c6bd1f-165f-42db-a669-8da71bb68304 tempest-TestInstancesWithCinderVolumes-1798748222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01caf9d5-a8c1-4170-959d-13f4b72b9da0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca88091b-1150-43b1-8661-0fea45cc3e17', 'volume_name': 'volume-ca88091b-1150-43b1-8661-0fea45cc3e17', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:23:58 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-77c6bd1f-165f-42db-a669-8da71bb68304 tempest-TestInstancesWithCinderVolumes-1798748222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65e9435b-8f37-454b-8307-7ac24b8b9842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:23:58 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-77c6bd1f-165f-42db-a669-8da71bb68304 tempest-TestInstancesWithCinderVolumes-1798748222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65e9435b-8f37-454b-8307-7ac24b8b9842) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:23:58 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-77c6bd1f-165f-42db-a669-8da71bb68304 tempest-TestInstancesWithCinderVolumes-1798748222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5a2fc24-5b73-44c2-8990-d24891e9df29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:23:58 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-77c6bd1f-165f-42db-a669-8da71bb68304 tempest-TestInstancesWithCinderVolumes-1798748222 None] Volume ca88091b-1150-43b1-8661-0fea45cc3e17: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca88091b-1150-43b1-8661-0fea45cc3e17', 'volume_size': 1} Sep 15 16:23:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-77c6bd1f-165f-42db-a669-8da71bb68304 tempest-TestInstancesWithCinderVolumes-1798748222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:23:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-77c6bd1f-165f-42db-a669-8da71bb68304 tempest-TestInstancesWithCinderVolumes-1798748222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:23:58 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-77c6bd1f-165f-42db-a669-8da71bb68304 tempest-TestInstancesWithCinderVolumes-1798748222 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:23:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1312503340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca88091b-1150-43b1-8661-0fea45cc3e17,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f23d7dcf47c04cd38f24c4049b1921c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:23:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:23:58Z,use_quota=True,user_id='4899c765a5394087b5edb35fb6d6378e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ac781369-ee42-4486-9852-422b7d2443a8),volume_type_id=ac781369-ee42-4486-9852-422b7d2443a8)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:23:58 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-77c6bd1f-165f-42db-a669-8da71bb68304 tempest-TestInstancesWithCinderVolumes-1798748222 None] Creating volume ca88091b-1150-43b1-8661-0fea45cc3e17 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:23:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-77c6bd1f-165f-42db-a669-8da71bb68304 tempest-TestInstancesWithCinderVolumes-1798748222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:23:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-77c6bd1f-165f-42db-a669-8da71bb68304 tempest-TestInstancesWithCinderVolumes-1798748222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:23:58 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-77c6bd1f-165f-42db-a669-8da71bb68304 tempest-TestInstancesWithCinderVolumes-1798748222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:23:58 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-77c6bd1f-165f-42db-a669-8da71bb68304 tempest-TestInstancesWithCinderVolumes-1798748222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:23:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-77c6bd1f-165f-42db-a669-8da71bb68304 tempest-TestInstancesWithCinderVolumes-1798748222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:23:58 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-77c6bd1f-165f-42db-a669-8da71bb68304 tempest-TestInstancesWithCinderVolumes-1798748222 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:23:58 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-77c6bd1f-165f-42db-a669-8da71bb68304 tempest-TestInstancesWithCinderVolumes-1798748222 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:23:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-77c6bd1f-165f-42db-a669-8da71bb68304 tempest-TestInstancesWithCinderVolumes-1798748222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ca88091b-1150-43b1-8661-0fea45cc3e17 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:23:58 devstack sudo[96167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ca88091b-1150-43b1-8661-0fea45cc3e17 1073741824 Sep 15 16:23:58 devstack sudo[96167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:23:59 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-18136ad0-61ec-4ec6-9ccc-71779397624e tempest-TestInstancesWithCinderVolumes-1798748222 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:23:59 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-18136ad0-61ec-4ec6-9ccc-71779397624e tempest-TestInstancesWithCinderVolumes-1798748222 None] Flow 'volume_create_manager' (a2933e2d-318b-48a6-9f54-ab6922f525c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:23:59 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-18136ad0-61ec-4ec6-9ccc-71779397624e tempest-TestInstancesWithCinderVolumes-1798748222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2db0203d-5e30-4af2-867b-1d81d4f47997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:23:59 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-18136ad0-61ec-4ec6-9ccc-71779397624e tempest-TestInstancesWithCinderVolumes-1798748222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2db0203d-5e30-4af2-867b-1d81d4f47997) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:23:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1812641073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a6bf931-2c01-4b85-b693-21030ecbaccd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f23d7dcf47c04cd38f24c4049b1921c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:23:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:23:59Z,use_quota=True,user_id='4899c765a5394087b5edb35fb6d6378e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3616fd5e-7f9d-4046-9218-852bdbd9de83),volume_type_id=3616fd5e-7f9d-4046-9218-852bdbd9de83)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:23:59 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-18136ad0-61ec-4ec6-9ccc-71779397624e tempest-TestInstancesWithCinderVolumes-1798748222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f099a8ca-1b81-4f73-bf80-cd9d11e99209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:23:59 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-18136ad0-61ec-4ec6-9ccc-71779397624e tempest-TestInstancesWithCinderVolumes-1798748222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f099a8ca-1b81-4f73-bf80-cd9d11e99209) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:23:59 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-18136ad0-61ec-4ec6-9ccc-71779397624e tempest-TestInstancesWithCinderVolumes-1798748222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cdaee12-99c3-47a0-a678-5e5e89f57059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:23:59 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-18136ad0-61ec-4ec6-9ccc-71779397624e tempest-TestInstancesWithCinderVolumes-1798748222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cdaee12-99c3-47a0-a678-5e5e89f57059) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a6bf931-2c01-4b85-b693-21030ecbaccd', 'volume_name': 'volume-0a6bf931-2c01-4b85-b693-21030ecbaccd', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:23:59 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-18136ad0-61ec-4ec6-9ccc-71779397624e tempest-TestInstancesWithCinderVolumes-1798748222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf43ab50-6cd9-46f7-9141-da1a9102d69b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:23:59 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-18136ad0-61ec-4ec6-9ccc-71779397624e tempest-TestInstancesWithCinderVolumes-1798748222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf43ab50-6cd9-46f7-9141-da1a9102d69b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:23:59 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-18136ad0-61ec-4ec6-9ccc-71779397624e tempest-TestInstancesWithCinderVolumes-1798748222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8273b088-aee6-472e-bf5e-8ca1705ff4b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:23:59 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-18136ad0-61ec-4ec6-9ccc-71779397624e tempest-TestInstancesWithCinderVolumes-1798748222 None] Volume 0a6bf931-2c01-4b85-b693-21030ecbaccd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a6bf931-2c01-4b85-b693-21030ecbaccd', 'volume_size': 1} Sep 15 16:23:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-18136ad0-61ec-4ec6-9ccc-71779397624e tempest-TestInstancesWithCinderVolumes-1798748222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:23:59 devstack sudo[96167]: pam_unix(sudo:session): session closed for user root Sep 15 16:23:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-77c6bd1f-165f-42db-a669-8da71bb68304 tempest-TestInstancesWithCinderVolumes-1798748222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ca88091b-1150-43b1-8661-0fea45cc3e17 1073741824" returned: 0 in 0.966s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:23:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-77c6bd1f-165f-42db-a669-8da71bb68304 tempest-TestInstancesWithCinderVolumes-1798748222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ca88091b-1150-43b1-8661-0fea45cc3e17 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:23:59 devstack sudo[96184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ca88091b-1150-43b1-8661-0fea45cc3e17 Sep 15 16:23:59 devstack sudo[96184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:23:59 devstack cinder-volume[86082]: DEBUG oslo_service.periodic_task [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86082) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 15 16:23:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:23:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:23:59 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:23:59 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:23:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:23:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:23:59 devstack sudo[96186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:23:59 devstack sudo[96186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:24:00 devstack sudo[96184]: pam_unix(sudo:session): session closed for user root Sep 15 16:24:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-77c6bd1f-165f-42db-a669-8da71bb68304 tempest-TestInstancesWithCinderVolumes-1798748222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ca88091b-1150-43b1-8661-0fea45cc3e17" returned: 0 in 0.494s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:24:00 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-77c6bd1f-165f-42db-a669-8da71bb68304 tempest-TestInstancesWithCinderVolumes-1798748222 None] <== create_volume: return (1549ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:24:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-77c6bd1f-165f-42db-a669-8da71bb68304 tempest-TestInstancesWithCinderVolumes-1798748222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.556s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:24:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-18136ad0-61ec-4ec6-9ccc-71779397624e tempest-TestInstancesWithCinderVolumes-1798748222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.635s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:24:00 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-18136ad0-61ec-4ec6-9ccc-71779397624e tempest-TestInstancesWithCinderVolumes-1798748222 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:23:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1812641073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a6bf931-2c01-4b85-b693-21030ecbaccd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f23d7dcf47c04cd38f24c4049b1921c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:23:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:23:59Z,use_quota=True,user_id='4899c765a5394087b5edb35fb6d6378e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3616fd5e-7f9d-4046-9218-852bdbd9de83),volume_type_id=3616fd5e-7f9d-4046-9218-852bdbd9de83)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:24:00 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-18136ad0-61ec-4ec6-9ccc-71779397624e tempest-TestInstancesWithCinderVolumes-1798748222 None] Creating volume 0a6bf931-2c01-4b85-b693-21030ecbaccd {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:24:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-18136ad0-61ec-4ec6-9ccc-71779397624e tempest-TestInstancesWithCinderVolumes-1798748222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:24:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-18136ad0-61ec-4ec6-9ccc-71779397624e tempest-TestInstancesWithCinderVolumes-1798748222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:24:00 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-18136ad0-61ec-4ec6-9ccc-71779397624e tempest-TestInstancesWithCinderVolumes-1798748222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:24:00 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-18136ad0-61ec-4ec6-9ccc-71779397624e tempest-TestInstancesWithCinderVolumes-1798748222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:24:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-18136ad0-61ec-4ec6-9ccc-71779397624e tempest-TestInstancesWithCinderVolumes-1798748222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:24:00 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-18136ad0-61ec-4ec6-9ccc-71779397624e tempest-TestInstancesWithCinderVolumes-1798748222 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:24:00 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-18136ad0-61ec-4ec6-9ccc-71779397624e tempest-TestInstancesWithCinderVolumes-1798748222 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:24:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-18136ad0-61ec-4ec6-9ccc-71779397624e tempest-TestInstancesWithCinderVolumes-1798748222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0a6bf931-2c01-4b85-b693-21030ecbaccd 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:24:00 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-169c1327-e9a2-48eb-8a05-051ea55e7e4a tempest-VolumesNegativeTest-1626062929 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:24:00 devstack sudo[96186]: pam_unix(sudo:session): session closed for user root Sep 15 16:24:00 devstack sudo[96191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0a6bf931-2c01-4b85-b693-21030ecbaccd 1073741824 Sep 15 16:24:00 devstack sudo[96191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:24:00 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-169c1327-e9a2-48eb-8a05-051ea55e7e4a tempest-VolumesNegativeTest-1626062929 None] Flow 'volume_create_manager' (543ed769-a052-4a89-926d-20dec4b6bbd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:24:00 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-169c1327-e9a2-48eb-8a05-051ea55e7e4a tempest-VolumesNegativeTest-1626062929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2cce2ac-a4bf-43a1-8a7a-c22526870e97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:24:00 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-77c6bd1f-165f-42db-a669-8da71bb68304 tempest-TestInstancesWithCinderVolumes-1798748222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5a2fc24-5b73-44c2-8990-d24891e9df29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca88091b-1150-43b1-8661-0fea45cc3e17', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:24:00 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-77c6bd1f-165f-42db-a669-8da71bb68304 tempest-TestInstancesWithCinderVolumes-1798748222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6b4dfcc-11af-4efe-8d30-37e657bf42cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:24:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.554s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:24:00 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:24:00 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-169c1327-e9a2-48eb-8a05-051ea55e7e4a tempest-VolumesNegativeTest-1626062929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2cce2ac-a4bf-43a1-8a7a-c22526870e97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:23:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-555890204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fc2bff1-5cb7-4281-aff1-5a6168ffe82f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='949cb385663244eb9e11b81484cf9366',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:24:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:24:00Z,use_quota=True,user_id='c9d495f869fe428c8941be411c41b548',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:24:00 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-169c1327-e9a2-48eb-8a05-051ea55e7e4a tempest-VolumesNegativeTest-1626062929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32f89810-260a-4cd3-931c-f4f0157237cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:24:00 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-169c1327-e9a2-48eb-8a05-051ea55e7e4a tempest-VolumesNegativeTest-1626062929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32f89810-260a-4cd3-931c-f4f0157237cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:24:00 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-169c1327-e9a2-48eb-8a05-051ea55e7e4a tempest-VolumesNegativeTest-1626062929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cab8f55-9ad4-4e2c-8e5f-9c04b982125a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:24:00 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-169c1327-e9a2-48eb-8a05-051ea55e7e4a tempest-VolumesNegativeTest-1626062929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cab8f55-9ad4-4e2c-8e5f-9c04b982125a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9fc2bff1-5cb7-4281-aff1-5a6168ffe82f', 'volume_name': 'volume-9fc2bff1-5cb7-4281-aff1-5a6168ffe82f', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:24:00 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-169c1327-e9a2-48eb-8a05-051ea55e7e4a tempest-VolumesNegativeTest-1626062929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bbcc0a9-a1ed-43dc-8fe2-4fcccfb86630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:24:00 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-169c1327-e9a2-48eb-8a05-051ea55e7e4a tempest-VolumesNegativeTest-1626062929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bbcc0a9-a1ed-43dc-8fe2-4fcccfb86630) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:24:00 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-169c1327-e9a2-48eb-8a05-051ea55e7e4a tempest-VolumesNegativeTest-1626062929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83d99635-2879-4855-9b62-db22941ff0a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:24:00 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-169c1327-e9a2-48eb-8a05-051ea55e7e4a tempest-VolumesNegativeTest-1626062929 None] Volume 9fc2bff1-5cb7-4281-aff1-5a6168ffe82f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9fc2bff1-5cb7-4281-aff1-5a6168ffe82f', 'volume_size': 1} Sep 15 16:24:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-169c1327-e9a2-48eb-8a05-051ea55e7e4a tempest-VolumesNegativeTest-1626062929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:24:00 devstack cinder-volume[86082]: DEBUG oslo_service.periodic_task [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Running periodic task VolumeManager._thread_info {{(pid=86082) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 15 16:24:00 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] thread count: 28 {{(pid=86082) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 15 16:24:00 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] thread info: [<_MainThread(MainThread, started 124875935469696)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86082) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 15 16:24:00 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-77c6bd1f-165f-42db-a669-8da71bb68304 tempest-TestInstancesWithCinderVolumes-1798748222 None] Volume volume-ca88091b-1150-43b1-8661-0fea45cc3e17 (ca88091b-1150-43b1-8661-0fea45cc3e17): created successfully Sep 15 16:24:00 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-77c6bd1f-165f-42db-a669-8da71bb68304 tempest-TestInstancesWithCinderVolumes-1798748222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6b4dfcc-11af-4efe-8d30-37e657bf42cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:24:00 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-77c6bd1f-165f-42db-a669-8da71bb68304 tempest-TestInstancesWithCinderVolumes-1798748222 None] Flow 'volume_create_manager' (1c4dba30-298f-4bc9-a6c7-cc5a3b3245f3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:24:00 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-77c6bd1f-165f-42db-a669-8da71bb68304 tempest-TestInstancesWithCinderVolumes-1798748222 None] Created volume successfully. Sep 15 16:24:00 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-21d9e2ef-2cbe-4066-81ea-db47d1d685b7 tempest-TestInstancesWithCinderVolumes-1798748222 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:24:00 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-21d9e2ef-2cbe-4066-81ea-db47d1d685b7 tempest-TestInstancesWithCinderVolumes-1798748222 None] Flow 'volume_create_manager' (3b66c152-08bc-4561-b702-2404f1555b68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:24:00 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-21d9e2ef-2cbe-4066-81ea-db47d1d685b7 tempest-TestInstancesWithCinderVolumes-1798748222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26a07535-64ff-4d78-b92e-88d287c7d6e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:24:00 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-21d9e2ef-2cbe-4066-81ea-db47d1d685b7 tempest-TestInstancesWithCinderVolumes-1798748222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26a07535-64ff-4d78-b92e-88d287c7d6e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:24:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-212197783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2510a23-d973-45ae-91fa-e844869e3e69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f23d7dcf47c04cd38f24c4049b1921c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:24:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:24:01Z,use_quota=True,user_id='4899c765a5394087b5edb35fb6d6378e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2377ed71-882a-4208-806e-8c1644e143d8),volume_type_id=2377ed71-882a-4208-806e-8c1644e143d8)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:24:00 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-21d9e2ef-2cbe-4066-81ea-db47d1d685b7 tempest-TestInstancesWithCinderVolumes-1798748222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcf06969-9201-4174-8758-485d10b89c0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:24:00 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-21d9e2ef-2cbe-4066-81ea-db47d1d685b7 tempest-TestInstancesWithCinderVolumes-1798748222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcf06969-9201-4174-8758-485d10b89c0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:24:00 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-21d9e2ef-2cbe-4066-81ea-db47d1d685b7 tempest-TestInstancesWithCinderVolumes-1798748222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b20df557-bfd4-481e-a487-457b23277841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:24:00 devstack cinder-volume[86082]: DEBUG cinder.image.glance [None req-21d9e2ef-2cbe-4066-81ea-db47d1d685b7 tempest-TestInstancesWithCinderVolumes-1798748222 None] Creating Keystone auth plugin from conf {{(pid=86082) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 15 16:24:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-9668a3b9-1115-4195-8b02-ed24f9387499 req-f3fb5d56-8f82-41b8-9c7f-6c936bf425a8 tempest-VolumesSnapshotsTestJSON-1522789859 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:24:01 devstack sudo[96191]: pam_unix(sudo:session): session closed for user root Sep 15 16:24:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-18136ad0-61ec-4ec6-9ccc-71779397624e tempest-TestInstancesWithCinderVolumes-1798748222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0a6bf931-2c01-4b85-b693-21030ecbaccd 1073741824" returned: 0 in 0.823s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:24:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-18136ad0-61ec-4ec6-9ccc-71779397624e tempest-TestInstancesWithCinderVolumes-1798748222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0a6bf931-2c01-4b85-b693-21030ecbaccd {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:24:01 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-21d9e2ef-2cbe-4066-81ea-db47d1d685b7 tempest-TestInstancesWithCinderVolumes-1798748222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b20df557-bfd4-481e-a487-457b23277841) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f2510a23-d973-45ae-91fa-e844869e3e69', 'volume_name': 'volume-f2510a23-d973-45ae-91fa-e844869e3e69', 'volume_size': 1, 'image_id': '0cb20200-0fac-4e67-bda7-6116728683e5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0cb20200-0fac-4e67-bda7-6116728683e5', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1813162065', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f23d7dcf47c04cd38f24c4049b1921c3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0cb20200-0fac-4e67-bda7-6116728683e5', 'created_at': datetime.datetime(2026, 9, 15, 14, 23, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 15, 14, 23, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0cb20200-0fac-4e67-bda7-6116728683e5/file', 'properties': {}}, 'image_service': }' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:24:01 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-21d9e2ef-2cbe-4066-81ea-db47d1d685b7 tempest-TestInstancesWithCinderVolumes-1798748222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cec12a12-db6c-40c9-a31a-0884723c437b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:24:01 devstack sudo[96198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0a6bf931-2c01-4b85-b693-21030ecbaccd Sep 15 16:24:01 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-21d9e2ef-2cbe-4066-81ea-db47d1d685b7 tempest-TestInstancesWithCinderVolumes-1798748222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cec12a12-db6c-40c9-a31a-0884723c437b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:24:01 devstack sudo[96198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:24:01 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-21d9e2ef-2cbe-4066-81ea-db47d1d685b7 tempest-TestInstancesWithCinderVolumes-1798748222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc82bb57-bc70-4ce6-81d1-c99c126094b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:24:01 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-21d9e2ef-2cbe-4066-81ea-db47d1d685b7 tempest-TestInstancesWithCinderVolumes-1798748222 None] Volume f2510a23-d973-45ae-91fa-e844869e3e69: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f2510a23-d973-45ae-91fa-e844869e3e69', 'volume_size': 1, 'image_id': '0cb20200-0fac-4e67-bda7-6116728683e5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0cb20200-0fac-4e67-bda7-6116728683e5', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1813162065', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f23d7dcf47c04cd38f24c4049b1921c3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0cb20200-0fac-4e67-bda7-6116728683e5', 'created_at': datetime.datetime(2026, 9, 15, 14, 23, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 15, 14, 23, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0cb20200-0fac-4e67-bda7-6116728683e5/file', 'properties': {}}, 'image_service': } Sep 15 16:24:01 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-21d9e2ef-2cbe-4066-81ea-db47d1d685b7 tempest-TestInstancesWithCinderVolumes-1798748222 None] Trying to clone f2510a23-d973-45ae-91fa-e844869e3e69 from image 0cb20200-0fac-4e67-bda7-6116728683e5 at location (None, [{'url': 'file:///opt/stack/data/glance/images/0cb20200-0fac-4e67-bda7-6116728683e5', 'metadata': {}}]). {{(pid=86082) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 15 16:24:01 devstack sudo[96198]: pam_unix(sudo:session): session closed for user root Sep 15 16:24:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-18136ad0-61ec-4ec6-9ccc-71779397624e tempest-TestInstancesWithCinderVolumes-1798748222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0a6bf931-2c01-4b85-b693-21030ecbaccd" returned: 0 in 0.324s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:24:01 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-18136ad0-61ec-4ec6-9ccc-71779397624e tempest-TestInstancesWithCinderVolumes-1798748222 None] <== create_volume: return (1216ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:24:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-18136ad0-61ec-4ec6-9ccc-71779397624e tempest-TestInstancesWithCinderVolumes-1798748222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.219s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:24:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-169c1327-e9a2-48eb-8a05-051ea55e7e4a tempest-VolumesNegativeTest-1626062929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.968s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:24:01 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-169c1327-e9a2-48eb-8a05-051ea55e7e4a tempest-VolumesNegativeTest-1626062929 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:23:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-555890204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fc2bff1-5cb7-4281-aff1-5a6168ffe82f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='949cb385663244eb9e11b81484cf9366',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:24:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:24:00Z,use_quota=True,user_id='c9d495f869fe428c8941be411c41b548',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:24:01 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-169c1327-e9a2-48eb-8a05-051ea55e7e4a tempest-VolumesNegativeTest-1626062929 None] Creating volume 9fc2bff1-5cb7-4281-aff1-5a6168ffe82f {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:24:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-169c1327-e9a2-48eb-8a05-051ea55e7e4a tempest-VolumesNegativeTest-1626062929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:24:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-169c1327-e9a2-48eb-8a05-051ea55e7e4a tempest-VolumesNegativeTest-1626062929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:24:01 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-169c1327-e9a2-48eb-8a05-051ea55e7e4a tempest-VolumesNegativeTest-1626062929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:24:01 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-169c1327-e9a2-48eb-8a05-051ea55e7e4a tempest-VolumesNegativeTest-1626062929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:24:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-169c1327-e9a2-48eb-8a05-051ea55e7e4a tempest-VolumesNegativeTest-1626062929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:24:01 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-169c1327-e9a2-48eb-8a05-051ea55e7e4a tempest-VolumesNegativeTest-1626062929 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:24:01 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-169c1327-e9a2-48eb-8a05-051ea55e7e4a tempest-VolumesNegativeTest-1626062929 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:24:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-169c1327-e9a2-48eb-8a05-051ea55e7e4a tempest-VolumesNegativeTest-1626062929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-9fc2bff1-5cb7-4281-aff1-5a6168ffe82f 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:24:01 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-18136ad0-61ec-4ec6-9ccc-71779397624e tempest-TestInstancesWithCinderVolumes-1798748222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8273b088-aee6-472e-bf5e-8ca1705ff4b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a6bf931-2c01-4b85-b693-21030ecbaccd', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:24:01 devstack sudo[96201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-9fc2bff1-5cb7-4281-aff1-5a6168ffe82f 1073741824 Sep 15 16:24:01 devstack sudo[96201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:24:01 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-18136ad0-61ec-4ec6-9ccc-71779397624e tempest-TestInstancesWithCinderVolumes-1798748222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07f98b3f-a46e-42e4-9d91-6afa783f2c2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:24:01 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-18136ad0-61ec-4ec6-9ccc-71779397624e tempest-TestInstancesWithCinderVolumes-1798748222 None] Volume volume-0a6bf931-2c01-4b85-b693-21030ecbaccd (0a6bf931-2c01-4b85-b693-21030ecbaccd): created successfully Sep 15 16:24:01 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-18136ad0-61ec-4ec6-9ccc-71779397624e tempest-TestInstancesWithCinderVolumes-1798748222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (07f98b3f-a46e-42e4-9d91-6afa783f2c2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:24:01 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-18136ad0-61ec-4ec6-9ccc-71779397624e tempest-TestInstancesWithCinderVolumes-1798748222 None] Flow 'volume_create_manager' (a2933e2d-318b-48a6-9f54-ab6922f525c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:24:01 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-18136ad0-61ec-4ec6-9ccc-71779397624e tempest-TestInstancesWithCinderVolumes-1798748222 None] Created volume successfully. Sep 15 16:24:02 devstack sudo[96201]: pam_unix(sudo:session): session closed for user root Sep 15 16:24:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-169c1327-e9a2-48eb-8a05-051ea55e7e4a tempest-VolumesNegativeTest-1626062929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-9fc2bff1-5cb7-4281-aff1-5a6168ffe82f 1073741824" returned: 0 in 0.568s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:24:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-169c1327-e9a2-48eb-8a05-051ea55e7e4a tempest-VolumesNegativeTest-1626062929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-9fc2bff1-5cb7-4281-aff1-5a6168ffe82f {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:24:02 devstack sudo[96207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-9fc2bff1-5cb7-4281-aff1-5a6168ffe82f Sep 15 16:24:02 devstack sudo[96207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:24:02 devstack sudo[96207]: pam_unix(sudo:session): session closed for user root Sep 15 16:24:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-169c1327-e9a2-48eb-8a05-051ea55e7e4a tempest-VolumesNegativeTest-1626062929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-9fc2bff1-5cb7-4281-aff1-5a6168ffe82f" returned: 0 in 0.324s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:24:02 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-169c1327-e9a2-48eb-8a05-051ea55e7e4a tempest-VolumesNegativeTest-1626062929 None] <== create_volume: return (981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:24:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-169c1327-e9a2-48eb-8a05-051ea55e7e4a tempest-VolumesNegativeTest-1626062929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.984s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:24:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-9668a3b9-1115-4195-8b02-ed24f9387499 req-f3fb5d56-8f82-41b8-9c7f-6c936bf425a8 tempest-VolumesSnapshotsTestJSON-1522789859 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.716s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:24:02 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-169c1327-e9a2-48eb-8a05-051ea55e7e4a tempest-VolumesNegativeTest-1626062929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83d99635-2879-4855-9b62-db22941ff0a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9fc2bff1-5cb7-4281-aff1-5a6168ffe82f', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:24:02 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-169c1327-e9a2-48eb-8a05-051ea55e7e4a tempest-VolumesNegativeTest-1626062929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0384884-cc41-46c9-85b0-5a420cdfa141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:24:02 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [req-9668a3b9-1115-4195-8b02-ed24f9387499 req-f3fb5d56-8f82-41b8-9c7f-6c936bf425a8 tempest-VolumesSnapshotsTestJSON-1522789859 None] Creating offline snapshot e051d8b9-6b68-4a33-8041-5f445a71079a of volume c3ff6808-d8b7-4b9c-99f6-14a4265e45da {{(pid=86082) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 15 16:24:02 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-169c1327-e9a2-48eb-8a05-051ea55e7e4a tempest-VolumesNegativeTest-1626062929 None] Volume volume-9fc2bff1-5cb7-4281-aff1-5a6168ffe82f (9fc2bff1-5cb7-4281-aff1-5a6168ffe82f): created successfully Sep 15 16:24:02 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-169c1327-e9a2-48eb-8a05-051ea55e7e4a tempest-VolumesNegativeTest-1626062929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0384884-cc41-46c9-85b0-5a420cdfa141) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:24:02 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-169c1327-e9a2-48eb-8a05-051ea55e7e4a tempest-VolumesNegativeTest-1626062929 None] Flow 'volume_create_manager' (543ed769-a052-4a89-926d-20dec4b6bbd2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:24:02 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7d4d6b8-eeb4-469e-aed5-665ff34de091]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:24:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [req-9668a3b9-1115-4195-8b02-ed24f9387499 req-f3fb5d56-8f82-41b8-9c7f-6c936bf425a8 tempest-VolumesSnapshotsTestJSON-1522789859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c3ff6808-d8b7-4b9c-99f6-14a4265e45da {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:24:02 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-169c1327-e9a2-48eb-8a05-051ea55e7e4a tempest-VolumesNegativeTest-1626062929 None] Created volume successfully. Sep 15 16:24:02 devstack sudo[96210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c3ff6808-d8b7-4b9c-99f6-14a4265e45da Sep 15 16:24:02 devstack sudo[96210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:24:02 devstack sudo[96210]: pam_unix(sudo:session): session closed for user root Sep 15 16:24:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [req-9668a3b9-1115-4195-8b02-ed24f9387499 req-f3fb5d56-8f82-41b8-9c7f-6c936bf425a8 tempest-VolumesSnapshotsTestJSON-1522789859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c3ff6808-d8b7-4b9c-99f6-14a4265e45da" returned: 0 in 0.453s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:24:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [req-9668a3b9-1115-4195-8b02-ed24f9387499 req-f3fb5d56-8f82-41b8-9c7f-6c936bf425a8 tempest-VolumesSnapshotsTestJSON-1522789859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c3ff6808-d8b7-4b9c-99f6-14a4265e45da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c3ff6808-d8b7-4b9c-99f6-14a4265e45da.e051d8b9-6b68-4a33-8041-5f445a71079a 1G {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:24:02 devstack sudo[96216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c3ff6808-d8b7-4b9c-99f6-14a4265e45da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c3ff6808-d8b7-4b9c-99f6-14a4265e45da.e051d8b9-6b68-4a33-8041-5f445a71079a 1G Sep 15 16:24:02 devstack sudo[96216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:24:03 devstack sudo[96216]: pam_unix(sudo:session): session closed for user root Sep 15 16:24:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [req-9668a3b9-1115-4195-8b02-ed24f9387499 req-f3fb5d56-8f82-41b8-9c7f-6c936bf425a8 tempest-VolumesSnapshotsTestJSON-1522789859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c3ff6808-d8b7-4b9c-99f6-14a4265e45da,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c3ff6808-d8b7-4b9c-99f6-14a4265e45da.e051d8b9-6b68-4a33-8041-5f445a71079a 1G" returned: 0 in 0.566s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:24:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [req-9668a3b9-1115-4195-8b02-ed24f9387499 req-f3fb5d56-8f82-41b8-9c7f-6c936bf425a8 tempest-VolumesSnapshotsTestJSON-1522789859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3ff6808-d8b7-4b9c-99f6-14a4265e45da -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c3ff6808-d8b7-4b9c-99f6-14a4265e45da.e051d8b9-6b68-4a33-8041-5f445a71079a {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:24:03 devstack sudo[96221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3ff6808-d8b7-4b9c-99f6-14a4265e45da -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c3ff6808-d8b7-4b9c-99f6-14a4265e45da.e051d8b9-6b68-4a33-8041-5f445a71079a Sep 15 16:24:03 devstack sudo[96221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:24:03 devstack sudo[96221]: pam_unix(sudo:session): session closed for user root Sep 15 16:24:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [req-9668a3b9-1115-4195-8b02-ed24f9387499 req-f3fb5d56-8f82-41b8-9c7f-6c936bf425a8 tempest-VolumesSnapshotsTestJSON-1522789859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c3ff6808-d8b7-4b9c-99f6-14a4265e45da -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c3ff6808-d8b7-4b9c-99f6-14a4265e45da.e051d8b9-6b68-4a33-8041-5f445a71079a" returned: 0 in 0.457s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:24:03 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [req-9668a3b9-1115-4195-8b02-ed24f9387499 req-f3fb5d56-8f82-41b8-9c7f-6c936bf425a8 tempest-VolumesSnapshotsTestJSON-1522789859 None] /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c3ff6808-d8b7-4b9c-99f6-14a4265e45da.e051d8b9-6b68-4a33-8041-5f445a71079a is being set with open permissions: ugo+rw Sep 15 16:24:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [req-9668a3b9-1115-4195-8b02-ed24f9387499 req-f3fb5d56-8f82-41b8-9c7f-6c936bf425a8 tempest-VolumesSnapshotsTestJSON-1522789859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c3ff6808-d8b7-4b9c-99f6-14a4265e45da.e051d8b9-6b68-4a33-8041-5f445a71079a {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:24:04 devstack sudo[96229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c3ff6808-d8b7-4b9c-99f6-14a4265e45da.e051d8b9-6b68-4a33-8041-5f445a71079a Sep 15 16:24:04 devstack sudo[96229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:24:04 devstack sudo[96229]: pam_unix(sudo:session): session closed for user root Sep 15 16:24:04 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [req-9668a3b9-1115-4195-8b02-ed24f9387499 req-f3fb5d56-8f82-41b8-9c7f-6c936bf425a8 tempest-VolumesSnapshotsTestJSON-1522789859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c3ff6808-d8b7-4b9c-99f6-14a4265e45da.e051d8b9-6b68-4a33-8041-5f445a71079a" returned: 0 in 0.330s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:24:04 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [req-9668a3b9-1115-4195-8b02-ed24f9387499 req-f3fb5d56-8f82-41b8-9c7f-6c936bf425a8 tempest-VolumesSnapshotsTestJSON-1522789859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c3ff6808-d8b7-4b9c-99f6-14a4265e45da.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:24:04 devstack sudo[96232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c3ff6808-d8b7-4b9c-99f6-14a4265e45da.info Sep 15 16:24:04 devstack sudo[96232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:24:04 devstack sudo[96232]: pam_unix(sudo:session): session closed for user root Sep 15 16:24:04 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [req-9668a3b9-1115-4195-8b02-ed24f9387499 req-f3fb5d56-8f82-41b8-9c7f-6c936bf425a8 tempest-VolumesSnapshotsTestJSON-1522789859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c3ff6808-d8b7-4b9c-99f6-14a4265e45da.info" returned: 0 in 0.366s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:24:04 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [req-9668a3b9-1115-4195-8b02-ed24f9387499 req-f3fb5d56-8f82-41b8-9c7f-6c936bf425a8 tempest-VolumesSnapshotsTestJSON-1522789859 None] /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c3ff6808-d8b7-4b9c-99f6-14a4265e45da.info is being set with open permissions: ugo+rw Sep 15 16:24:04 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [req-9668a3b9-1115-4195-8b02-ed24f9387499 req-f3fb5d56-8f82-41b8-9c7f-6c936bf425a8 tempest-VolumesSnapshotsTestJSON-1522789859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c3ff6808-d8b7-4b9c-99f6-14a4265e45da.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:24:04 devstack sudo[96236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c3ff6808-d8b7-4b9c-99f6-14a4265e45da.info Sep 15 16:24:04 devstack sudo[96236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:24:05 devstack sudo[96236]: pam_unix(sudo:session): session closed for user root Sep 15 16:24:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [req-9668a3b9-1115-4195-8b02-ed24f9387499 req-f3fb5d56-8f82-41b8-9c7f-6c936bf425a8 tempest-VolumesSnapshotsTestJSON-1522789859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c3ff6808-d8b7-4b9c-99f6-14a4265e45da.info" returned: 0 in 0.323s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:24:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-9668a3b9-1115-4195-8b02-ed24f9387499 req-f3fb5d56-8f82-41b8-9c7f-6c936bf425a8 tempest-VolumesSnapshotsTestJSON-1522789859 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.658s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:24:05 devstack cinder-volume[86082]: INFO cinder.volume.manager [req-9668a3b9-1115-4195-8b02-ed24f9387499 req-f3fb5d56-8f82-41b8-9c7f-6c936bf425a8 tempest-VolumesSnapshotsTestJSON-1522789859 None] Create snapshot completed successfully Sep 15 16:24:05 devstack cinder-volume[86082]: DEBUG cinder.coordination [req-c83b4bd2-7264-424e-8adf-2ae4c63c04ff req-b5c0c416-f17e-4522-86ae-07b56fc7757b tempest-VolumesSnapshotsTestJSON-1522789859 None] Acquiring lock "cinder-e051d8b9-6b68-4a33-8041-5f445a71079a-delete_snapshot" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:24:05 devstack cinder-volume[86082]: DEBUG cinder.coordination [req-c83b4bd2-7264-424e-8adf-2ae4c63c04ff req-b5c0c416-f17e-4522-86ae-07b56fc7757b tempest-VolumesSnapshotsTestJSON-1522789859 None] Lock "cinder-e051d8b9-6b68-4a33-8041-5f445a71079a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.047s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:24:05 devstack cinder-volume[86082]: DEBUG cinder.coordination [req-c83b4bd2-7264-424e-8adf-2ae4c63c04ff req-b5c0c416-f17e-4522-86ae-07b56fc7757b tempest-VolumesSnapshotsTestJSON-1522789859 None] Acquiring lock "cinder-quobyte-c3ff6808-d8b7-4b9c-99f6-14a4265e45da" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:24:05 devstack cinder-volume[86082]: DEBUG cinder.coordination [req-c83b4bd2-7264-424e-8adf-2ae4c63c04ff req-b5c0c416-f17e-4522-86ae-07b56fc7757b tempest-VolumesSnapshotsTestJSON-1522789859 None] Lock "cinder-quobyte-c3ff6808-d8b7-4b9c-99f6-14a4265e45da" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:24:05 devstack cinder-volume[86082]: DEBUG cinder.coordination [req-c83b4bd2-7264-424e-8adf-2ae4c63c04ff req-b5c0c416-f17e-4522-86ae-07b56fc7757b tempest-VolumesSnapshotsTestJSON-1522789859 None] Acquiring lock "cinder-quobyte-e051d8b9-6b68-4a33-8041-5f445a71079a" by "_delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:24:05 devstack cinder-volume[86082]: DEBUG cinder.coordination [req-c83b4bd2-7264-424e-8adf-2ae4c63c04ff req-b5c0c416-f17e-4522-86ae-07b56fc7757b tempest-VolumesSnapshotsTestJSON-1522789859 None] Lock "cinder-quobyte-e051d8b9-6b68-4a33-8041-5f445a71079a" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:24:05 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [req-c83b4bd2-7264-424e-8adf-2ae4c63c04ff req-b5c0c416-f17e-4522-86ae-07b56fc7757b tempest-VolumesSnapshotsTestJSON-1522789859 None] Deleting offline snapshot e051d8b9-6b68-4a33-8041-5f445a71079a of volume c3ff6808-d8b7-4b9c-99f6-14a4265e45da {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 15 16:24:05 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [req-c83b4bd2-7264-424e-8adf-2ae4c63c04ff req-b5c0c416-f17e-4522-86ae-07b56fc7757b tempest-VolumesSnapshotsTestJSON-1522789859 None] snapshot_file for this snap is: volume-c3ff6808-d8b7-4b9c-99f6-14a4265e45da.e051d8b9-6b68-4a33-8041-5f445a71079a {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 15 16:24:05 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[bac2f88e-6c1c-491c-b210-46a652255029]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:24:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [req-c83b4bd2-7264-424e-8adf-2ae4c63c04ff req-b5c0c416-f17e-4522-86ae-07b56fc7757b tempest-VolumesSnapshotsTestJSON-1522789859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c3ff6808-d8b7-4b9c-99f6-14a4265e45da.e051d8b9-6b68-4a33-8041-5f445a71079a {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:24:05 devstack sudo[96239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c3ff6808-d8b7-4b9c-99f6-14a4265e45da.e051d8b9-6b68-4a33-8041-5f445a71079a Sep 15 16:24:05 devstack sudo[96239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:24:06 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-21d9e2ef-2cbe-4066-81ea-db47d1d685b7 tempest-TestInstancesWithCinderVolumes-1798748222 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0cb20200-0fac-4e67-bda7-6116728683e5_h9_75fikdevstack@QuobyteHD, size 20.69 MB, duration 4.84 sec {{(pid=86082) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 15 16:24:06 devstack cinder-volume[86082]: INFO cinder.image.image_utils [None req-21d9e2ef-2cbe-4066-81ea-db47d1d685b7 tempest-TestInstancesWithCinderVolumes-1798748222 None] Image download 20.69 MB at 4.28 MB/s Sep 15 16:24:06 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa6af8a1-c9de-447d-9354-aafb51d46fc0]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:24:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-21d9e2ef-2cbe-4066-81ea-db47d1d685b7 tempest-TestInstancesWithCinderVolumes-1798748222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0cb20200-0fac-4e67-bda7-6116728683e5_h9_75fikdevstack@QuobyteHD {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:24:06 devstack sudo[96245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0cb20200-0fac-4e67-bda7-6116728683e5_h9_75fikdevstack@QuobyteHD Sep 15 16:24:06 devstack sudo[96245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:24:06 devstack sudo[96239]: pam_unix(sudo:session): session closed for user root Sep 15 16:24:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [req-c83b4bd2-7264-424e-8adf-2ae4c63c04ff req-b5c0c416-f17e-4522-86ae-07b56fc7757b tempest-VolumesSnapshotsTestJSON-1522789859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c3ff6808-d8b7-4b9c-99f6-14a4265e45da.e051d8b9-6b68-4a33-8041-5f445a71079a" returned: 0 in 0.685s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:24:06 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [req-c83b4bd2-7264-424e-8adf-2ae4c63c04ff req-b5c0c416-f17e-4522-86ae-07b56fc7757b tempest-VolumesSnapshotsTestJSON-1522789859 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c3ff6808-d8b7-4b9c-99f6-14a4265e45da(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 16:24:06 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[4771548b-53b6-4877-bd45-15bd2840807a]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:24:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [req-c83b4bd2-7264-424e-8adf-2ae4c63c04ff req-b5c0c416-f17e-4522-86ae-07b56fc7757b tempest-VolumesSnapshotsTestJSON-1522789859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c3ff6808-d8b7-4b9c-99f6-14a4265e45da {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:24:06 devstack sudo[96245]: pam_unix(sudo:session): session closed for user root Sep 15 16:24:06 devstack sudo[96257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c3ff6808-d8b7-4b9c-99f6-14a4265e45da Sep 15 16:24:06 devstack sudo[96257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:24:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-21d9e2ef-2cbe-4066-81ea-db47d1d685b7 tempest-TestInstancesWithCinderVolumes-1798748222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0cb20200-0fac-4e67-bda7-6116728683e5_h9_75fikdevstack@QuobyteHD" returned: 0 in 0.528s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:24:06 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-21d9e2ef-2cbe-4066-81ea-db47d1d685b7 tempest-TestInstancesWithCinderVolumes-1798748222 None] Temporary image 0cb20200-0fac-4e67-bda7-6116728683e5 is fetched for user 4899c765a5394087b5edb35fb6d6378e. {{(pid=86082) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 15 16:24:06 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd7c65d7-71b8-4adb-8574-fd33aa75452a]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:24:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-21d9e2ef-2cbe-4066-81ea-db47d1d685b7 tempest-TestInstancesWithCinderVolumes-1798748222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0cb20200-0fac-4e67-bda7-6116728683e5_h9_75fikdevstack@QuobyteHD {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:24:06 devstack sudo[96257]: pam_unix(sudo:session): session closed for user root Sep 15 16:24:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [req-c83b4bd2-7264-424e-8adf-2ae4c63c04ff req-b5c0c416-f17e-4522-86ae-07b56fc7757b tempest-VolumesSnapshotsTestJSON-1522789859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c3ff6808-d8b7-4b9c-99f6-14a4265e45da" returned: 0 in 0.522s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:24:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [req-c83b4bd2-7264-424e-8adf-2ae4c63c04ff req-b5c0c416-f17e-4522-86ae-07b56fc7757b tempest-VolumesSnapshotsTestJSON-1522789859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c3ff6808-d8b7-4b9c-99f6-14a4265e45da.e051d8b9-6b68-4a33-8041-5f445a71079a {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:24:07 devstack sudo[96269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0cb20200-0fac-4e67-bda7-6116728683e5_h9_75fikdevstack@QuobyteHD Sep 15 16:24:07 devstack sudo[96269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:24:07 devstack sudo[96274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c3ff6808-d8b7-4b9c-99f6-14a4265e45da.e051d8b9-6b68-4a33-8041-5f445a71079a Sep 15 16:24:07 devstack sudo[96274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:24:07 devstack sudo[96269]: pam_unix(sudo:session): session closed for user root Sep 15 16:24:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-21d9e2ef-2cbe-4066-81ea-db47d1d685b7 tempest-TestInstancesWithCinderVolumes-1798748222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0cb20200-0fac-4e67-bda7-6116728683e5_h9_75fikdevstack@QuobyteHD" returned: 0 in 0.391s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:24:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-21d9e2ef-2cbe-4066-81ea-db47d1d685b7 tempest-TestInstancesWithCinderVolumes-1798748222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:24:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-21d9e2ef-2cbe-4066-81ea-db47d1d685b7 tempest-TestInstancesWithCinderVolumes-1798748222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:24:07 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-21d9e2ef-2cbe-4066-81ea-db47d1d685b7 tempest-TestInstancesWithCinderVolumes-1798748222 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:24:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-212197783',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2510a23-d973-45ae-91fa-e844869e3e69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f23d7dcf47c04cd38f24c4049b1921c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:24:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:24:01Z,use_quota=True,user_id='4899c765a5394087b5edb35fb6d6378e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2377ed71-882a-4208-806e-8c1644e143d8),volume_type_id=2377ed71-882a-4208-806e-8c1644e143d8)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:24:07 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-21d9e2ef-2cbe-4066-81ea-db47d1d685b7 tempest-TestInstancesWithCinderVolumes-1798748222 None] Creating volume f2510a23-d973-45ae-91fa-e844869e3e69 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:24:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-21d9e2ef-2cbe-4066-81ea-db47d1d685b7 tempest-TestInstancesWithCinderVolumes-1798748222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:24:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-21d9e2ef-2cbe-4066-81ea-db47d1d685b7 tempest-TestInstancesWithCinderVolumes-1798748222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:24:07 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-21d9e2ef-2cbe-4066-81ea-db47d1d685b7 tempest-TestInstancesWithCinderVolumes-1798748222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:24:07 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-21d9e2ef-2cbe-4066-81ea-db47d1d685b7 tempest-TestInstancesWithCinderVolumes-1798748222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:24:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-21d9e2ef-2cbe-4066-81ea-db47d1d685b7 tempest-TestInstancesWithCinderVolumes-1798748222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:24:07 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-21d9e2ef-2cbe-4066-81ea-db47d1d685b7 tempest-TestInstancesWithCinderVolumes-1798748222 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:24:07 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-21d9e2ef-2cbe-4066-81ea-db47d1d685b7 tempest-TestInstancesWithCinderVolumes-1798748222 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:24:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-21d9e2ef-2cbe-4066-81ea-db47d1d685b7 tempest-TestInstancesWithCinderVolumes-1798748222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-f2510a23-d973-45ae-91fa-e844869e3e69 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:24:07 devstack sudo[96283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-f2510a23-d973-45ae-91fa-e844869e3e69 1073741824 Sep 15 16:24:07 devstack sudo[96283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:24:07 devstack sudo[96274]: pam_unix(sudo:session): session closed for user root Sep 15 16:24:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [req-c83b4bd2-7264-424e-8adf-2ae4c63c04ff req-b5c0c416-f17e-4522-86ae-07b56fc7757b tempest-VolumesSnapshotsTestJSON-1522789859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c3ff6808-d8b7-4b9c-99f6-14a4265e45da.e051d8b9-6b68-4a33-8041-5f445a71079a" returned: 0 in 0.518s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:24:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [req-c83b4bd2-7264-424e-8adf-2ae4c63c04ff req-b5c0c416-f17e-4522-86ae-07b56fc7757b tempest-VolumesSnapshotsTestJSON-1522789859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c3ff6808-d8b7-4b9c-99f6-14a4265e45da.e051d8b9-6b68-4a33-8041-5f445a71079a {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:24:07 devstack sudo[96287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c3ff6808-d8b7-4b9c-99f6-14a4265e45da.e051d8b9-6b68-4a33-8041-5f445a71079a Sep 15 16:24:07 devstack sudo[96287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:24:07 devstack sudo[96287]: pam_unix(sudo:session): session closed for user root Sep 15 16:24:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [req-c83b4bd2-7264-424e-8adf-2ae4c63c04ff req-b5c0c416-f17e-4522-86ae-07b56fc7757b tempest-VolumesSnapshotsTestJSON-1522789859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c3ff6808-d8b7-4b9c-99f6-14a4265e45da.e051d8b9-6b68-4a33-8041-5f445a71079a" returned: 0 in 0.327s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:24:07 devstack cinder-volume[86082]: DEBUG cinder.coordination [req-c83b4bd2-7264-424e-8adf-2ae4c63c04ff req-b5c0c416-f17e-4522-86ae-07b56fc7757b tempest-VolumesSnapshotsTestJSON-1522789859 None] Lock "cinder-quobyte-e051d8b9-6b68-4a33-8041-5f445a71079a" released by "_delete_snapshot" :: held 2.231s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:24:07 devstack cinder-volume[86082]: DEBUG cinder.coordination [req-c83b4bd2-7264-424e-8adf-2ae4c63c04ff req-b5c0c416-f17e-4522-86ae-07b56fc7757b tempest-VolumesSnapshotsTestJSON-1522789859 None] Lock "cinder-quobyte-c3ff6808-d8b7-4b9c-99f6-14a4265e45da" released by "delete_snapshot" :: held 2.268s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:24:07 devstack sudo[96283]: pam_unix(sudo:session): session closed for user root Sep 15 16:24:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-21d9e2ef-2cbe-4066-81ea-db47d1d685b7 tempest-TestInstancesWithCinderVolumes-1798748222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-f2510a23-d973-45ae-91fa-e844869e3e69 1073741824" returned: 0 in 0.680s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:24:07 devstack cinder-volume[86082]: DEBUG cinder.quota [req-c83b4bd2-7264-424e-8adf-2ae4c63c04ff req-b5c0c416-f17e-4522-86ae-07b56fc7757b tempest-VolumesSnapshotsTestJSON-1522789859 None] Created reservations ['0cf98e79-b7ff-4a1c-9d54-c1ef5466e3d5', '87f908e5-a1d9-4339-897f-cbe2ede3366e', 'f7df53b9-ac94-4861-b288-3961ad1f8f3e', '7a749652-4cce-40f2-8773-7159c54dcf5b'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:24:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-21d9e2ef-2cbe-4066-81ea-db47d1d685b7 tempest-TestInstancesWithCinderVolumes-1798748222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-f2510a23-d973-45ae-91fa-e844869e3e69 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:24:08 devstack sudo[96295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-f2510a23-d973-45ae-91fa-e844869e3e69 Sep 15 16:24:08 devstack sudo[96295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:24:08 devstack cinder-volume[86082]: INFO cinder.volume.manager [req-c83b4bd2-7264-424e-8adf-2ae4c63c04ff req-b5c0c416-f17e-4522-86ae-07b56fc7757b tempest-VolumesSnapshotsTestJSON-1522789859 None] Delete snapshot completed successfully. Sep 15 16:24:08 devstack cinder-volume[86082]: DEBUG cinder.coordination [req-c83b4bd2-7264-424e-8adf-2ae4c63c04ff req-b5c0c416-f17e-4522-86ae-07b56fc7757b tempest-VolumesSnapshotsTestJSON-1522789859 None] Lock "cinder-e051d8b9-6b68-4a33-8041-5f445a71079a-delete_snapshot" released by "delete_snapshot" :: held 2.514s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:24:08 devstack sudo[96295]: pam_unix(sudo:session): session closed for user root Sep 15 16:24:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-21d9e2ef-2cbe-4066-81ea-db47d1d685b7 tempest-TestInstancesWithCinderVolumes-1798748222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-f2510a23-d973-45ae-91fa-e844869e3e69" returned: 0 in 0.330s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:24:08 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-21d9e2ef-2cbe-4066-81ea-db47d1d685b7 tempest-TestInstancesWithCinderVolumes-1798748222 None] <== create_volume: return (1074ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:24:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-21d9e2ef-2cbe-4066-81ea-db47d1d685b7 tempest-TestInstancesWithCinderVolumes-1798748222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.082s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:24:08 devstack cinder-volume[86082]: DEBUG cinder.volume.volume_utils [None req-21d9e2ef-2cbe-4066-81ea-db47d1d685b7 tempest-TestInstancesWithCinderVolumes-1798748222 None] Attempting download of 0cb20200-0fac-4e67-bda7-6116728683e5 ((None, [{'url': 'file:///opt/stack/data/glance/images/0cb20200-0fac-4e67-bda7-6116728683e5', 'metadata': {}}])) to volume f2510a23-d973-45ae-91fa-e844869e3e69. {{(pid=86082) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 15 16:24:08 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc3ede01-9867-4773-9247-208cf30bb90f]: (4, 'raw') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:24:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-21d9e2ef-2cbe-4066-81ea-db47d1d685b7 tempest-TestInstancesWithCinderVolumes-1798748222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0cb20200-0fac-4e67-bda7-6116728683e5_6n_6_1jn {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:24:08 devstack sudo[96298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0cb20200-0fac-4e67-bda7-6116728683e5_6n_6_1jn Sep 15 16:24:08 devstack sudo[96298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:24:08 devstack sudo[96298]: pam_unix(sudo:session): session closed for user root Sep 15 16:24:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-21d9e2ef-2cbe-4066-81ea-db47d1d685b7 tempest-TestInstancesWithCinderVolumes-1798748222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0cb20200-0fac-4e67-bda7-6116728683e5_6n_6_1jn" returned: 0 in 0.456s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:24:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-21d9e2ef-2cbe-4066-81ea-db47d1d685b7 tempest-TestInstancesWithCinderVolumes-1798748222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0cb20200-0fac-4e67-bda7-6116728683e5_6n_6_1jn {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:24:09 devstack cinder-volume[86082]: DEBUG cinder.coordination [req-7b1a26db-84c9-453c-a180-8fc0894db61a req-2afe41a7-56cf-4178-bb41-d4a7c5347575 tempest-VolumesSnapshotsTestJSON-1522789859 None] Acquiring lock "cinder-c3ff6808-d8b7-4b9c-99f6-14a4265e45da-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:24:09 devstack cinder-volume[86082]: DEBUG cinder.coordination [req-7b1a26db-84c9-453c-a180-8fc0894db61a req-2afe41a7-56cf-4178-bb41-d4a7c5347575 tempest-VolumesSnapshotsTestJSON-1522789859 None] Lock "cinder-c3ff6808-d8b7-4b9c-99f6-14a4265e45da-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:24:09 devstack sudo[96302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0cb20200-0fac-4e67-bda7-6116728683e5_6n_6_1jn Sep 15 16:24:09 devstack sudo[96302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:24:09 devstack cinder-volume[86082]: DEBUG cinder.coordination [req-7b1a26db-84c9-453c-a180-8fc0894db61a req-2afe41a7-56cf-4178-bb41-d4a7c5347575 tempest-VolumesSnapshotsTestJSON-1522789859 None] Acquiring lock "cinder-quobyte-c3ff6808-d8b7-4b9c-99f6-14a4265e45da" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:24:09 devstack cinder-volume[86082]: DEBUG cinder.coordination [req-7b1a26db-84c9-453c-a180-8fc0894db61a req-2afe41a7-56cf-4178-bb41-d4a7c5347575 tempest-VolumesSnapshotsTestJSON-1522789859 None] Lock "cinder-quobyte-c3ff6808-d8b7-4b9c-99f6-14a4265e45da" acquired by "delete_volume" :: waited 0.017s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:24:09 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e9b8b10-ec61-4c24-9974-943cfe236d43]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:24:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [req-7b1a26db-84c9-453c-a180-8fc0894db61a req-2afe41a7-56cf-4178-bb41-d4a7c5347575 tempest-VolumesSnapshotsTestJSON-1522789859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c3ff6808-d8b7-4b9c-99f6-14a4265e45da {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:24:09 devstack sudo[96310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c3ff6808-d8b7-4b9c-99f6-14a4265e45da Sep 15 16:24:09 devstack sudo[96310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:24:09 devstack sudo[96302]: pam_unix(sudo:session): session closed for user root Sep 15 16:24:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-21d9e2ef-2cbe-4066-81ea-db47d1d685b7 tempest-TestInstancesWithCinderVolumes-1798748222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0cb20200-0fac-4e67-bda7-6116728683e5_6n_6_1jn" returned: 1 in 0.594s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:24:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-21d9e2ef-2cbe-4066-81ea-db47d1d685b7 tempest-TestInstancesWithCinderVolumes-1798748222 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0cb20200-0fac-4e67-bda7-6116728683e5_6n_6_1jn' failed. Not Retrying. {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 15 16:24:09 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[afbe9612-24b0-4731-a0fd-189eafcbe61c]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:24:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-21d9e2ef-2cbe-4066-81ea-db47d1d685b7 tempest-TestInstancesWithCinderVolumes-1798748222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0cb20200-0fac-4e67-bda7-6116728683e5_h9_75fikdevstack@QuobyteHD {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:24:09 devstack sudo[96318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0cb20200-0fac-4e67-bda7-6116728683e5_h9_75fikdevstack@QuobyteHD Sep 15 16:24:09 devstack sudo[96318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:24:09 devstack sudo[96310]: pam_unix(sudo:session): session closed for user root Sep 15 16:24:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [req-7b1a26db-84c9-453c-a180-8fc0894db61a req-2afe41a7-56cf-4178-bb41-d4a7c5347575 tempest-VolumesSnapshotsTestJSON-1522789859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c3ff6808-d8b7-4b9c-99f6-14a4265e45da" returned: 0 in 0.510s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:24:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [req-7b1a26db-84c9-453c-a180-8fc0894db61a req-2afe41a7-56cf-4178-bb41-d4a7c5347575 tempest-VolumesSnapshotsTestJSON-1522789859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c3ff6808-d8b7-4b9c-99f6-14a4265e45da {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:24:09 devstack sudo[96327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c3ff6808-d8b7-4b9c-99f6-14a4265e45da Sep 15 16:24:09 devstack sudo[96327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:24:10 devstack sudo[96318]: pam_unix(sudo:session): session closed for user root Sep 15 16:24:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-21d9e2ef-2cbe-4066-81ea-db47d1d685b7 tempest-TestInstancesWithCinderVolumes-1798748222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0cb20200-0fac-4e67-bda7-6116728683e5_h9_75fikdevstack@QuobyteHD" returned: 0 in 0.489s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:24:10 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-21d9e2ef-2cbe-4066-81ea-db47d1d685b7 tempest-TestInstancesWithCinderVolumes-1798748222 None] 0cb20200-0fac-4e67-bda7-6116728683e5 was qcow2, converting to qcow2 {{(pid=86082) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 15 16:24:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-21d9e2ef-2cbe-4066-81ea-db47d1d685b7 tempest-TestInstancesWithCinderVolumes-1798748222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0cb20200-0fac-4e67-bda7-6116728683e5_h9_75fikdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-f2510a23-d973-45ae-91fa-e844869e3e69 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:24:10 devstack sudo[96335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0cb20200-0fac-4e67-bda7-6116728683e5_h9_75fikdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-f2510a23-d973-45ae-91fa-e844869e3e69 Sep 15 16:24:10 devstack sudo[96335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:24:10 devstack sudo[96327]: pam_unix(sudo:session): session closed for user root Sep 15 16:24:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [req-7b1a26db-84c9-453c-a180-8fc0894db61a req-2afe41a7-56cf-4178-bb41-d4a7c5347575 tempest-VolumesSnapshotsTestJSON-1522789859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c3ff6808-d8b7-4b9c-99f6-14a4265e45da" returned: 0 in 0.354s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:24:10 devstack cinder-volume[86082]: DEBUG cinder.coordination [req-7b1a26db-84c9-453c-a180-8fc0894db61a req-2afe41a7-56cf-4178-bb41-d4a7c5347575 tempest-VolumesSnapshotsTestJSON-1522789859 None] Lock "cinder-quobyte-c3ff6808-d8b7-4b9c-99f6-14a4265e45da" released by "delete_volume" :: held 0.998s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:24:10 devstack cinder-volume[86082]: DEBUG cinder.quota [req-7b1a26db-84c9-453c-a180-8fc0894db61a req-2afe41a7-56cf-4178-bb41-d4a7c5347575 tempest-VolumesSnapshotsTestJSON-1522789859 None] Created reservations ['ab946045-2864-44b1-b7d6-7c0340a98360', '385c1da1-c7e1-41b7-99b6-647adbeff221', '0bf126c6-adc3-4f22-9861-ec69b7f6be69', 'c7ebe62c-8231-485e-a17e-011c58437ce7'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:24:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-7b1a26db-84c9-453c-a180-8fc0894db61a req-2afe41a7-56cf-4178-bb41-d4a7c5347575 tempest-VolumesSnapshotsTestJSON-1522789859 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:24:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-7b1a26db-84c9-453c-a180-8fc0894db61a req-2afe41a7-56cf-4178-bb41-d4a7c5347575 tempest-VolumesSnapshotsTestJSON-1522789859 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:24:10 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [req-7b1a26db-84c9-453c-a180-8fc0894db61a req-2afe41a7-56cf-4178-bb41-d4a7c5347575 tempest-VolumesSnapshotsTestJSON-1522789859 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:24:10 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [req-7b1a26db-84c9-453c-a180-8fc0894db61a req-2afe41a7-56cf-4178-bb41-d4a7c5347575 tempest-VolumesSnapshotsTestJSON-1522789859 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:24:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-7b1a26db-84c9-453c-a180-8fc0894db61a req-2afe41a7-56cf-4178-bb41-d4a7c5347575 tempest-VolumesSnapshotsTestJSON-1522789859 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:24:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [req-7b1a26db-84c9-453c-a180-8fc0894db61a req-2afe41a7-56cf-4178-bb41-d4a7c5347575 tempest-VolumesSnapshotsTestJSON-1522789859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:24:10 devstack sudo[96342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:24:10 devstack sudo[96342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:24:10 devstack sudo[96342]: pam_unix(sudo:session): session closed for user root Sep 15 16:24:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [req-7b1a26db-84c9-453c-a180-8fc0894db61a req-2afe41a7-56cf-4178-bb41-d4a7c5347575 tempest-VolumesSnapshotsTestJSON-1522789859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.319s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:24:10 devstack cinder-volume[86082]: DEBUG cinder.manager [req-7b1a26db-84c9-453c-a180-8fc0894db61a req-2afe41a7-56cf-4178-bb41-d4a7c5347575 tempest-VolumesSnapshotsTestJSON-1522789859 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:24:10 devstack cinder-volume[86082]: INFO cinder.volume.manager [req-7b1a26db-84c9-453c-a180-8fc0894db61a req-2afe41a7-56cf-4178-bb41-d4a7c5347575 tempest-VolumesSnapshotsTestJSON-1522789859 None] Deleted volume successfully. Sep 15 16:24:10 devstack cinder-volume[86082]: DEBUG cinder.coordination [req-7b1a26db-84c9-453c-a180-8fc0894db61a req-2afe41a7-56cf-4178-bb41-d4a7c5347575 tempest-VolumesSnapshotsTestJSON-1522789859 None] Lock "cinder-c3ff6808-d8b7-4b9c-99f6-14a4265e45da-delete_volume" released by "delete_volume" :: held 1.626s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:24:13 devstack sudo[96335]: pam_unix(sudo:session): session closed for user root Sep 15 16:24:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-21d9e2ef-2cbe-4066-81ea-db47d1d685b7 tempest-TestInstancesWithCinderVolumes-1798748222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0cb20200-0fac-4e67-bda7-6116728683e5_h9_75fikdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-f2510a23-d973-45ae-91fa-e844869e3e69" returned: 0 in 3.554s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:24:13 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-21d9e2ef-2cbe-4066-81ea-db47d1d685b7 tempest-TestInstancesWithCinderVolumes-1798748222 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0cb20200-0fac-4e67-bda7-6116728683e5_h9_75fikdevstack@QuobyteHD, size 112.00 MB, duration 3.56 sec, destination /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-f2510a23-d973-45ae-91fa-e844869e3e69 {{(pid=86082) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 15 16:24:13 devstack cinder-volume[86082]: INFO cinder.image.image_utils [None req-21d9e2ef-2cbe-4066-81ea-db47d1d685b7 tempest-TestInstancesWithCinderVolumes-1798748222 None] Converted 112.00 MB image at 31.49 MB/s Sep 15 16:24:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-21d9e2ef-2cbe-4066-81ea-db47d1d685b7 tempest-TestInstancesWithCinderVolumes-1798748222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-f2510a23-d973-45ae-91fa-e844869e3e69 1G {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:24:13 devstack sudo[96450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-f2510a23-d973-45ae-91fa-e844869e3e69 1G Sep 15 16:24:13 devstack sudo[96450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:24:14 devstack sudo[96450]: pam_unix(sudo:session): session closed for user root Sep 15 16:24:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-21d9e2ef-2cbe-4066-81ea-db47d1d685b7 tempest-TestInstancesWithCinderVolumes-1798748222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-f2510a23-d973-45ae-91fa-e844869e3e69 1G" returned: 0 in 0.830s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:24:14 devstack cinder-volume[86082]: DEBUG cinder.volume.volume_utils [None req-21d9e2ef-2cbe-4066-81ea-db47d1d685b7 tempest-TestInstancesWithCinderVolumes-1798748222 None] Downloaded image 0cb20200-0fac-4e67-bda7-6116728683e5 ((None, [{'url': 'file:///opt/stack/data/glance/images/0cb20200-0fac-4e67-bda7-6116728683e5', 'metadata': {}}])) to volume f2510a23-d973-45ae-91fa-e844869e3e69 successfully. {{(pid=86082) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 15 16:24:14 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-21d9e2ef-2cbe-4066-81ea-db47d1d685b7 tempest-TestInstancesWithCinderVolumes-1798748222 None] Temporary image 0cb20200-0fac-4e67-bda7-6116728683e5 for user 4899c765a5394087b5edb35fb6d6378e is deleted. {{(pid=86082) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 15 16:24:14 devstack cinder-volume[86082]: DEBUG cinder.volume.volume_utils [None req-21d9e2ef-2cbe-4066-81ea-db47d1d685b7 tempest-TestInstancesWithCinderVolumes-1798748222 None] Marking volume f2510a23-d973-45ae-91fa-e844869e3e69 as bootable. {{(pid=86082) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 15 16:24:14 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-21d9e2ef-2cbe-4066-81ea-db47d1d685b7 tempest-TestInstancesWithCinderVolumes-1798748222 None] Copying metadata from image 0cb20200-0fac-4e67-bda7-6116728683e5 to f2510a23-d973-45ae-91fa-e844869e3e69. {{(pid=86082) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 15 16:24:14 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-21d9e2ef-2cbe-4066-81ea-db47d1d685b7 tempest-TestInstancesWithCinderVolumes-1798748222 None] Creating volume glance metadata for volume f2510a23-d973-45ae-91fa-e844869e3e69 backed by image 0cb20200-0fac-4e67-bda7-6116728683e5 with: {'image_id': '0cb20200-0fac-4e67-bda7-6116728683e5', 'image_name': 'tempest-scenario-img--1813162065', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86082) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 15 16:24:14 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-21d9e2ef-2cbe-4066-81ea-db47d1d685b7 tempest-TestInstancesWithCinderVolumes-1798748222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc82bb57-bc70-4ce6-81d1-c99c126094b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2510a23-d973-45ae-91fa-e844869e3e69', 'volume_size': 1, 'image_id': '0cb20200-0fac-4e67-bda7-6116728683e5', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0cb20200-0fac-4e67-bda7-6116728683e5', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1813162065', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'f23d7dcf47c04cd38f24c4049b1921c3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0cb20200-0fac-4e67-bda7-6116728683e5', 'created_at': datetime.datetime(2026, 9, 15, 14, 23, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 15, 14, 23, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0cb20200-0fac-4e67-bda7-6116728683e5/file', 'properties': {}}, 'image_service': }' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:24:14 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-21d9e2ef-2cbe-4066-81ea-db47d1d685b7 tempest-TestInstancesWithCinderVolumes-1798748222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ddf5c42-fe55-42c3-9c0a-aaa94a8b76c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:24:14 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-21d9e2ef-2cbe-4066-81ea-db47d1d685b7 tempest-TestInstancesWithCinderVolumes-1798748222 None] Volume volume-f2510a23-d973-45ae-91fa-e844869e3e69 (f2510a23-d973-45ae-91fa-e844869e3e69): created successfully Sep 15 16:24:14 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-21d9e2ef-2cbe-4066-81ea-db47d1d685b7 tempest-TestInstancesWithCinderVolumes-1798748222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2ddf5c42-fe55-42c3-9c0a-aaa94a8b76c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:24:14 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-21d9e2ef-2cbe-4066-81ea-db47d1d685b7 tempest-TestInstancesWithCinderVolumes-1798748222 None] Flow 'volume_create_manager' (3b66c152-08bc-4561-b702-2404f1555b68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:24:14 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-21d9e2ef-2cbe-4066-81ea-db47d1d685b7 tempest-TestInstancesWithCinderVolumes-1798748222 None] Created volume successfully. Sep 15 16:24:20 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [req-050ee826-a824-4f6a-a0c0-f25696070bbb req-76c025a9-dda2-4801-8d19-e42801b7dd12 tempest-VolumesGetTestJSON-747697902 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:24:20 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-050ee826-a824-4f6a-a0c0-f25696070bbb req-76c025a9-dda2-4801-8d19-e42801b7dd12 tempest-VolumesGetTestJSON-747697902 None] Flow 'volume_create_manager' (b93b7c44-1153-4eab-9321-08ac04223873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:24:20 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-050ee826-a824-4f6a-a0c0-f25696070bbb req-76c025a9-dda2-4801-8d19-e42801b7dd12 tempest-VolumesGetTestJSON-747697902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e342b75-99b1-4299-bad2-f0cf31048a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:24:20 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-050ee826-a824-4f6a-a0c0-f25696070bbb req-76c025a9-dda2-4801-8d19-e42801b7dd12 tempest-VolumesGetTestJSON-747697902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e342b75-99b1-4299-bad2-f0cf31048a44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:24:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-524086171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72e7781c-38bb-465d-9a1b-225b92639af6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fb376587a71749879ddd6a45b5941171',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:24:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:24:21Z,use_quota=True,user_id='0e9238f2cbbe43d8ac9f8e094e94af8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:24:20 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-050ee826-a824-4f6a-a0c0-f25696070bbb req-76c025a9-dda2-4801-8d19-e42801b7dd12 tempest-VolumesGetTestJSON-747697902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9581f3ea-e4fd-40e6-a932-2f3b5d6ca5e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:24:20 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-050ee826-a824-4f6a-a0c0-f25696070bbb req-76c025a9-dda2-4801-8d19-e42801b7dd12 tempest-VolumesGetTestJSON-747697902 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9581f3ea-e4fd-40e6-a932-2f3b5d6ca5e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:24:20 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-050ee826-a824-4f6a-a0c0-f25696070bbb req-76c025a9-dda2-4801-8d19-e42801b7dd12 tempest-VolumesGetTestJSON-747697902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cb01bf8-506d-426d-8dbc-c213ab87ee98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:24:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-050ee826-a824-4f6a-a0c0-f25696070bbb req-76c025a9-dda2-4801-8d19-e42801b7dd12 tempest-VolumesGetTestJSON-747697902 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cb01bf8-506d-426d-8dbc-c213ab87ee98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72e7781c-38bb-465d-9a1b-225b92639af6', 'volume_name': 'volume-72e7781c-38bb-465d-9a1b-225b92639af6', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:24:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-050ee826-a824-4f6a-a0c0-f25696070bbb req-76c025a9-dda2-4801-8d19-e42801b7dd12 tempest-VolumesGetTestJSON-747697902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e85c6682-ea0e-4806-91fc-0d671db73c1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:24:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-050ee826-a824-4f6a-a0c0-f25696070bbb req-76c025a9-dda2-4801-8d19-e42801b7dd12 tempest-VolumesGetTestJSON-747697902 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e85c6682-ea0e-4806-91fc-0d671db73c1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:24:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-050ee826-a824-4f6a-a0c0-f25696070bbb req-76c025a9-dda2-4801-8d19-e42801b7dd12 tempest-VolumesGetTestJSON-747697902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (759fc011-3432-4327-a05f-f473051b4026) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:24:21 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [req-050ee826-a824-4f6a-a0c0-f25696070bbb req-76c025a9-dda2-4801-8d19-e42801b7dd12 tempest-VolumesGetTestJSON-747697902 None] Volume 72e7781c-38bb-465d-9a1b-225b92639af6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72e7781c-38bb-465d-9a1b-225b92639af6', 'volume_size': 1} Sep 15 16:24:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-050ee826-a824-4f6a-a0c0-f25696070bbb req-76c025a9-dda2-4801-8d19-e42801b7dd12 tempest-VolumesGetTestJSON-747697902 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:24:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-050ee826-a824-4f6a-a0c0-f25696070bbb req-76c025a9-dda2-4801-8d19-e42801b7dd12 tempest-VolumesGetTestJSON-747697902 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:24:21 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [req-050ee826-a824-4f6a-a0c0-f25696070bbb req-76c025a9-dda2-4801-8d19-e42801b7dd12 tempest-VolumesGetTestJSON-747697902 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:24:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-524086171',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72e7781c-38bb-465d-9a1b-225b92639af6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fb376587a71749879ddd6a45b5941171',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:24:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:24:21Z,use_quota=True,user_id='0e9238f2cbbe43d8ac9f8e094e94af8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:24:21 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [req-050ee826-a824-4f6a-a0c0-f25696070bbb req-76c025a9-dda2-4801-8d19-e42801b7dd12 tempest-VolumesGetTestJSON-747697902 None] Creating volume 72e7781c-38bb-465d-9a1b-225b92639af6 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:24:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-050ee826-a824-4f6a-a0c0-f25696070bbb req-76c025a9-dda2-4801-8d19-e42801b7dd12 tempest-VolumesGetTestJSON-747697902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:24:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-050ee826-a824-4f6a-a0c0-f25696070bbb req-76c025a9-dda2-4801-8d19-e42801b7dd12 tempest-VolumesGetTestJSON-747697902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:24:21 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [req-050ee826-a824-4f6a-a0c0-f25696070bbb req-76c025a9-dda2-4801-8d19-e42801b7dd12 tempest-VolumesGetTestJSON-747697902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:24:21 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [req-050ee826-a824-4f6a-a0c0-f25696070bbb req-76c025a9-dda2-4801-8d19-e42801b7dd12 tempest-VolumesGetTestJSON-747697902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:24:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-050ee826-a824-4f6a-a0c0-f25696070bbb req-76c025a9-dda2-4801-8d19-e42801b7dd12 tempest-VolumesGetTestJSON-747697902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:24:21 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [req-050ee826-a824-4f6a-a0c0-f25696070bbb req-76c025a9-dda2-4801-8d19-e42801b7dd12 tempest-VolumesGetTestJSON-747697902 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:24:21 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [req-050ee826-a824-4f6a-a0c0-f25696070bbb req-76c025a9-dda2-4801-8d19-e42801b7dd12 tempest-VolumesGetTestJSON-747697902 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:24:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [req-050ee826-a824-4f6a-a0c0-f25696070bbb req-76c025a9-dda2-4801-8d19-e42801b7dd12 tempest-VolumesGetTestJSON-747697902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-72e7781c-38bb-465d-9a1b-225b92639af6 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:24:21 devstack sudo[96544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-72e7781c-38bb-465d-9a1b-225b92639af6 1073741824 Sep 15 16:24:21 devstack sudo[96544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:24:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-dbfe558c-200b-407e-b991-bb4c72b82280 req-382b08a3-2f36-4b64-907f-f5a4fb26d775 tempest-TestInstancesWithCinderVolumes-1798748222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:24:22 devstack sudo[96544]: pam_unix(sudo:session): session closed for user root Sep 15 16:24:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [req-050ee826-a824-4f6a-a0c0-f25696070bbb req-76c025a9-dda2-4801-8d19-e42801b7dd12 tempest-VolumesGetTestJSON-747697902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-72e7781c-38bb-465d-9a1b-225b92639af6 1073741824" returned: 0 in 1.012s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:24:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [req-050ee826-a824-4f6a-a0c0-f25696070bbb req-76c025a9-dda2-4801-8d19-e42801b7dd12 tempest-VolumesGetTestJSON-747697902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-72e7781c-38bb-465d-9a1b-225b92639af6 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:24:22 devstack sudo[96557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-72e7781c-38bb-465d-9a1b-225b92639af6 Sep 15 16:24:22 devstack sudo[96557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:24:22 devstack sudo[96557]: pam_unix(sudo:session): session closed for user root Sep 15 16:24:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [req-050ee826-a824-4f6a-a0c0-f25696070bbb req-76c025a9-dda2-4801-8d19-e42801b7dd12 tempest-VolumesGetTestJSON-747697902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-72e7781c-38bb-465d-9a1b-225b92639af6" returned: 0 in 0.438s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:24:22 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [req-050ee826-a824-4f6a-a0c0-f25696070bbb req-76c025a9-dda2-4801-8d19-e42801b7dd12 tempest-VolumesGetTestJSON-747697902 None] <== create_volume: return (1538ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:24:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-050ee826-a824-4f6a-a0c0-f25696070bbb req-76c025a9-dda2-4801-8d19-e42801b7dd12 tempest-VolumesGetTestJSON-747697902 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.547s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:24:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-dbfe558c-200b-407e-b991-bb4c72b82280 req-382b08a3-2f36-4b64-907f-f5a4fb26d775 tempest-TestInstancesWithCinderVolumes-1798748222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.601s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:24:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-dbfe558c-200b-407e-b991-bb4c72b82280 req-382b08a3-2f36-4b64-907f-f5a4fb26d775 tempest-TestInstancesWithCinderVolumes-1798748222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.035s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:24:22 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-050ee826-a824-4f6a-a0c0-f25696070bbb req-76c025a9-dda2-4801-8d19-e42801b7dd12 tempest-VolumesGetTestJSON-747697902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (759fc011-3432-4327-a05f-f473051b4026) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72e7781c-38bb-465d-9a1b-225b92639af6', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:24:22 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-050ee826-a824-4f6a-a0c0-f25696070bbb req-76c025a9-dda2-4801-8d19-e42801b7dd12 tempest-VolumesGetTestJSON-747697902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc136f95-3d3f-4e54-b0f3-178c40b8fd19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:24:22 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [req-050ee826-a824-4f6a-a0c0-f25696070bbb req-76c025a9-dda2-4801-8d19-e42801b7dd12 tempest-VolumesGetTestJSON-747697902 None] Volume volume-72e7781c-38bb-465d-9a1b-225b92639af6 (72e7781c-38bb-465d-9a1b-225b92639af6): created successfully Sep 15 16:24:22 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-050ee826-a824-4f6a-a0c0-f25696070bbb req-76c025a9-dda2-4801-8d19-e42801b7dd12 tempest-VolumesGetTestJSON-747697902 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc136f95-3d3f-4e54-b0f3-178c40b8fd19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:24:22 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-050ee826-a824-4f6a-a0c0-f25696070bbb req-76c025a9-dda2-4801-8d19-e42801b7dd12 tempest-VolumesGetTestJSON-747697902 None] Flow 'volume_create_manager' (b93b7c44-1153-4eab-9321-08ac04223873) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:24:22 devstack cinder-volume[86082]: INFO cinder.volume.manager [req-050ee826-a824-4f6a-a0c0-f25696070bbb req-76c025a9-dda2-4801-8d19-e42801b7dd12 tempest-VolumesGetTestJSON-747697902 None] Created volume successfully. Sep 15 16:24:22 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-dbfe558c-200b-407e-b991-bb4c72b82280 req-382b08a3-2f36-4b64-907f-f5a4fb26d775 tempest-TestInstancesWithCinderVolumes-1798748222 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a', 'name': 'volume-f2510a23-d973-45ae-91fa-e844869e3e69', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a00dc9a7-41dc-4bc5-bb9f-0e151d29c5be', 'enforce_multipath': True} {{(pid=86082) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 15 16:24:22 devstack cinder-volume[86082]: INFO cinder.volume.manager [req-dbfe558c-200b-407e-b991-bb4c72b82280 req-382b08a3-2f36-4b64-907f-f5a4fb26d775 tempest-TestInstancesWithCinderVolumes-1798748222 None] attachment_update completed successfully. Sep 15 16:24:23 devstack cinder-volume[86082]: DEBUG cinder.coordination [req-5de4f349-ab3d-4210-b689-3fb76128d3f2 req-dc25a080-516d-47d8-84db-6a7b2a23901a tempest-VolumesGetTestJSON-747697902 None] Acquiring lock "cinder-72e7781c-38bb-465d-9a1b-225b92639af6-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:24:23 devstack cinder-volume[86082]: DEBUG cinder.coordination [req-5de4f349-ab3d-4210-b689-3fb76128d3f2 req-dc25a080-516d-47d8-84db-6a7b2a23901a tempest-VolumesGetTestJSON-747697902 None] Lock "cinder-72e7781c-38bb-465d-9a1b-225b92639af6-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:24:23 devstack cinder-volume[86082]: DEBUG cinder.coordination [req-5de4f349-ab3d-4210-b689-3fb76128d3f2 req-dc25a080-516d-47d8-84db-6a7b2a23901a tempest-VolumesGetTestJSON-747697902 None] Acquiring lock "cinder-quobyte-72e7781c-38bb-465d-9a1b-225b92639af6" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:24:23 devstack cinder-volume[86082]: DEBUG cinder.coordination [req-5de4f349-ab3d-4210-b689-3fb76128d3f2 req-dc25a080-516d-47d8-84db-6a7b2a23901a tempest-VolumesGetTestJSON-747697902 None] Lock "cinder-quobyte-72e7781c-38bb-465d-9a1b-225b92639af6" acquired by "delete_volume" :: waited 0.022s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:24:23 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bf0eaa6-c9df-4b36-ba4c-66a622a780a4]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:24:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [req-5de4f349-ab3d-4210-b689-3fb76128d3f2 req-dc25a080-516d-47d8-84db-6a7b2a23901a tempest-VolumesGetTestJSON-747697902 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-72e7781c-38bb-465d-9a1b-225b92639af6 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:24:24 devstack sudo[96562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-72e7781c-38bb-465d-9a1b-225b92639af6 Sep 15 16:24:24 devstack sudo[96562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:24:24 devstack sudo[96562]: pam_unix(sudo:session): session closed for user root Sep 15 16:24:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [req-5de4f349-ab3d-4210-b689-3fb76128d3f2 req-dc25a080-516d-47d8-84db-6a7b2a23901a tempest-VolumesGetTestJSON-747697902 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-72e7781c-38bb-465d-9a1b-225b92639af6" returned: 0 in 0.623s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:24:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [req-5de4f349-ab3d-4210-b689-3fb76128d3f2 req-dc25a080-516d-47d8-84db-6a7b2a23901a tempest-VolumesGetTestJSON-747697902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-72e7781c-38bb-465d-9a1b-225b92639af6 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:24:24 devstack sudo[96567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-72e7781c-38bb-465d-9a1b-225b92639af6 Sep 15 16:24:24 devstack sudo[96567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:24:25 devstack sudo[96567]: pam_unix(sudo:session): session closed for user root Sep 15 16:24:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [req-5de4f349-ab3d-4210-b689-3fb76128d3f2 req-dc25a080-516d-47d8-84db-6a7b2a23901a tempest-VolumesGetTestJSON-747697902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-72e7781c-38bb-465d-9a1b-225b92639af6" returned: 0 in 0.536s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:24:25 devstack cinder-volume[86082]: DEBUG cinder.coordination [req-5de4f349-ab3d-4210-b689-3fb76128d3f2 req-dc25a080-516d-47d8-84db-6a7b2a23901a tempest-VolumesGetTestJSON-747697902 None] Lock "cinder-quobyte-72e7781c-38bb-465d-9a1b-225b92639af6" released by "delete_volume" :: held 1.219s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:24:25 devstack cinder-volume[86082]: DEBUG cinder.quota [req-5de4f349-ab3d-4210-b689-3fb76128d3f2 req-dc25a080-516d-47d8-84db-6a7b2a23901a tempest-VolumesGetTestJSON-747697902 None] Created reservations ['430aefd7-8349-49d3-a546-e896d28035a6', 'd621ba60-7ec5-4045-9f4b-92bb2db03355', '00eef96e-b779-4955-a99d-a6ce7d0ead83', 'a0f442cd-9de6-4402-ad19-6ebd6768532f'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:24:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-5de4f349-ab3d-4210-b689-3fb76128d3f2 req-dc25a080-516d-47d8-84db-6a7b2a23901a tempest-VolumesGetTestJSON-747697902 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:24:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-5de4f349-ab3d-4210-b689-3fb76128d3f2 req-dc25a080-516d-47d8-84db-6a7b2a23901a tempest-VolumesGetTestJSON-747697902 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:24:25 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [req-5de4f349-ab3d-4210-b689-3fb76128d3f2 req-dc25a080-516d-47d8-84db-6a7b2a23901a tempest-VolumesGetTestJSON-747697902 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:24:25 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [req-5de4f349-ab3d-4210-b689-3fb76128d3f2 req-dc25a080-516d-47d8-84db-6a7b2a23901a tempest-VolumesGetTestJSON-747697902 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:24:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-5de4f349-ab3d-4210-b689-3fb76128d3f2 req-dc25a080-516d-47d8-84db-6a7b2a23901a tempest-VolumesGetTestJSON-747697902 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:24:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [req-5de4f349-ab3d-4210-b689-3fb76128d3f2 req-dc25a080-516d-47d8-84db-6a7b2a23901a tempest-VolumesGetTestJSON-747697902 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:24:25 devstack sudo[96571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:24:25 devstack sudo[96571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:24:25 devstack sudo[96571]: pam_unix(sudo:session): session closed for user root Sep 15 16:24:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [req-5de4f349-ab3d-4210-b689-3fb76128d3f2 req-dc25a080-516d-47d8-84db-6a7b2a23901a tempest-VolumesGetTestJSON-747697902 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.377s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:24:25 devstack cinder-volume[86082]: DEBUG cinder.manager [req-5de4f349-ab3d-4210-b689-3fb76128d3f2 req-dc25a080-516d-47d8-84db-6a7b2a23901a tempest-VolumesGetTestJSON-747697902 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:24:25 devstack cinder-volume[86082]: INFO cinder.volume.manager [req-5de4f349-ab3d-4210-b689-3fb76128d3f2 req-dc25a080-516d-47d8-84db-6a7b2a23901a tempest-VolumesGetTestJSON-747697902 None] Deleted volume successfully. Sep 15 16:24:25 devstack cinder-volume[86082]: DEBUG cinder.coordination [req-5de4f349-ab3d-4210-b689-3fb76128d3f2 req-dc25a080-516d-47d8-84db-6a7b2a23901a tempest-VolumesGetTestJSON-747697902 None] Lock "cinder-72e7781c-38bb-465d-9a1b-225b92639af6-delete_volume" released by "delete_volume" :: held 1.932s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:24:34 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-18733f81-c4de-4ceb-a467-4efab67fd0dc tempest-VolumesNegativeTest-1626062929 None] Acquiring lock "cinder-9fc2bff1-5cb7-4281-aff1-5a6168ffe82f-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:24:34 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-18733f81-c4de-4ceb-a467-4efab67fd0dc tempest-VolumesNegativeTest-1626062929 None] Lock "cinder-9fc2bff1-5cb7-4281-aff1-5a6168ffe82f-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:24:35 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-18733f81-c4de-4ceb-a467-4efab67fd0dc tempest-VolumesNegativeTest-1626062929 None] Acquiring lock "cinder-quobyte-9fc2bff1-5cb7-4281-aff1-5a6168ffe82f" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:24:35 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-18733f81-c4de-4ceb-a467-4efab67fd0dc tempest-VolumesNegativeTest-1626062929 None] Lock "cinder-quobyte-9fc2bff1-5cb7-4281-aff1-5a6168ffe82f" acquired by "delete_volume" :: waited 0.030s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:24:35 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c75801a-7335-4f06-a970-dfb443f9b0cb]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:24:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-18733f81-c4de-4ceb-a467-4efab67fd0dc tempest-VolumesNegativeTest-1626062929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-9fc2bff1-5cb7-4281-aff1-5a6168ffe82f {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:24:35 devstack sudo[97096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-9fc2bff1-5cb7-4281-aff1-5a6168ffe82f Sep 15 16:24:35 devstack sudo[97096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:24:35 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:SELECT=74,cinder:UPDATE=61,cinder:INSERT=25,cinder:DELETE=7 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 16:24:36 devstack sudo[97096]: pam_unix(sudo:session): session closed for user root Sep 15 16:24:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-18733f81-c4de-4ceb-a467-4efab67fd0dc tempest-VolumesNegativeTest-1626062929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-9fc2bff1-5cb7-4281-aff1-5a6168ffe82f" returned: 0 in 0.947s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:24:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-18733f81-c4de-4ceb-a467-4efab67fd0dc tempest-VolumesNegativeTest-1626062929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-9fc2bff1-5cb7-4281-aff1-5a6168ffe82f {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:24:36 devstack sudo[97101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-9fc2bff1-5cb7-4281-aff1-5a6168ffe82f Sep 15 16:24:36 devstack sudo[97101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:24:36 devstack sudo[97101]: pam_unix(sudo:session): session closed for user root Sep 15 16:24:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-18733f81-c4de-4ceb-a467-4efab67fd0dc tempest-VolumesNegativeTest-1626062929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-9fc2bff1-5cb7-4281-aff1-5a6168ffe82f" returned: 0 in 0.482s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:24:36 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-18733f81-c4de-4ceb-a467-4efab67fd0dc tempest-VolumesNegativeTest-1626062929 None] Lock "cinder-quobyte-9fc2bff1-5cb7-4281-aff1-5a6168ffe82f" released by "delete_volume" :: held 1.534s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:24:36 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-18733f81-c4de-4ceb-a467-4efab67fd0dc tempest-VolumesNegativeTest-1626062929 None] Created reservations ['967ffe85-4a78-47bf-9155-036993e28e03', 'defd8763-44f5-4c37-b294-e2aadcbcc881', '00ec3287-fd73-4e06-b9ad-d9441bea29fb', '4c5a2aad-40cb-4f5e-b553-23488d768c31'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:24:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-18733f81-c4de-4ceb-a467-4efab67fd0dc tempest-VolumesNegativeTest-1626062929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:24:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-18733f81-c4de-4ceb-a467-4efab67fd0dc tempest-VolumesNegativeTest-1626062929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:24:36 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-18733f81-c4de-4ceb-a467-4efab67fd0dc tempest-VolumesNegativeTest-1626062929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:24:36 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-18733f81-c4de-4ceb-a467-4efab67fd0dc tempest-VolumesNegativeTest-1626062929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:24:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-18733f81-c4de-4ceb-a467-4efab67fd0dc tempest-VolumesNegativeTest-1626062929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:24:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-18733f81-c4de-4ceb-a467-4efab67fd0dc tempest-VolumesNegativeTest-1626062929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:24:36 devstack sudo[97107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:24:36 devstack sudo[97107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:24:37 devstack sudo[97107]: pam_unix(sudo:session): session closed for user root Sep 15 16:24:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-18733f81-c4de-4ceb-a467-4efab67fd0dc tempest-VolumesNegativeTest-1626062929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.575s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:24:37 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-18733f81-c4de-4ceb-a467-4efab67fd0dc tempest-VolumesNegativeTest-1626062929 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:24:37 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-18733f81-c4de-4ceb-a467-4efab67fd0dc tempest-VolumesNegativeTest-1626062929 None] Deleted volume successfully. Sep 15 16:24:37 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-18733f81-c4de-4ceb-a467-4efab67fd0dc tempest-VolumesNegativeTest-1626062929 None] Lock "cinder-9fc2bff1-5cb7-4281-aff1-5a6168ffe82f-delete_volume" released by "delete_volume" :: held 2.566s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:24:43 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:SELECT=69,cinder:DELETE=6,cinder:UPDATE=80,cinder:INSERT=16 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 16:24:43 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-224789e0-d7c3-4bf2-971a-f91064349081 tempest-AttachVolumeNegativeTest-612785929 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:24:43 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-224789e0-d7c3-4bf2-971a-f91064349081 tempest-AttachVolumeNegativeTest-612785929 None] Flow 'volume_create_manager' (aa5539e9-3ec8-4d17-8955-640428340f90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:24:43 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-224789e0-d7c3-4bf2-971a-f91064349081 tempest-AttachVolumeNegativeTest-612785929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dbdc11a-e041-45d9-930e-8b3801f2b5d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:24:43 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-224789e0-d7c3-4bf2-971a-f91064349081 tempest-AttachVolumeNegativeTest-612785929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dbdc11a-e041-45d9-930e-8b3801f2b5d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:24:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1614758986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e5bbe02-787f-4127-8a1e-35c11aa0cf9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef4cf00d20054e2aa09d80608ec2688a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:24:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:24:44Z,use_quota=True,user_id='8fdca69cd06d4561a61b26546e2e803b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:24:43 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-224789e0-d7c3-4bf2-971a-f91064349081 tempest-AttachVolumeNegativeTest-612785929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1eab2a4-52c7-4de7-bf2d-ea8e2af89f04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:24:43 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-224789e0-d7c3-4bf2-971a-f91064349081 tempest-AttachVolumeNegativeTest-612785929 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1eab2a4-52c7-4de7-bf2d-ea8e2af89f04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:24:43 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-224789e0-d7c3-4bf2-971a-f91064349081 tempest-AttachVolumeNegativeTest-612785929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05e9b35c-3a3f-4b3d-886a-1e8f312a5316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:24:43 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-224789e0-d7c3-4bf2-971a-f91064349081 tempest-AttachVolumeNegativeTest-612785929 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05e9b35c-3a3f-4b3d-886a-1e8f312a5316) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e5bbe02-787f-4127-8a1e-35c11aa0cf9c', 'volume_name': 'volume-5e5bbe02-787f-4127-8a1e-35c11aa0cf9c', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:24:43 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-224789e0-d7c3-4bf2-971a-f91064349081 tempest-AttachVolumeNegativeTest-612785929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5eb23af2-dd59-461c-a78f-172996cd5f53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:24:43 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-224789e0-d7c3-4bf2-971a-f91064349081 tempest-AttachVolumeNegativeTest-612785929 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5eb23af2-dd59-461c-a78f-172996cd5f53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:24:43 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-224789e0-d7c3-4bf2-971a-f91064349081 tempest-AttachVolumeNegativeTest-612785929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c04062c-c04a-428e-8465-42a9d16aceb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:24:43 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-224789e0-d7c3-4bf2-971a-f91064349081 tempest-AttachVolumeNegativeTest-612785929 None] Volume 5e5bbe02-787f-4127-8a1e-35c11aa0cf9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e5bbe02-787f-4127-8a1e-35c11aa0cf9c', 'volume_size': 1} Sep 15 16:24:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-224789e0-d7c3-4bf2-971a-f91064349081 tempest-AttachVolumeNegativeTest-612785929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:24:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-224789e0-d7c3-4bf2-971a-f91064349081 tempest-AttachVolumeNegativeTest-612785929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:24:43 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-224789e0-d7c3-4bf2-971a-f91064349081 tempest-AttachVolumeNegativeTest-612785929 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:24:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1614758986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e5bbe02-787f-4127-8a1e-35c11aa0cf9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ef4cf00d20054e2aa09d80608ec2688a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:24:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:24:44Z,use_quota=True,user_id='8fdca69cd06d4561a61b26546e2e803b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:24:43 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-224789e0-d7c3-4bf2-971a-f91064349081 tempest-AttachVolumeNegativeTest-612785929 None] Creating volume 5e5bbe02-787f-4127-8a1e-35c11aa0cf9c {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:24:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-224789e0-d7c3-4bf2-971a-f91064349081 tempest-AttachVolumeNegativeTest-612785929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:24:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-224789e0-d7c3-4bf2-971a-f91064349081 tempest-AttachVolumeNegativeTest-612785929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:24:43 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-224789e0-d7c3-4bf2-971a-f91064349081 tempest-AttachVolumeNegativeTest-612785929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:24:43 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-224789e0-d7c3-4bf2-971a-f91064349081 tempest-AttachVolumeNegativeTest-612785929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:24:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-224789e0-d7c3-4bf2-971a-f91064349081 tempest-AttachVolumeNegativeTest-612785929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:24:43 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-224789e0-d7c3-4bf2-971a-f91064349081 tempest-AttachVolumeNegativeTest-612785929 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:24:43 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-224789e0-d7c3-4bf2-971a-f91064349081 tempest-AttachVolumeNegativeTest-612785929 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:24:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-224789e0-d7c3-4bf2-971a-f91064349081 tempest-AttachVolumeNegativeTest-612785929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-5e5bbe02-787f-4127-8a1e-35c11aa0cf9c 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:24:43 devstack sudo[97122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-5e5bbe02-787f-4127-8a1e-35c11aa0cf9c 1073741824 Sep 15 16:24:43 devstack sudo[97122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:24:44 devstack sudo[97122]: pam_unix(sudo:session): session closed for user root Sep 15 16:24:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-224789e0-d7c3-4bf2-971a-f91064349081 tempest-AttachVolumeNegativeTest-612785929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-5e5bbe02-787f-4127-8a1e-35c11aa0cf9c 1073741824" returned: 0 in 0.585s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:24:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-224789e0-d7c3-4bf2-971a-f91064349081 tempest-AttachVolumeNegativeTest-612785929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-5e5bbe02-787f-4127-8a1e-35c11aa0cf9c {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:24:44 devstack sudo[97128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-5e5bbe02-787f-4127-8a1e-35c11aa0cf9c Sep 15 16:24:44 devstack sudo[97128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:24:44 devstack sudo[97128]: pam_unix(sudo:session): session closed for user root Sep 15 16:24:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-224789e0-d7c3-4bf2-971a-f91064349081 tempest-AttachVolumeNegativeTest-612785929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-5e5bbe02-787f-4127-8a1e-35c11aa0cf9c" returned: 0 in 0.280s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:24:44 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-224789e0-d7c3-4bf2-971a-f91064349081 tempest-AttachVolumeNegativeTest-612785929 None] <== create_volume: return (914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:24:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-224789e0-d7c3-4bf2-971a-f91064349081 tempest-AttachVolumeNegativeTest-612785929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.917s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:24:44 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-224789e0-d7c3-4bf2-971a-f91064349081 tempest-AttachVolumeNegativeTest-612785929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c04062c-c04a-428e-8465-42a9d16aceb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e5bbe02-787f-4127-8a1e-35c11aa0cf9c', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:24:44 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-224789e0-d7c3-4bf2-971a-f91064349081 tempest-AttachVolumeNegativeTest-612785929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fbe0bc0-f0ef-4acd-a6ba-e7ae35fa9971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:24:44 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-224789e0-d7c3-4bf2-971a-f91064349081 tempest-AttachVolumeNegativeTest-612785929 None] Volume volume-5e5bbe02-787f-4127-8a1e-35c11aa0cf9c (5e5bbe02-787f-4127-8a1e-35c11aa0cf9c): created successfully Sep 15 16:24:44 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-224789e0-d7c3-4bf2-971a-f91064349081 tempest-AttachVolumeNegativeTest-612785929 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fbe0bc0-f0ef-4acd-a6ba-e7ae35fa9971) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:24:44 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-224789e0-d7c3-4bf2-971a-f91064349081 tempest-AttachVolumeNegativeTest-612785929 None] Flow 'volume_create_manager' (aa5539e9-3ec8-4d17-8955-640428340f90) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:24:44 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-224789e0-d7c3-4bf2-971a-f91064349081 tempest-AttachVolumeNegativeTest-612785929 None] Created volume successfully. Sep 15 16:24:45 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-b1c48533-e9ea-43ba-8af6-e31b40e47933 tempest-GroupsTest-1303038423 None] Group tempest-Group1-1518450586: creating Sep 15 16:24:45 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-b1c48533-e9ea-43ba-8af6-e31b40e47933 tempest-GroupsTest-1303038423 None] Group tempest-Group1-1518450586: created successfully Sep 15 16:24:45 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-b1c48533-e9ea-43ba-8af6-e31b40e47933 tempest-GroupsTest-1303038423 None] Create group completed successfully. Sep 15 16:24:46 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-54c36d97-2eea-4375-90d5-43a552cc4ad0 tempest-GroupsTest-1303038423 None] Group tempest-Group2-1176981344: creating Sep 15 16:24:46 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-54c36d97-2eea-4375-90d5-43a552cc4ad0 tempest-GroupsTest-1303038423 None] Group tempest-Group2-1176981344: created successfully Sep 15 16:24:46 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-54c36d97-2eea-4375-90d5-43a552cc4ad0 tempest-GroupsTest-1303038423 None] Create group completed successfully. Sep 15 16:24:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-d22a5a06-9bd4-41f3-b2cd-de1e300fe26b req-cabcbc40-4398-42ac-9a2f-ccf0ded4c24b tempest-AttachVolumeNegativeTest-612785929 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:24:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-d22a5a06-9bd4-41f3-b2cd-de1e300fe26b req-cabcbc40-4398-42ac-9a2f-ccf0ded4c24b tempest-AttachVolumeNegativeTest-612785929 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:24:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-d22a5a06-9bd4-41f3-b2cd-de1e300fe26b req-cabcbc40-4398-42ac-9a2f-ccf0ded4c24b tempest-AttachVolumeNegativeTest-612785929 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:24:47 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-d22a5a06-9bd4-41f3-b2cd-de1e300fe26b req-cabcbc40-4398-42ac-9a2f-ccf0ded4c24b tempest-AttachVolumeNegativeTest-612785929 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a', 'name': 'volume-5e5bbe02-787f-4127-8a1e-35c11aa0cf9c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '216ba129-f9b8-4011-9a4a-0ce5ae381202', 'enforce_multipath': True} {{(pid=86082) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 15 16:24:47 devstack cinder-volume[86082]: INFO cinder.volume.manager [req-d22a5a06-9bd4-41f3-b2cd-de1e300fe26b req-cabcbc40-4398-42ac-9a2f-ccf0ded4c24b tempest-AttachVolumeNegativeTest-612785929 None] attachment_update completed successfully. Sep 15 16:24:48 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb1f2094-d32e-46d6-8801-1329c0532a97 tempest-GroupsTest-1303038423 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:24:48 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-bb1f2094-d32e-46d6-8801-1329c0532a97 tempest-GroupsTest-1303038423 None] Flow 'volume_create_manager' (2a6022bc-91e5-41be-80fe-f65bf822733b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:24:49 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-bb1f2094-d32e-46d6-8801-1329c0532a97 tempest-GroupsTest-1303038423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (664b075d-b6d8-414a-8d05-bd9d05f98a17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:24:49 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-bb1f2094-d32e-46d6-8801-1329c0532a97 tempest-GroupsTest-1303038423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (664b075d-b6d8-414a-8d05-bd9d05f98a17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:24:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1905658179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=03946d14-64b1-4a97-ac65-b6cd92975b98,host='devstack@QuobyteHD#QuobyteHD',id=e092bc8e-ddd1-49d3-992d-14265f8df5f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1435b4ecfc54357b02ef1ce92ffb671',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:24:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:24:49Z,use_quota=True,user_id='a4ba98c508d9469ea855eb139ed4cef3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e70c71d3-77ee-4d1e-9499-917b54d4d387),volume_type_id=e70c71d3-77ee-4d1e-9499-917b54d4d387)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:24:49 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-bb1f2094-d32e-46d6-8801-1329c0532a97 tempest-GroupsTest-1303038423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (564304fe-7d70-4640-ae41-0bcfd2451640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:24:49 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-bb1f2094-d32e-46d6-8801-1329c0532a97 tempest-GroupsTest-1303038423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (564304fe-7d70-4640-ae41-0bcfd2451640) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:24:49 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-bb1f2094-d32e-46d6-8801-1329c0532a97 tempest-GroupsTest-1303038423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b98fdf66-c5f3-493c-a0c8-3e8372ab8e89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:24:49 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-bb1f2094-d32e-46d6-8801-1329c0532a97 tempest-GroupsTest-1303038423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b98fdf66-c5f3-493c-a0c8-3e8372ab8e89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e092bc8e-ddd1-49d3-992d-14265f8df5f9', 'volume_name': 'volume-e092bc8e-ddd1-49d3-992d-14265f8df5f9', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:24:49 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-bb1f2094-d32e-46d6-8801-1329c0532a97 tempest-GroupsTest-1303038423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b566c3cc-bffc-4eba-8b71-b1c230d24e5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:24:49 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-bb1f2094-d32e-46d6-8801-1329c0532a97 tempest-GroupsTest-1303038423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b566c3cc-bffc-4eba-8b71-b1c230d24e5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:24:49 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-bb1f2094-d32e-46d6-8801-1329c0532a97 tempest-GroupsTest-1303038423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fb5d80d-35a2-4e93-9acb-ccb5471b14df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:24:49 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-bb1f2094-d32e-46d6-8801-1329c0532a97 tempest-GroupsTest-1303038423 None] Volume e092bc8e-ddd1-49d3-992d-14265f8df5f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e092bc8e-ddd1-49d3-992d-14265f8df5f9', 'volume_size': 1} Sep 15 16:24:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-bb1f2094-d32e-46d6-8801-1329c0532a97 tempest-GroupsTest-1303038423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:24:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-bb1f2094-d32e-46d6-8801-1329c0532a97 tempest-GroupsTest-1303038423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:24:49 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-bb1f2094-d32e-46d6-8801-1329c0532a97 tempest-GroupsTest-1303038423 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=03946d14-64b1-4a97-ac65-b6cd92975b98,created_at=2026-09-15T14:24:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1905658179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=03946d14-64b1-4a97-ac65-b6cd92975b98,host='devstack@QuobyteHD#QuobyteHD',id=e092bc8e-ddd1-49d3-992d-14265f8df5f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1435b4ecfc54357b02ef1ce92ffb671',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:24:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:24:49Z,use_quota=True,user_id='a4ba98c508d9469ea855eb139ed4cef3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e70c71d3-77ee-4d1e-9499-917b54d4d387),volume_type_id=e70c71d3-77ee-4d1e-9499-917b54d4d387)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:24:49 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-bb1f2094-d32e-46d6-8801-1329c0532a97 tempest-GroupsTest-1303038423 None] Creating volume e092bc8e-ddd1-49d3-992d-14265f8df5f9 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:24:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-bb1f2094-d32e-46d6-8801-1329c0532a97 tempest-GroupsTest-1303038423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:24:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-bb1f2094-d32e-46d6-8801-1329c0532a97 tempest-GroupsTest-1303038423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:24:49 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-bb1f2094-d32e-46d6-8801-1329c0532a97 tempest-GroupsTest-1303038423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:24:49 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-bb1f2094-d32e-46d6-8801-1329c0532a97 tempest-GroupsTest-1303038423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:24:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-bb1f2094-d32e-46d6-8801-1329c0532a97 tempest-GroupsTest-1303038423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:24:49 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-bb1f2094-d32e-46d6-8801-1329c0532a97 tempest-GroupsTest-1303038423 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:24:49 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-bb1f2094-d32e-46d6-8801-1329c0532a97 tempest-GroupsTest-1303038423 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:24:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-bb1f2094-d32e-46d6-8801-1329c0532a97 tempest-GroupsTest-1303038423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-e092bc8e-ddd1-49d3-992d-14265f8df5f9 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:24:49 devstack sudo[97179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-e092bc8e-ddd1-49d3-992d-14265f8df5f9 1073741824 Sep 15 16:24:49 devstack sudo[97179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:24:49 devstack cinder-volume[86082]: INFO cinder.volume.manager [req-8c4cedb9-2326-4f6e-a21a-b78d38bb276b req-d47bc1da-1417-4643-abb8-6c7ed93feeb0 tempest-AttachVolumeNegativeTest-612785929 None] Terminate volume connection completed successfully. Sep 15 16:24:49 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-8c4cedb9-2326-4f6e-a21a-b78d38bb276b req-d47bc1da-1417-4643-abb8-6c7ed93feeb0 tempest-AttachVolumeNegativeTest-612785929 None] Deleting attachment 216ba129-f9b8-4011-9a4a-0ce5ae381202. {{(pid=86082) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 15 16:24:49 devstack sudo[97179]: pam_unix(sudo:session): session closed for user root Sep 15 16:24:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-bb1f2094-d32e-46d6-8801-1329c0532a97 tempest-GroupsTest-1303038423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-e092bc8e-ddd1-49d3-992d-14265f8df5f9 1073741824" returned: 0 in 0.601s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:24:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-bb1f2094-d32e-46d6-8801-1329c0532a97 tempest-GroupsTest-1303038423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-e092bc8e-ddd1-49d3-992d-14265f8df5f9 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:24:49 devstack sudo[97186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-e092bc8e-ddd1-49d3-992d-14265f8df5f9 Sep 15 16:24:49 devstack sudo[97186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:24:50 devstack sudo[97186]: pam_unix(sudo:session): session closed for user root Sep 15 16:24:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-bb1f2094-d32e-46d6-8801-1329c0532a97 tempest-GroupsTest-1303038423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-e092bc8e-ddd1-49d3-992d-14265f8df5f9" returned: 0 in 0.418s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:24:50 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-bb1f2094-d32e-46d6-8801-1329c0532a97 tempest-GroupsTest-1303038423 None] <== create_volume: return (1068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:24:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-bb1f2094-d32e-46d6-8801-1329c0532a97 tempest-GroupsTest-1303038423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.074s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:24:50 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-bb1f2094-d32e-46d6-8801-1329c0532a97 tempest-GroupsTest-1303038423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fb5d80d-35a2-4e93-9acb-ccb5471b14df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e092bc8e-ddd1-49d3-992d-14265f8df5f9', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:24:50 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-bb1f2094-d32e-46d6-8801-1329c0532a97 tempest-GroupsTest-1303038423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c084672c-48b0-4d91-bb1b-0b2227344fbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:24:50 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-bb1f2094-d32e-46d6-8801-1329c0532a97 tempest-GroupsTest-1303038423 None] Volume volume-e092bc8e-ddd1-49d3-992d-14265f8df5f9 (e092bc8e-ddd1-49d3-992d-14265f8df5f9): created successfully Sep 15 16:24:50 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-bb1f2094-d32e-46d6-8801-1329c0532a97 tempest-GroupsTest-1303038423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c084672c-48b0-4d91-bb1b-0b2227344fbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:24:50 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-bb1f2094-d32e-46d6-8801-1329c0532a97 tempest-GroupsTest-1303038423 None] Flow 'volume_create_manager' (2a6022bc-91e5-41be-80fe-f65bf822733b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:24:50 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-bb1f2094-d32e-46d6-8801-1329c0532a97 tempest-GroupsTest-1303038423 None] Created volume successfully. Sep 15 16:24:52 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-043acf85-9957-4fbe-8c41-a662897d77c5 tempest-GroupsTest-1303038423 None] Acquiring lock "cinder-quobyte-e092bc8e-ddd1-49d3-992d-14265f8df5f9" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:24:52 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-043acf85-9957-4fbe-8c41-a662897d77c5 tempest-GroupsTest-1303038423 None] Lock "cinder-quobyte-e092bc8e-ddd1-49d3-992d-14265f8df5f9" acquired by "delete_volume" :: waited 0.033s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:24:52 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c51638b-436a-4e94-b510-cce4af7db04e]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:24:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-043acf85-9957-4fbe-8c41-a662897d77c5 tempest-GroupsTest-1303038423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-e092bc8e-ddd1-49d3-992d-14265f8df5f9 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:24:52 devstack sudo[97210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-e092bc8e-ddd1-49d3-992d-14265f8df5f9 Sep 15 16:24:52 devstack sudo[97210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:24:52 devstack sudo[97210]: pam_unix(sudo:session): session closed for user root Sep 15 16:24:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-043acf85-9957-4fbe-8c41-a662897d77c5 tempest-GroupsTest-1303038423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-e092bc8e-ddd1-49d3-992d-14265f8df5f9" returned: 0 in 0.444s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:24:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-043acf85-9957-4fbe-8c41-a662897d77c5 tempest-GroupsTest-1303038423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-e092bc8e-ddd1-49d3-992d-14265f8df5f9 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:24:52 devstack sudo[97216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-e092bc8e-ddd1-49d3-992d-14265f8df5f9 Sep 15 16:24:52 devstack sudo[97216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:24:53 devstack sudo[97216]: pam_unix(sudo:session): session closed for user root Sep 15 16:24:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-043acf85-9957-4fbe-8c41-a662897d77c5 tempest-GroupsTest-1303038423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-e092bc8e-ddd1-49d3-992d-14265f8df5f9" returned: 0 in 0.379s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:24:53 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-043acf85-9957-4fbe-8c41-a662897d77c5 tempest-GroupsTest-1303038423 None] Lock "cinder-quobyte-e092bc8e-ddd1-49d3-992d-14265f8df5f9" released by "delete_volume" :: held 0.903s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:24:53 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-043acf85-9957-4fbe-8c41-a662897d77c5 tempest-GroupsTest-1303038423 None] Created reservations ['73d1c072-5009-40fa-aeee-16e0d1f33ec6'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:24:53 devstack cinder-volume[86082]: WARNING cinder.quota [None req-043acf85-9957-4fbe-8c41-a662897d77c5 tempest-GroupsTest-1303038423 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-91223754 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-91223754, it is now deprecated. Please use the default quota class for default quota. Sep 15 16:24:53 devstack cinder-volume[86082]: WARNING cinder.quota [None req-043acf85-9957-4fbe-8c41-a662897d77c5 tempest-GroupsTest-1303038423 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-91223754 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-91223754, it is now deprecated. Please use the default quota class for default quota. Sep 15 16:24:53 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-043acf85-9957-4fbe-8c41-a662897d77c5 tempest-GroupsTest-1303038423 None] Created reservations ['99338da0-0260-4001-9722-dfc05ca68072', 'cc08c9f8-c63b-46f7-aefb-119a4703d9b9', '680b81bc-934c-4453-a079-7c59026f8aac', 'bca1dfac-6fda-4fcb-89c3-23a693a616c4'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:24:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-043acf85-9957-4fbe-8c41-a662897d77c5 tempest-GroupsTest-1303038423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:24:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-043acf85-9957-4fbe-8c41-a662897d77c5 tempest-GroupsTest-1303038423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:24:53 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-043acf85-9957-4fbe-8c41-a662897d77c5 tempest-GroupsTest-1303038423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:24:53 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-043acf85-9957-4fbe-8c41-a662897d77c5 tempest-GroupsTest-1303038423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:24:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-043acf85-9957-4fbe-8c41-a662897d77c5 tempest-GroupsTest-1303038423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:24:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-043acf85-9957-4fbe-8c41-a662897d77c5 tempest-GroupsTest-1303038423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:24:53 devstack sudo[97219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:24:53 devstack sudo[97219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:24:53 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-7b136e29-e021-4ebf-9523-a5d2cfeab292 tempest-GroupsTest-1303038423 None] Created reservations ['12fd627c-efda-4840-8c95-8336d18756c2'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:24:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-7b136e29-e021-4ebf-9523-a5d2cfeab292 tempest-GroupsTest-1303038423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:24:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-7b136e29-e021-4ebf-9523-a5d2cfeab292 tempest-GroupsTest-1303038423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:24:53 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-7b136e29-e021-4ebf-9523-a5d2cfeab292 tempest-GroupsTest-1303038423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:24:53 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-7b136e29-e021-4ebf-9523-a5d2cfeab292 tempest-GroupsTest-1303038423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:24:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-7b136e29-e021-4ebf-9523-a5d2cfeab292 tempest-GroupsTest-1303038423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:24:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7b136e29-e021-4ebf-9523-a5d2cfeab292 tempest-GroupsTest-1303038423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:24:53 devstack sudo[97222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:24:53 devstack sudo[97222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:24:53 devstack sudo[97219]: pam_unix(sudo:session): session closed for user root Sep 15 16:24:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-043acf85-9957-4fbe-8c41-a662897d77c5 tempest-GroupsTest-1303038423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.324s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:24:53 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-043acf85-9957-4fbe-8c41-a662897d77c5 tempest-GroupsTest-1303038423 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:24:53 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-043acf85-9957-4fbe-8c41-a662897d77c5 tempest-GroupsTest-1303038423 None] Delete group completed successfully. Sep 15 16:24:54 devstack sudo[97222]: pam_unix(sudo:session): session closed for user root Sep 15 16:24:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7b136e29-e021-4ebf-9523-a5d2cfeab292 tempest-GroupsTest-1303038423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.301s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:24:54 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-7b136e29-e021-4ebf-9523-a5d2cfeab292 tempest-GroupsTest-1303038423 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:24:54 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-7b136e29-e021-4ebf-9523-a5d2cfeab292 tempest-GroupsTest-1303038423 None] Delete group completed successfully. Sep 15 16:24:54 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b89dff2-d561-423f-aafc-897297a037f8 tempest-VolumesSnapshotTestJSON-999544861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:24:54 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7b89dff2-d561-423f-aafc-897297a037f8 tempest-VolumesSnapshotTestJSON-999544861 None] Flow 'volume_create_manager' (52eae8e3-4234-4e8a-84fc-f5acb7f1df2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:24:54 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7b89dff2-d561-423f-aafc-897297a037f8 tempest-VolumesSnapshotTestJSON-999544861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (849d4c89-823c-49b5-abc5-23d66c128634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:24:54 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7b89dff2-d561-423f-aafc-897297a037f8 tempest-VolumesSnapshotTestJSON-999544861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (849d4c89-823c-49b5-abc5-23d66c128634) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:24:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-607653062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21496a3e-4636-47a1-a8da-1b96049fe201,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98963f0df68643a7885de5021e1b8ff4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:24:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:24:55Z,use_quota=True,user_id='274fbf9eed974fbf8903d2cfaeae0224',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:24:54 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7b89dff2-d561-423f-aafc-897297a037f8 tempest-VolumesSnapshotTestJSON-999544861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (923c99c8-d7dc-48b8-a1b4-85b68892d79c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:24:54 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7b89dff2-d561-423f-aafc-897297a037f8 tempest-VolumesSnapshotTestJSON-999544861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (923c99c8-d7dc-48b8-a1b4-85b68892d79c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:24:54 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7b89dff2-d561-423f-aafc-897297a037f8 tempest-VolumesSnapshotTestJSON-999544861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1699d3c-099e-4af8-a47a-d45421c3a04c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:24:54 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7b89dff2-d561-423f-aafc-897297a037f8 tempest-VolumesSnapshotTestJSON-999544861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1699d3c-099e-4af8-a47a-d45421c3a04c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21496a3e-4636-47a1-a8da-1b96049fe201', 'volume_name': 'volume-21496a3e-4636-47a1-a8da-1b96049fe201', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:24:54 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7b89dff2-d561-423f-aafc-897297a037f8 tempest-VolumesSnapshotTestJSON-999544861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a45b1070-6023-4b15-8a25-f0ed9cefb0ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:24:54 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7b89dff2-d561-423f-aafc-897297a037f8 tempest-VolumesSnapshotTestJSON-999544861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a45b1070-6023-4b15-8a25-f0ed9cefb0ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:24:54 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7b89dff2-d561-423f-aafc-897297a037f8 tempest-VolumesSnapshotTestJSON-999544861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f44707bb-e8f1-4ff6-9cce-a671156a9a8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:24:54 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-7b89dff2-d561-423f-aafc-897297a037f8 tempest-VolumesSnapshotTestJSON-999544861 None] Volume 21496a3e-4636-47a1-a8da-1b96049fe201: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21496a3e-4636-47a1-a8da-1b96049fe201', 'volume_size': 1} Sep 15 16:24:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-7b89dff2-d561-423f-aafc-897297a037f8 tempest-VolumesSnapshotTestJSON-999544861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:24:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-7b89dff2-d561-423f-aafc-897297a037f8 tempest-VolumesSnapshotTestJSON-999544861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:24:55 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-7b89dff2-d561-423f-aafc-897297a037f8 tempest-VolumesSnapshotTestJSON-999544861 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:24:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-607653062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21496a3e-4636-47a1-a8da-1b96049fe201,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98963f0df68643a7885de5021e1b8ff4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:24:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:24:55Z,use_quota=True,user_id='274fbf9eed974fbf8903d2cfaeae0224',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:24:55 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-7b89dff2-d561-423f-aafc-897297a037f8 tempest-VolumesSnapshotTestJSON-999544861 None] Creating volume 21496a3e-4636-47a1-a8da-1b96049fe201 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:24:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-7b89dff2-d561-423f-aafc-897297a037f8 tempest-VolumesSnapshotTestJSON-999544861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:24:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-7b89dff2-d561-423f-aafc-897297a037f8 tempest-VolumesSnapshotTestJSON-999544861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:24:55 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-7b89dff2-d561-423f-aafc-897297a037f8 tempest-VolumesSnapshotTestJSON-999544861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:24:55 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-7b89dff2-d561-423f-aafc-897297a037f8 tempest-VolumesSnapshotTestJSON-999544861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:24:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-7b89dff2-d561-423f-aafc-897297a037f8 tempest-VolumesSnapshotTestJSON-999544861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:24:55 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-7b89dff2-d561-423f-aafc-897297a037f8 tempest-VolumesSnapshotTestJSON-999544861 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:24:55 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-7b89dff2-d561-423f-aafc-897297a037f8 tempest-VolumesSnapshotTestJSON-999544861 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:24:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7b89dff2-d561-423f-aafc-897297a037f8 tempest-VolumesSnapshotTestJSON-999544861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-21496a3e-4636-47a1-a8da-1b96049fe201 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:24:55 devstack sudo[97226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-21496a3e-4636-47a1-a8da-1b96049fe201 1073741824 Sep 15 16:24:55 devstack sudo[97226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:24:55 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-fd640412-74ae-4d48-9b34-6369f1cf5503 tempest-GroupsTest-1303038423 None] Group tempest-GroupsTest-Group-1361350852: creating Sep 15 16:24:55 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-fd640412-74ae-4d48-9b34-6369f1cf5503 tempest-GroupsTest-1303038423 None] Group tempest-GroupsTest-Group-1361350852: created successfully Sep 15 16:24:55 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-fd640412-74ae-4d48-9b34-6369f1cf5503 tempest-GroupsTest-1303038423 None] Create group completed successfully. Sep 15 16:24:55 devstack sudo[97226]: pam_unix(sudo:session): session closed for user root Sep 15 16:24:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7b89dff2-d561-423f-aafc-897297a037f8 tempest-VolumesSnapshotTestJSON-999544861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-21496a3e-4636-47a1-a8da-1b96049fe201 1073741824" returned: 0 in 0.623s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:24:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7b89dff2-d561-423f-aafc-897297a037f8 tempest-VolumesSnapshotTestJSON-999544861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-21496a3e-4636-47a1-a8da-1b96049fe201 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:24:55 devstack sudo[97233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-21496a3e-4636-47a1-a8da-1b96049fe201 Sep 15 16:24:55 devstack sudo[97233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:24:56 devstack sudo[97233]: pam_unix(sudo:session): session closed for user root Sep 15 16:24:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7b89dff2-d561-423f-aafc-897297a037f8 tempest-VolumesSnapshotTestJSON-999544861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-21496a3e-4636-47a1-a8da-1b96049fe201" returned: 0 in 0.363s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:24:56 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-7b89dff2-d561-423f-aafc-897297a037f8 tempest-VolumesSnapshotTestJSON-999544861 None] <== create_volume: return (1044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:24:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-7b89dff2-d561-423f-aafc-897297a037f8 tempest-VolumesSnapshotTestJSON-999544861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.047s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:24:56 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7b89dff2-d561-423f-aafc-897297a037f8 tempest-VolumesSnapshotTestJSON-999544861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f44707bb-e8f1-4ff6-9cce-a671156a9a8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21496a3e-4636-47a1-a8da-1b96049fe201', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:24:56 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7b89dff2-d561-423f-aafc-897297a037f8 tempest-VolumesSnapshotTestJSON-999544861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (846e1a81-fb15-4b0c-807e-4cefaec80f25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:24:56 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-7b89dff2-d561-423f-aafc-897297a037f8 tempest-VolumesSnapshotTestJSON-999544861 None] Volume volume-21496a3e-4636-47a1-a8da-1b96049fe201 (21496a3e-4636-47a1-a8da-1b96049fe201): created successfully Sep 15 16:24:56 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7b89dff2-d561-423f-aafc-897297a037f8 tempest-VolumesSnapshotTestJSON-999544861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (846e1a81-fb15-4b0c-807e-4cefaec80f25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:24:56 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7b89dff2-d561-423f-aafc-897297a037f8 tempest-VolumesSnapshotTestJSON-999544861 None] Flow 'volume_create_manager' (52eae8e3-4234-4e8a-84fc-f5acb7f1df2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:24:56 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-7b89dff2-d561-423f-aafc-897297a037f8 tempest-VolumesSnapshotTestJSON-999544861 None] Created volume successfully. Sep 15 16:24:57 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c2a373f-01ca-4838-ada3-7d660d54c49c tempest-GroupsTest-1303038423 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:24:57 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2c2a373f-01ca-4838-ada3-7d660d54c49c tempest-GroupsTest-1303038423 None] Flow 'volume_create_manager' (efa8600b-81e1-4e2b-9676-b5bea1408a93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:24:57 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2c2a373f-01ca-4838-ada3-7d660d54c49c tempest-GroupsTest-1303038423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (502484a9-1bc0-4c4f-8563-98d0ec8e1f35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:24:57 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2c2a373f-01ca-4838-ada3-7d660d54c49c tempest-GroupsTest-1303038423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (502484a9-1bc0-4c4f-8563-98d0ec8e1f35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:24:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2062941805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=eeaad246-cae1-4956-9775-cc01632bdc44,host='devstack@QuobyteHD#QuobyteHD',id=19a9fcd5-4bf5-47db-8c68-dfc6a32c8324,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1435b4ecfc54357b02ef1ce92ffb671',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:24:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:24:57Z,use_quota=True,user_id='a4ba98c508d9469ea855eb139ed4cef3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2aa144be-dcb5-45d1-922d-4faa83f32e5f),volume_type_id=2aa144be-dcb5-45d1-922d-4faa83f32e5f)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:24:57 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2c2a373f-01ca-4838-ada3-7d660d54c49c tempest-GroupsTest-1303038423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (635718bd-6a70-4013-bff5-d66da2310619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:24:57 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2c2a373f-01ca-4838-ada3-7d660d54c49c tempest-GroupsTest-1303038423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (635718bd-6a70-4013-bff5-d66da2310619) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:24:57 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2c2a373f-01ca-4838-ada3-7d660d54c49c tempest-GroupsTest-1303038423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62e35733-4a95-4a69-bf36-9c70920f571a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:24:57 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2c2a373f-01ca-4838-ada3-7d660d54c49c tempest-GroupsTest-1303038423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62e35733-4a95-4a69-bf36-9c70920f571a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19a9fcd5-4bf5-47db-8c68-dfc6a32c8324', 'volume_name': 'volume-19a9fcd5-4bf5-47db-8c68-dfc6a32c8324', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:24:57 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2c2a373f-01ca-4838-ada3-7d660d54c49c tempest-GroupsTest-1303038423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28794bc8-32b0-40bb-aba3-3b435e4ae347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:24:57 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2c2a373f-01ca-4838-ada3-7d660d54c49c tempest-GroupsTest-1303038423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28794bc8-32b0-40bb-aba3-3b435e4ae347) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:24:57 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2c2a373f-01ca-4838-ada3-7d660d54c49c tempest-GroupsTest-1303038423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ebc2946-e3fb-4544-bd51-03db93ccc216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:24:57 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-2c2a373f-01ca-4838-ada3-7d660d54c49c tempest-GroupsTest-1303038423 None] Volume 19a9fcd5-4bf5-47db-8c68-dfc6a32c8324: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19a9fcd5-4bf5-47db-8c68-dfc6a32c8324', 'volume_size': 1} Sep 15 16:24:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-2c2a373f-01ca-4838-ada3-7d660d54c49c tempest-GroupsTest-1303038423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:24:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-2c2a373f-01ca-4838-ada3-7d660d54c49c tempest-GroupsTest-1303038423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:24:57 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-2c2a373f-01ca-4838-ada3-7d660d54c49c tempest-GroupsTest-1303038423 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=eeaad246-cae1-4956-9775-cc01632bdc44,created_at=2026-09-15T14:24:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2062941805',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=eeaad246-cae1-4956-9775-cc01632bdc44,host='devstack@QuobyteHD#QuobyteHD',id=19a9fcd5-4bf5-47db-8c68-dfc6a32c8324,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1435b4ecfc54357b02ef1ce92ffb671',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:24:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:24:57Z,use_quota=True,user_id='a4ba98c508d9469ea855eb139ed4cef3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2aa144be-dcb5-45d1-922d-4faa83f32e5f),volume_type_id=2aa144be-dcb5-45d1-922d-4faa83f32e5f)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:24:57 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-2c2a373f-01ca-4838-ada3-7d660d54c49c tempest-GroupsTest-1303038423 None] Creating volume 19a9fcd5-4bf5-47db-8c68-dfc6a32c8324 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:24:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-2c2a373f-01ca-4838-ada3-7d660d54c49c tempest-GroupsTest-1303038423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:24:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-2c2a373f-01ca-4838-ada3-7d660d54c49c tempest-GroupsTest-1303038423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:24:57 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-2c2a373f-01ca-4838-ada3-7d660d54c49c tempest-GroupsTest-1303038423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:24:57 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-2c2a373f-01ca-4838-ada3-7d660d54c49c tempest-GroupsTest-1303038423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:24:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-2c2a373f-01ca-4838-ada3-7d660d54c49c tempest-GroupsTest-1303038423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:24:57 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-2c2a373f-01ca-4838-ada3-7d660d54c49c tempest-GroupsTest-1303038423 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:24:57 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-2c2a373f-01ca-4838-ada3-7d660d54c49c tempest-GroupsTest-1303038423 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:24:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2c2a373f-01ca-4838-ada3-7d660d54c49c tempest-GroupsTest-1303038423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-19a9fcd5-4bf5-47db-8c68-dfc6a32c8324 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:24:57 devstack sudo[97237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-19a9fcd5-4bf5-47db-8c68-dfc6a32c8324 1073741824 Sep 15 16:24:57 devstack sudo[97237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:24:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-15f7e396-83ac-46a5-9915-783351ec0982 tempest-VolumesSnapshotTestJSON-999544861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:24:57 devstack sudo[97237]: pam_unix(sudo:session): session closed for user root Sep 15 16:24:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2c2a373f-01ca-4838-ada3-7d660d54c49c tempest-GroupsTest-1303038423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-19a9fcd5-4bf5-47db-8c68-dfc6a32c8324 1073741824" returned: 0 in 0.485s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:24:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2c2a373f-01ca-4838-ada3-7d660d54c49c tempest-GroupsTest-1303038423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-19a9fcd5-4bf5-47db-8c68-dfc6a32c8324 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:24:57 devstack sudo[97251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-19a9fcd5-4bf5-47db-8c68-dfc6a32c8324 Sep 15 16:24:57 devstack sudo[97251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:24:58 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-6c852374-7cf3-4992-9158-1f6eb2b814cd tempest-AttachVolumeNegativeTest-612785929 None] Acquiring lock "cinder-5e5bbe02-787f-4127-8a1e-35c11aa0cf9c-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:24:58 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-6c852374-7cf3-4992-9158-1f6eb2b814cd tempest-AttachVolumeNegativeTest-612785929 None] Lock "cinder-5e5bbe02-787f-4127-8a1e-35c11aa0cf9c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:24:58 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-6c852374-7cf3-4992-9158-1f6eb2b814cd tempest-AttachVolumeNegativeTest-612785929 None] Acquiring lock "cinder-quobyte-5e5bbe02-787f-4127-8a1e-35c11aa0cf9c" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:24:58 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-6c852374-7cf3-4992-9158-1f6eb2b814cd tempest-AttachVolumeNegativeTest-612785929 None] Lock "cinder-quobyte-5e5bbe02-787f-4127-8a1e-35c11aa0cf9c" acquired by "delete_volume" :: waited 0.023s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:24:58 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[af970b4a-8ab9-4c50-b7cf-b643106a4f17]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:24:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-6c852374-7cf3-4992-9158-1f6eb2b814cd tempest-AttachVolumeNegativeTest-612785929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-5e5bbe02-787f-4127-8a1e-35c11aa0cf9c {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:24:58 devstack sudo[97251]: pam_unix(sudo:session): session closed for user root Sep 15 16:24:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2c2a373f-01ca-4838-ada3-7d660d54c49c tempest-GroupsTest-1303038423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-19a9fcd5-4bf5-47db-8c68-dfc6a32c8324" returned: 0 in 0.302s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:24:58 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-2c2a373f-01ca-4838-ada3-7d660d54c49c tempest-GroupsTest-1303038423 None] <== create_volume: return (839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:24:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-2c2a373f-01ca-4838-ada3-7d660d54c49c tempest-GroupsTest-1303038423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.842s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:24:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-15f7e396-83ac-46a5-9915-783351ec0982 tempest-VolumesSnapshotTestJSON-999544861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.596s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:24:58 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2c2a373f-01ca-4838-ada3-7d660d54c49c tempest-GroupsTest-1303038423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ebc2946-e3fb-4544-bd51-03db93ccc216) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19a9fcd5-4bf5-47db-8c68-dfc6a32c8324', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:24:58 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2c2a373f-01ca-4838-ada3-7d660d54c49c tempest-GroupsTest-1303038423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fb04e4d-7a22-48c5-9448-c51cc1065c0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:24:58 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-15f7e396-83ac-46a5-9915-783351ec0982 tempest-VolumesSnapshotTestJSON-999544861 None] Creating offline snapshot 2acc67c5-0e5d-4907-946b-02ab1c471557 of volume 21496a3e-4636-47a1-a8da-1b96049fe201 {{(pid=86082) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 15 16:24:58 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-2c2a373f-01ca-4838-ada3-7d660d54c49c tempest-GroupsTest-1303038423 None] Volume volume-19a9fcd5-4bf5-47db-8c68-dfc6a32c8324 (19a9fcd5-4bf5-47db-8c68-dfc6a32c8324): created successfully Sep 15 16:24:58 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2c2a373f-01ca-4838-ada3-7d660d54c49c tempest-GroupsTest-1303038423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fb04e4d-7a22-48c5-9448-c51cc1065c0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:24:58 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2c2a373f-01ca-4838-ada3-7d660d54c49c tempest-GroupsTest-1303038423 None] Flow 'volume_create_manager' (efa8600b-81e1-4e2b-9676-b5bea1408a93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:24:58 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba497346-2972-463f-8102-11859ac72427]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:24:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-15f7e396-83ac-46a5-9915-783351ec0982 tempest-VolumesSnapshotTestJSON-999544861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-21496a3e-4636-47a1-a8da-1b96049fe201 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:24:58 devstack sudo[97254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-5e5bbe02-787f-4127-8a1e-35c11aa0cf9c Sep 15 16:24:58 devstack sudo[97254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:24:58 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-2c2a373f-01ca-4838-ada3-7d660d54c49c tempest-GroupsTest-1303038423 None] Created volume successfully. Sep 15 16:24:58 devstack sudo[97255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-21496a3e-4636-47a1-a8da-1b96049fe201 Sep 15 16:24:58 devstack sudo[97255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:24:58 devstack sudo[97254]: pam_unix(sudo:session): session closed for user root Sep 15 16:24:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-6c852374-7cf3-4992-9158-1f6eb2b814cd tempest-AttachVolumeNegativeTest-612785929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-5e5bbe02-787f-4127-8a1e-35c11aa0cf9c" returned: 0 in 0.495s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:24:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-6c852374-7cf3-4992-9158-1f6eb2b814cd tempest-AttachVolumeNegativeTest-612785929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-5e5bbe02-787f-4127-8a1e-35c11aa0cf9c {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:24:58 devstack sudo[97264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-5e5bbe02-787f-4127-8a1e-35c11aa0cf9c Sep 15 16:24:58 devstack sudo[97264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:24:58 devstack sudo[97255]: pam_unix(sudo:session): session closed for user root Sep 15 16:24:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-15f7e396-83ac-46a5-9915-783351ec0982 tempest-VolumesSnapshotTestJSON-999544861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-21496a3e-4636-47a1-a8da-1b96049fe201" returned: 0 in 0.463s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:24:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-15f7e396-83ac-46a5-9915-783351ec0982 tempest-VolumesSnapshotTestJSON-999544861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-21496a3e-4636-47a1-a8da-1b96049fe201,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-21496a3e-4636-47a1-a8da-1b96049fe201.2acc67c5-0e5d-4907-946b-02ab1c471557 1G {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:24:58 devstack sudo[97266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-21496a3e-4636-47a1-a8da-1b96049fe201,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-21496a3e-4636-47a1-a8da-1b96049fe201.2acc67c5-0e5d-4907-946b-02ab1c471557 1G Sep 15 16:24:58 devstack sudo[97266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:24:58 devstack sudo[97264]: pam_unix(sudo:session): session closed for user root Sep 15 16:24:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-6c852374-7cf3-4992-9158-1f6eb2b814cd tempest-AttachVolumeNegativeTest-612785929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-5e5bbe02-787f-4127-8a1e-35c11aa0cf9c" returned: 0 in 0.284s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:24:59 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-6c852374-7cf3-4992-9158-1f6eb2b814cd tempest-AttachVolumeNegativeTest-612785929 None] Lock "cinder-quobyte-5e5bbe02-787f-4127-8a1e-35c11aa0cf9c" released by "delete_volume" :: held 0.860s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:24:59 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-6c852374-7cf3-4992-9158-1f6eb2b814cd tempest-AttachVolumeNegativeTest-612785929 None] Created reservations ['8307beec-2cb2-41c1-803a-a41987955df7', '088979c3-4f14-4a58-82b7-5c156853021f', 'ac3ba210-3bf4-43f0-821d-2bd487e88b4e', '6fbfcd6b-319c-43ea-8e48-6593e9dfe64c'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:24:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-6c852374-7cf3-4992-9158-1f6eb2b814cd tempest-AttachVolumeNegativeTest-612785929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:24:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-6c852374-7cf3-4992-9158-1f6eb2b814cd tempest-AttachVolumeNegativeTest-612785929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:24:59 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-6c852374-7cf3-4992-9158-1f6eb2b814cd tempest-AttachVolumeNegativeTest-612785929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:24:59 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-6c852374-7cf3-4992-9158-1f6eb2b814cd tempest-AttachVolumeNegativeTest-612785929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:24:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-6c852374-7cf3-4992-9158-1f6eb2b814cd tempest-AttachVolumeNegativeTest-612785929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:24:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-6c852374-7cf3-4992-9158-1f6eb2b814cd tempest-AttachVolumeNegativeTest-612785929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:24:59 devstack sudo[97272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:24:59 devstack sudo[97272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:24:59 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-999471e4-8ab8-43a9-b2c7-70de803935ee tempest-GroupsTest-1303038423 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:24:59 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-999471e4-8ab8-43a9-b2c7-70de803935ee tempest-GroupsTest-1303038423 None] Flow 'volume_create_manager' (93bb26e7-97e0-43e4-b109-d19f4986a2af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:24:59 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-999471e4-8ab8-43a9-b2c7-70de803935ee tempest-GroupsTest-1303038423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf43c08d-211b-4767-acaf-990c33dd73e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:24:59 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-999471e4-8ab8-43a9-b2c7-70de803935ee tempest-GroupsTest-1303038423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf43c08d-211b-4767-acaf-990c33dd73e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:24:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-521969797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=eeaad246-cae1-4956-9775-cc01632bdc44,host='devstack@QuobyteHD#QuobyteHD',id=4403263f-432f-4b1e-b35f-f74b4c7936aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1435b4ecfc54357b02ef1ce92ffb671',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:24:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:24:59Z,use_quota=True,user_id='a4ba98c508d9469ea855eb139ed4cef3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2aa144be-dcb5-45d1-922d-4faa83f32e5f),volume_type_id=2aa144be-dcb5-45d1-922d-4faa83f32e5f)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:24:59 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-999471e4-8ab8-43a9-b2c7-70de803935ee tempest-GroupsTest-1303038423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b309008-8fd6-486f-9a33-d44018d25032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:24:59 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-999471e4-8ab8-43a9-b2c7-70de803935ee tempest-GroupsTest-1303038423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b309008-8fd6-486f-9a33-d44018d25032) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:24:59 devstack sudo[97266]: pam_unix(sudo:session): session closed for user root Sep 15 16:24:59 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-999471e4-8ab8-43a9-b2c7-70de803935ee tempest-GroupsTest-1303038423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44f79864-34f8-4ccf-a7ff-8f8f54944a3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:24:59 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-999471e4-8ab8-43a9-b2c7-70de803935ee tempest-GroupsTest-1303038423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44f79864-34f8-4ccf-a7ff-8f8f54944a3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4403263f-432f-4b1e-b35f-f74b4c7936aa', 'volume_name': 'volume-4403263f-432f-4b1e-b35f-f74b4c7936aa', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:24:59 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-999471e4-8ab8-43a9-b2c7-70de803935ee tempest-GroupsTest-1303038423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9373b0e1-462e-4eb8-84c6-ccc1cbf599d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:24:59 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-999471e4-8ab8-43a9-b2c7-70de803935ee tempest-GroupsTest-1303038423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9373b0e1-462e-4eb8-84c6-ccc1cbf599d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:24:59 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-999471e4-8ab8-43a9-b2c7-70de803935ee tempest-GroupsTest-1303038423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb5c7770-e6ae-4884-a219-0a8f807079c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:24:59 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-999471e4-8ab8-43a9-b2c7-70de803935ee tempest-GroupsTest-1303038423 None] Volume 4403263f-432f-4b1e-b35f-f74b4c7936aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4403263f-432f-4b1e-b35f-f74b4c7936aa', 'volume_size': 1} Sep 15 16:24:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-999471e4-8ab8-43a9-b2c7-70de803935ee tempest-GroupsTest-1303038423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:24:59 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f5cb5e25-543c-4d0c-af5e-4240a1b291cc tempest-AttachVolumeNegativeTest-612785929 None] Acquiring lock "cinder-901c541d-0907-40dc-a029-269b4af14148-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:24:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-15f7e396-83ac-46a5-9915-783351ec0982 tempest-VolumesSnapshotTestJSON-999544861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-21496a3e-4636-47a1-a8da-1b96049fe201,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-21496a3e-4636-47a1-a8da-1b96049fe201.2acc67c5-0e5d-4907-946b-02ab1c471557 1G" returned: 0 in 0.657s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:24:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-15f7e396-83ac-46a5-9915-783351ec0982 tempest-VolumesSnapshotTestJSON-999544861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21496a3e-4636-47a1-a8da-1b96049fe201 -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-21496a3e-4636-47a1-a8da-1b96049fe201.2acc67c5-0e5d-4907-946b-02ab1c471557 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:24:59 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f5cb5e25-543c-4d0c-af5e-4240a1b291cc tempest-AttachVolumeNegativeTest-612785929 None] Lock "cinder-901c541d-0907-40dc-a029-269b4af14148-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:24:59 devstack sudo[97274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21496a3e-4636-47a1-a8da-1b96049fe201 -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-21496a3e-4636-47a1-a8da-1b96049fe201.2acc67c5-0e5d-4907-946b-02ab1c471557 Sep 15 16:24:59 devstack sudo[97274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:24:59 devstack sudo[97272]: pam_unix(sudo:session): session closed for user root Sep 15 16:24:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-6c852374-7cf3-4992-9158-1f6eb2b814cd tempest-AttachVolumeNegativeTest-612785929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.327s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:24:59 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-6c852374-7cf3-4992-9158-1f6eb2b814cd tempest-AttachVolumeNegativeTest-612785929 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:24:59 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f5cb5e25-543c-4d0c-af5e-4240a1b291cc tempest-AttachVolumeNegativeTest-612785929 None] Acquiring lock "cinder-quobyte-901c541d-0907-40dc-a029-269b4af14148" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:24:59 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-6c852374-7cf3-4992-9158-1f6eb2b814cd tempest-AttachVolumeNegativeTest-612785929 None] Deleted volume successfully. Sep 15 16:24:59 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f5cb5e25-543c-4d0c-af5e-4240a1b291cc tempest-AttachVolumeNegativeTest-612785929 None] Lock "cinder-quobyte-901c541d-0907-40dc-a029-269b4af14148" acquired by "delete_volume" :: waited 0.019s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:24:59 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-6c852374-7cf3-4992-9158-1f6eb2b814cd tempest-AttachVolumeNegativeTest-612785929 None] Lock "cinder-5e5bbe02-787f-4127-8a1e-35c11aa0cf9c-delete_volume" released by "delete_volume" :: held 1.451s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:24:59 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[45174bd4-48a8-43c3-ab38-47bf6aff830f]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:24:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f5cb5e25-543c-4d0c-af5e-4240a1b291cc tempest-AttachVolumeNegativeTest-612785929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-901c541d-0907-40dc-a029-269b4af14148 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:24:59 devstack sudo[97277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-901c541d-0907-40dc-a029-269b4af14148 Sep 15 16:24:59 devstack sudo[97277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:24:59 devstack sudo[97274]: pam_unix(sudo:session): session closed for user root Sep 15 16:24:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-15f7e396-83ac-46a5-9915-783351ec0982 tempest-VolumesSnapshotTestJSON-999544861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21496a3e-4636-47a1-a8da-1b96049fe201 -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-21496a3e-4636-47a1-a8da-1b96049fe201.2acc67c5-0e5d-4907-946b-02ab1c471557" returned: 0 in 0.359s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:24:59 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-15f7e396-83ac-46a5-9915-783351ec0982 tempest-VolumesSnapshotTestJSON-999544861 None] /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-21496a3e-4636-47a1-a8da-1b96049fe201.2acc67c5-0e5d-4907-946b-02ab1c471557 is being set with open permissions: ugo+rw Sep 15 16:24:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-15f7e396-83ac-46a5-9915-783351ec0982 tempest-VolumesSnapshotTestJSON-999544861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-21496a3e-4636-47a1-a8da-1b96049fe201.2acc67c5-0e5d-4907-946b-02ab1c471557 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:24:59 devstack cinder-volume[86082]: DEBUG oslo_service.periodic_task [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86082) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 15 16:24:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:24:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:24:59 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:24:59 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:24:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:24:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:24:59 devstack sudo[97282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-21496a3e-4636-47a1-a8da-1b96049fe201.2acc67c5-0e5d-4907-946b-02ab1c471557 Sep 15 16:24:59 devstack sudo[97282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:24:59 devstack sudo[97284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:24:59 devstack sudo[97284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:24:59 devstack sudo[97277]: pam_unix(sudo:session): session closed for user root Sep 15 16:24:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f5cb5e25-543c-4d0c-af5e-4240a1b291cc tempest-AttachVolumeNegativeTest-612785929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-901c541d-0907-40dc-a029-269b4af14148" returned: 0 in 0.399s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:24:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f5cb5e25-543c-4d0c-af5e-4240a1b291cc tempest-AttachVolumeNegativeTest-612785929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-901c541d-0907-40dc-a029-269b4af14148 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:24:59 devstack sudo[97289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-901c541d-0907-40dc-a029-269b4af14148 Sep 15 16:24:59 devstack sudo[97289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:25:00 devstack sudo[97282]: pam_unix(sudo:session): session closed for user root Sep 15 16:25:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-15f7e396-83ac-46a5-9915-783351ec0982 tempest-VolumesSnapshotTestJSON-999544861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-21496a3e-4636-47a1-a8da-1b96049fe201.2acc67c5-0e5d-4907-946b-02ab1c471557" returned: 0 in 0.265s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:25:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-15f7e396-83ac-46a5-9915-783351ec0982 tempest-VolumesSnapshotTestJSON-999544861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-21496a3e-4636-47a1-a8da-1b96049fe201.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:25:00 devstack sudo[97284]: pam_unix(sudo:session): session closed for user root Sep 15 16:25:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.293s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:25:00 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:25:00 devstack cinder-volume[86082]: DEBUG oslo_service.periodic_task [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Running periodic task VolumeManager._thread_info {{(pid=86082) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 15 16:25:00 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] thread count: 28 {{(pid=86082) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 15 16:25:00 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] thread info: [<_MainThread(MainThread, started 124875935469696)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86082) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 15 16:25:00 devstack sudo[97293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-21496a3e-4636-47a1-a8da-1b96049fe201.info Sep 15 16:25:00 devstack sudo[97293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:25:00 devstack sudo[97289]: pam_unix(sudo:session): session closed for user root Sep 15 16:25:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f5cb5e25-543c-4d0c-af5e-4240a1b291cc tempest-AttachVolumeNegativeTest-612785929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-901c541d-0907-40dc-a029-269b4af14148" returned: 0 in 0.248s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:25:00 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f5cb5e25-543c-4d0c-af5e-4240a1b291cc tempest-AttachVolumeNegativeTest-612785929 None] Lock "cinder-quobyte-901c541d-0907-40dc-a029-269b4af14148" released by "delete_volume" :: held 0.702s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:25:00 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-f5cb5e25-543c-4d0c-af5e-4240a1b291cc tempest-AttachVolumeNegativeTest-612785929 None] Created reservations ['6976c2b5-5ad8-490a-8eec-7792e158da0e', '837b8ca2-5afe-4824-af4a-2b3d4ce50ee6', '25ea2b76-d81f-40dc-abaf-216e2b3a057b', '4cda3e79-e618-418d-9035-8086d1eae2c6'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:25:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f5cb5e25-543c-4d0c-af5e-4240a1b291cc tempest-AttachVolumeNegativeTest-612785929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:25:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f5cb5e25-543c-4d0c-af5e-4240a1b291cc tempest-AttachVolumeNegativeTest-612785929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:25:00 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-f5cb5e25-543c-4d0c-af5e-4240a1b291cc tempest-AttachVolumeNegativeTest-612785929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:25:00 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-f5cb5e25-543c-4d0c-af5e-4240a1b291cc tempest-AttachVolumeNegativeTest-612785929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:25:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f5cb5e25-543c-4d0c-af5e-4240a1b291cc tempest-AttachVolumeNegativeTest-612785929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:25:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f5cb5e25-543c-4d0c-af5e-4240a1b291cc tempest-AttachVolumeNegativeTest-612785929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:25:00 devstack sudo[97297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:25:00 devstack sudo[97297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:25:00 devstack sudo[97293]: pam_unix(sudo:session): session closed for user root Sep 15 16:25:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-15f7e396-83ac-46a5-9915-783351ec0982 tempest-VolumesSnapshotTestJSON-999544861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-21496a3e-4636-47a1-a8da-1b96049fe201.info" returned: 0 in 0.290s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:25:00 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-15f7e396-83ac-46a5-9915-783351ec0982 tempest-VolumesSnapshotTestJSON-999544861 None] /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-21496a3e-4636-47a1-a8da-1b96049fe201.info is being set with open permissions: ugo+rw Sep 15 16:25:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-15f7e396-83ac-46a5-9915-783351ec0982 tempest-VolumesSnapshotTestJSON-999544861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-21496a3e-4636-47a1-a8da-1b96049fe201.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:25:00 devstack sudo[97300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-21496a3e-4636-47a1-a8da-1b96049fe201.info Sep 15 16:25:00 devstack sudo[97300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:25:00 devstack sudo[97297]: pam_unix(sudo:session): session closed for user root Sep 15 16:25:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f5cb5e25-543c-4d0c-af5e-4240a1b291cc tempest-AttachVolumeNegativeTest-612785929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.291s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:25:00 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-f5cb5e25-543c-4d0c-af5e-4240a1b291cc tempest-AttachVolumeNegativeTest-612785929 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:25:00 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-f5cb5e25-543c-4d0c-af5e-4240a1b291cc tempest-AttachVolumeNegativeTest-612785929 None] Deleted volume successfully. Sep 15 16:25:00 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f5cb5e25-543c-4d0c-af5e-4240a1b291cc tempest-AttachVolumeNegativeTest-612785929 None] Lock "cinder-901c541d-0907-40dc-a029-269b4af14148-delete_volume" released by "delete_volume" :: held 1.236s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:25:00 devstack sudo[97300]: pam_unix(sudo:session): session closed for user root Sep 15 16:25:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-15f7e396-83ac-46a5-9915-783351ec0982 tempest-VolumesSnapshotTestJSON-999544861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-21496a3e-4636-47a1-a8da-1b96049fe201.info" returned: 0 in 0.331s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:25:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-15f7e396-83ac-46a5-9915-783351ec0982 tempest-VolumesSnapshotTestJSON-999544861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.513s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:25:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-999471e4-8ab8-43a9-b2c7-70de803935ee tempest-GroupsTest-1303038423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.335s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:25:00 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-999471e4-8ab8-43a9-b2c7-70de803935ee tempest-GroupsTest-1303038423 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=eeaad246-cae1-4956-9775-cc01632bdc44,created_at=2026-09-15T14:24:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-521969797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=eeaad246-cae1-4956-9775-cc01632bdc44,host='devstack@QuobyteHD#QuobyteHD',id=4403263f-432f-4b1e-b35f-f74b4c7936aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1435b4ecfc54357b02ef1ce92ffb671',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:24:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:24:59Z,use_quota=True,user_id='a4ba98c508d9469ea855eb139ed4cef3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2aa144be-dcb5-45d1-922d-4faa83f32e5f),volume_type_id=2aa144be-dcb5-45d1-922d-4faa83f32e5f)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:25:00 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-999471e4-8ab8-43a9-b2c7-70de803935ee tempest-GroupsTest-1303038423 None] Creating volume 4403263f-432f-4b1e-b35f-f74b4c7936aa {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:25:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-999471e4-8ab8-43a9-b2c7-70de803935ee tempest-GroupsTest-1303038423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:25:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-999471e4-8ab8-43a9-b2c7-70de803935ee tempest-GroupsTest-1303038423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:25:00 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-999471e4-8ab8-43a9-b2c7-70de803935ee tempest-GroupsTest-1303038423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:25:00 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-999471e4-8ab8-43a9-b2c7-70de803935ee tempest-GroupsTest-1303038423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:25:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-999471e4-8ab8-43a9-b2c7-70de803935ee tempest-GroupsTest-1303038423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:25:00 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-999471e4-8ab8-43a9-b2c7-70de803935ee tempest-GroupsTest-1303038423 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:25:00 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-999471e4-8ab8-43a9-b2c7-70de803935ee tempest-GroupsTest-1303038423 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:25:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-999471e4-8ab8-43a9-b2c7-70de803935ee tempest-GroupsTest-1303038423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-4403263f-432f-4b1e-b35f-f74b4c7936aa 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:25:00 devstack sudo[97309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-4403263f-432f-4b1e-b35f-f74b4c7936aa 1073741824 Sep 15 16:25:00 devstack sudo[97309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:25:00 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-15f7e396-83ac-46a5-9915-783351ec0982 tempest-VolumesSnapshotTestJSON-999544861 None] Create snapshot completed successfully Sep 15 16:25:00 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-7e05319c-fb8e-4796-b1f2-4db80c77364a tempest-AttachVolumeNegativeTest-612785929 None] Acquiring lock "cinder-e2f57520-c196-4a78-887a-f15e14f925e0-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:25:00 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-7e05319c-fb8e-4796-b1f2-4db80c77364a tempest-AttachVolumeNegativeTest-612785929 None] Lock "cinder-e2f57520-c196-4a78-887a-f15e14f925e0-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:25:00 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-7e05319c-fb8e-4796-b1f2-4db80c77364a tempest-AttachVolumeNegativeTest-612785929 None] Acquiring lock "cinder-quobyte-e2f57520-c196-4a78-887a-f15e14f925e0" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:25:00 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-7e05319c-fb8e-4796-b1f2-4db80c77364a tempest-AttachVolumeNegativeTest-612785929 None] Lock "cinder-quobyte-e2f57520-c196-4a78-887a-f15e14f925e0" acquired by "delete_volume" :: waited 0.018s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:25:01 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d3080b4-f382-4873-af08-de52edfe2909]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:25:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7e05319c-fb8e-4796-b1f2-4db80c77364a tempest-AttachVolumeNegativeTest-612785929 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-e2f57520-c196-4a78-887a-f15e14f925e0 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:25:01 devstack sudo[97314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-e2f57520-c196-4a78-887a-f15e14f925e0 Sep 15 16:25:01 devstack sudo[97314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:25:01 devstack sudo[97309]: pam_unix(sudo:session): session closed for user root Sep 15 16:25:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-999471e4-8ab8-43a9-b2c7-70de803935ee tempest-GroupsTest-1303038423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-4403263f-432f-4b1e-b35f-f74b4c7936aa 1073741824" returned: 0 in 0.582s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:25:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-999471e4-8ab8-43a9-b2c7-70de803935ee tempest-GroupsTest-1303038423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-4403263f-432f-4b1e-b35f-f74b4c7936aa {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:25:01 devstack sudo[97328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-4403263f-432f-4b1e-b35f-f74b4c7936aa Sep 15 16:25:01 devstack sudo[97328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:25:01 devstack sudo[97314]: pam_unix(sudo:session): session closed for user root Sep 15 16:25:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7e05319c-fb8e-4796-b1f2-4db80c77364a tempest-AttachVolumeNegativeTest-612785929 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-e2f57520-c196-4a78-887a-f15e14f925e0" returned: 0 in 0.458s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:25:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7e05319c-fb8e-4796-b1f2-4db80c77364a tempest-AttachVolumeNegativeTest-612785929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-e2f57520-c196-4a78-887a-f15e14f925e0 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:25:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-0ca34b9a-5c79-423f-9530-54dea2bf9850 req-fa53d5df-ec08-48ce-aa7f-badc494dc1fe tempest-TestInstancesWithCinderVolumes-1798748222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:25:01 devstack sudo[97334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-e2f57520-c196-4a78-887a-f15e14f925e0 Sep 15 16:25:01 devstack sudo[97334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:25:01 devstack sudo[97328]: pam_unix(sudo:session): session closed for user root Sep 15 16:25:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-999471e4-8ab8-43a9-b2c7-70de803935ee tempest-GroupsTest-1303038423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-4403263f-432f-4b1e-b35f-f74b4c7936aa" returned: 0 in 0.278s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:25:01 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-999471e4-8ab8-43a9-b2c7-70de803935ee tempest-GroupsTest-1303038423 None] <== create_volume: return (919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:25:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-999471e4-8ab8-43a9-b2c7-70de803935ee tempest-GroupsTest-1303038423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.923s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:25:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-0ca34b9a-5c79-423f-9530-54dea2bf9850 req-fa53d5df-ec08-48ce-aa7f-badc494dc1fe tempest-TestInstancesWithCinderVolumes-1798748222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.165s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:25:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-0ca34b9a-5c79-423f-9530-54dea2bf9850 req-fa53d5df-ec08-48ce-aa7f-badc494dc1fe tempest-TestInstancesWithCinderVolumes-1798748222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:25:01 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-999471e4-8ab8-43a9-b2c7-70de803935ee tempest-GroupsTest-1303038423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb5c7770-e6ae-4884-a219-0a8f807079c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4403263f-432f-4b1e-b35f-f74b4c7936aa', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:25:01 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-999471e4-8ab8-43a9-b2c7-70de803935ee tempest-GroupsTest-1303038423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3682627c-507c-4088-8505-1ed0cc8c675f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:25:01 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-999471e4-8ab8-43a9-b2c7-70de803935ee tempest-GroupsTest-1303038423 None] Volume volume-4403263f-432f-4b1e-b35f-f74b4c7936aa (4403263f-432f-4b1e-b35f-f74b4c7936aa): created successfully Sep 15 16:25:01 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-999471e4-8ab8-43a9-b2c7-70de803935ee tempest-GroupsTest-1303038423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3682627c-507c-4088-8505-1ed0cc8c675f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:25:01 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-999471e4-8ab8-43a9-b2c7-70de803935ee tempest-GroupsTest-1303038423 None] Flow 'volume_create_manager' (93bb26e7-97e0-43e4-b109-d19f4986a2af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:25:01 devstack sudo[97334]: pam_unix(sudo:session): session closed for user root Sep 15 16:25:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7e05319c-fb8e-4796-b1f2-4db80c77364a tempest-AttachVolumeNegativeTest-612785929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-e2f57520-c196-4a78-887a-f15e14f925e0" returned: 0 in 0.273s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:25:01 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-0ca34b9a-5c79-423f-9530-54dea2bf9850 req-fa53d5df-ec08-48ce-aa7f-badc494dc1fe tempest-TestInstancesWithCinderVolumes-1798748222 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a', 'name': 'volume-ca88091b-1150-43b1-8661-0fea45cc3e17', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b660fcfe-8bb1-447b-8b82-54e409ddac5c', 'enforce_multipath': True} {{(pid=86082) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 15 16:25:01 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-999471e4-8ab8-43a9-b2c7-70de803935ee tempest-GroupsTest-1303038423 None] Created volume successfully. Sep 15 16:25:01 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-7e05319c-fb8e-4796-b1f2-4db80c77364a tempest-AttachVolumeNegativeTest-612785929 None] Lock "cinder-quobyte-e2f57520-c196-4a78-887a-f15e14f925e0" released by "delete_volume" :: held 0.798s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:25:01 devstack cinder-volume[86082]: INFO cinder.volume.manager [req-0ca34b9a-5c79-423f-9530-54dea2bf9850 req-fa53d5df-ec08-48ce-aa7f-badc494dc1fe tempest-TestInstancesWithCinderVolumes-1798748222 None] attachment_update completed successfully. Sep 15 16:25:01 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-7e05319c-fb8e-4796-b1f2-4db80c77364a tempest-AttachVolumeNegativeTest-612785929 None] Created reservations ['66525bf7-6661-4624-b6d1-3b67aac75495', 'aa61874a-e6d2-496c-a248-a286f573639c', 'a4657694-8e78-4b6c-816b-d768c9a6b6a2', 'b51eca21-6d8b-43f6-bf69-e079d8652f05'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:25:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-7e05319c-fb8e-4796-b1f2-4db80c77364a tempest-AttachVolumeNegativeTest-612785929 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:25:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-7e05319c-fb8e-4796-b1f2-4db80c77364a tempest-AttachVolumeNegativeTest-612785929 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:25:02 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-7e05319c-fb8e-4796-b1f2-4db80c77364a tempest-AttachVolumeNegativeTest-612785929 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:25:02 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-7e05319c-fb8e-4796-b1f2-4db80c77364a tempest-AttachVolumeNegativeTest-612785929 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:25:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-7e05319c-fb8e-4796-b1f2-4db80c77364a tempest-AttachVolumeNegativeTest-612785929 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:25:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7e05319c-fb8e-4796-b1f2-4db80c77364a tempest-AttachVolumeNegativeTest-612785929 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:25:02 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-9a73cd16-3606-42b5-aace-317e63430beb tempest-VolumesSnapshotTestJSON-999544861 None] Acquiring lock "cinder-2acc67c5-0e5d-4907-946b-02ab1c471557-delete_snapshot" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:25:02 devstack sudo[97349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:25:02 devstack sudo[97349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:25:02 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-9a73cd16-3606-42b5-aace-317e63430beb tempest-VolumesSnapshotTestJSON-999544861 None] Lock "cinder-2acc67c5-0e5d-4907-946b-02ab1c471557-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:25:02 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-9a73cd16-3606-42b5-aace-317e63430beb tempest-VolumesSnapshotTestJSON-999544861 None] Acquiring lock "cinder-quobyte-21496a3e-4636-47a1-a8da-1b96049fe201" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:25:02 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-9a73cd16-3606-42b5-aace-317e63430beb tempest-VolumesSnapshotTestJSON-999544861 None] Lock "cinder-quobyte-21496a3e-4636-47a1-a8da-1b96049fe201" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:25:02 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-9a73cd16-3606-42b5-aace-317e63430beb tempest-VolumesSnapshotTestJSON-999544861 None] Acquiring lock "cinder-quobyte-2acc67c5-0e5d-4907-946b-02ab1c471557" by "_delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:25:02 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-9a73cd16-3606-42b5-aace-317e63430beb tempest-VolumesSnapshotTestJSON-999544861 None] Lock "cinder-quobyte-2acc67c5-0e5d-4907-946b-02ab1c471557" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:25:02 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-9a73cd16-3606-42b5-aace-317e63430beb tempest-VolumesSnapshotTestJSON-999544861 None] Deleting offline snapshot 2acc67c5-0e5d-4907-946b-02ab1c471557 of volume 21496a3e-4636-47a1-a8da-1b96049fe201 {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 15 16:25:02 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-9a73cd16-3606-42b5-aace-317e63430beb tempest-VolumesSnapshotTestJSON-999544861 None] snapshot_file for this snap is: volume-21496a3e-4636-47a1-a8da-1b96049fe201.2acc67c5-0e5d-4907-946b-02ab1c471557 {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 15 16:25:02 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[fda3860d-6199-4399-9359-175136ca439c]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:25:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9a73cd16-3606-42b5-aace-317e63430beb tempest-VolumesSnapshotTestJSON-999544861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-21496a3e-4636-47a1-a8da-1b96049fe201.2acc67c5-0e5d-4907-946b-02ab1c471557 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:25:02 devstack sudo[97349]: pam_unix(sudo:session): session closed for user root Sep 15 16:25:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7e05319c-fb8e-4796-b1f2-4db80c77364a tempest-AttachVolumeNegativeTest-612785929 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.379s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:25:02 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-7e05319c-fb8e-4796-b1f2-4db80c77364a tempest-AttachVolumeNegativeTest-612785929 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:25:02 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-7e05319c-fb8e-4796-b1f2-4db80c77364a tempest-AttachVolumeNegativeTest-612785929 None] Deleted volume successfully. Sep 15 16:25:02 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-7e05319c-fb8e-4796-b1f2-4db80c77364a tempest-AttachVolumeNegativeTest-612785929 None] Lock "cinder-e2f57520-c196-4a78-887a-f15e14f925e0-delete_volume" released by "delete_volume" :: held 1.527s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:25:02 devstack sudo[97430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-21496a3e-4636-47a1-a8da-1b96049fe201.2acc67c5-0e5d-4907-946b-02ab1c471557 Sep 15 16:25:02 devstack sudo[97430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:25:02 devstack sudo[97430]: pam_unix(sudo:session): session closed for user root Sep 15 16:25:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9a73cd16-3606-42b5-aace-317e63430beb tempest-VolumesSnapshotTestJSON-999544861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-21496a3e-4636-47a1-a8da-1b96049fe201.2acc67c5-0e5d-4907-946b-02ab1c471557" returned: 0 in 0.557s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:25:02 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-9a73cd16-3606-42b5-aace-317e63430beb tempest-VolumesSnapshotTestJSON-999544861 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-21496a3e-4636-47a1-a8da-1b96049fe201(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 16:25:02 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[b985e2a4-bea6-4a70-be2b-34af5eedb9e5]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:25:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9a73cd16-3606-42b5-aace-317e63430beb tempest-VolumesSnapshotTestJSON-999544861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-21496a3e-4636-47a1-a8da-1b96049fe201 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:25:02 devstack sudo[97667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-21496a3e-4636-47a1-a8da-1b96049fe201 Sep 15 16:25:02 devstack sudo[97667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:25:03 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-c93086f1-b057-44ea-859d-3868d1bf1393 tempest-GroupsTest-1303038423 None] Update group completed successfully. Sep 15 16:25:03 devstack sudo[97667]: pam_unix(sudo:session): session closed for user root Sep 15 16:25:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9a73cd16-3606-42b5-aace-317e63430beb tempest-VolumesSnapshotTestJSON-999544861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-21496a3e-4636-47a1-a8da-1b96049fe201" returned: 0 in 0.423s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:25:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9a73cd16-3606-42b5-aace-317e63430beb tempest-VolumesSnapshotTestJSON-999544861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-21496a3e-4636-47a1-a8da-1b96049fe201.2acc67c5-0e5d-4907-946b-02ab1c471557 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:25:03 devstack sudo[97682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-21496a3e-4636-47a1-a8da-1b96049fe201.2acc67c5-0e5d-4907-946b-02ab1c471557 Sep 15 16:25:03 devstack sudo[97682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:25:03 devstack sudo[97682]: pam_unix(sudo:session): session closed for user root Sep 15 16:25:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9a73cd16-3606-42b5-aace-317e63430beb tempest-VolumesSnapshotTestJSON-999544861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-21496a3e-4636-47a1-a8da-1b96049fe201.2acc67c5-0e5d-4907-946b-02ab1c471557" returned: 0 in 0.402s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:25:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9a73cd16-3606-42b5-aace-317e63430beb tempest-VolumesSnapshotTestJSON-999544861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-21496a3e-4636-47a1-a8da-1b96049fe201.2acc67c5-0e5d-4907-946b-02ab1c471557 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:25:03 devstack sudo[97691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-21496a3e-4636-47a1-a8da-1b96049fe201.2acc67c5-0e5d-4907-946b-02ab1c471557 Sep 15 16:25:03 devstack sudo[97691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:25:04 devstack sudo[97691]: pam_unix(sudo:session): session closed for user root Sep 15 16:25:04 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9a73cd16-3606-42b5-aace-317e63430beb tempest-VolumesSnapshotTestJSON-999544861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-21496a3e-4636-47a1-a8da-1b96049fe201.2acc67c5-0e5d-4907-946b-02ab1c471557" returned: 0 in 0.316s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:25:04 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-9a73cd16-3606-42b5-aace-317e63430beb tempest-VolumesSnapshotTestJSON-999544861 None] Lock "cinder-quobyte-2acc67c5-0e5d-4907-946b-02ab1c471557" released by "_delete_snapshot" :: held 1.903s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:25:04 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-9a73cd16-3606-42b5-aace-317e63430beb tempest-VolumesSnapshotTestJSON-999544861 None] Lock "cinder-quobyte-21496a3e-4636-47a1-a8da-1b96049fe201" released by "delete_snapshot" :: held 1.935s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:25:04 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-9a73cd16-3606-42b5-aace-317e63430beb tempest-VolumesSnapshotTestJSON-999544861 None] Created reservations ['db92739d-b7ff-4bc4-810f-fa9d69413d03', 'c46bf3a0-e95b-42b6-b72e-bfddac412883', 'd9f6c4e8-c0e5-4314-9d5f-f4edf8e4c530', 'c7ddf975-6141-45ba-a5c5-f364717ae3df'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:25:04 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-9a73cd16-3606-42b5-aace-317e63430beb tempest-VolumesSnapshotTestJSON-999544861 None] Delete snapshot completed successfully. Sep 15 16:25:04 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-9a73cd16-3606-42b5-aace-317e63430beb tempest-VolumesSnapshotTestJSON-999544861 None] Lock "cinder-2acc67c5-0e5d-4907-946b-02ab1c471557-delete_snapshot" released by "delete_snapshot" :: held 2.269s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:25:04 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-b74ca461-79b9-4f6b-932f-27b47c1c72ab tempest-GroupsTest-1303038423 None] Update group completed successfully. Sep 15 16:25:04 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-1c0be5a6-01a2-49b2-ab66-2dcd891732a7 req-4b3ae5b9-f62e-443b-a240-8bd170115ef7 tempest-TestInstancesWithCinderVolumes-1798748222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:25:04 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-1c0be5a6-01a2-49b2-ab66-2dcd891732a7 req-4b3ae5b9-f62e-443b-a240-8bd170115ef7 tempest-TestInstancesWithCinderVolumes-1798748222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:25:04 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-1c0be5a6-01a2-49b2-ab66-2dcd891732a7 req-4b3ae5b9-f62e-443b-a240-8bd170115ef7 tempest-TestInstancesWithCinderVolumes-1798748222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:25:04 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-1c0be5a6-01a2-49b2-ab66-2dcd891732a7 req-4b3ae5b9-f62e-443b-a240-8bd170115ef7 tempest-TestInstancesWithCinderVolumes-1798748222 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a', 'name': 'volume-0a6bf931-2c01-4b85-b693-21030ecbaccd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c8b4f0a7-525a-4428-a962-ce2221ed9584', 'enforce_multipath': True} {{(pid=86082) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 15 16:25:04 devstack cinder-volume[86082]: INFO cinder.volume.manager [req-1c0be5a6-01a2-49b2-ab66-2dcd891732a7 req-4b3ae5b9-f62e-443b-a240-8bd170115ef7 tempest-TestInstancesWithCinderVolumes-1798748222 None] attachment_update completed successfully. Sep 15 16:25:05 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6a0f921-9094-4659-ac21-a8e3cfc6f3dc tempest-VolumesSnapshotTestJSON-999544861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:25:05 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b6a0f921-9094-4659-ac21-a8e3cfc6f3dc tempest-VolumesSnapshotTestJSON-999544861 None] Flow 'volume_create_manager' (0cc8c9b8-0c09-4f1f-8345-b9a90acb6b08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:25:05 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b6a0f921-9094-4659-ac21-a8e3cfc6f3dc tempest-VolumesSnapshotTestJSON-999544861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (370e436e-20cb-4f91-9a74-6944b152d34e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:25:06 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b6a0f921-9094-4659-ac21-a8e3cfc6f3dc tempest-VolumesSnapshotTestJSON-999544861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (370e436e-20cb-4f91-9a74-6944b152d34e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:25:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-230369079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea03ccba-d5e5-4708-b5f6-bdee1d758a98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98963f0df68643a7885de5021e1b8ff4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:25:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:25:06Z,use_quota=True,user_id='274fbf9eed974fbf8903d2cfaeae0224',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:25:06 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b6a0f921-9094-4659-ac21-a8e3cfc6f3dc tempest-VolumesSnapshotTestJSON-999544861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48e28c15-24f2-419d-9fbf-dd497c78717d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:25:06 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b6a0f921-9094-4659-ac21-a8e3cfc6f3dc tempest-VolumesSnapshotTestJSON-999544861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (48e28c15-24f2-419d-9fbf-dd497c78717d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:25:06 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b6a0f921-9094-4659-ac21-a8e3cfc6f3dc tempest-VolumesSnapshotTestJSON-999544861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9776b979-0243-47cb-bbdb-e0b377c0478a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:25:06 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b6a0f921-9094-4659-ac21-a8e3cfc6f3dc tempest-VolumesSnapshotTestJSON-999544861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9776b979-0243-47cb-bbdb-e0b377c0478a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea03ccba-d5e5-4708-b5f6-bdee1d758a98', 'volume_name': 'volume-ea03ccba-d5e5-4708-b5f6-bdee1d758a98', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:25:06 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b6a0f921-9094-4659-ac21-a8e3cfc6f3dc tempest-VolumesSnapshotTestJSON-999544861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5411be10-00f2-443c-bf91-8af2af834cb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:25:06 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b6a0f921-9094-4659-ac21-a8e3cfc6f3dc tempest-VolumesSnapshotTestJSON-999544861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5411be10-00f2-443c-bf91-8af2af834cb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:25:06 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b6a0f921-9094-4659-ac21-a8e3cfc6f3dc tempest-VolumesSnapshotTestJSON-999544861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22c91b2d-34a6-4df9-b6f1-d81d384f7040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:25:06 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-b6a0f921-9094-4659-ac21-a8e3cfc6f3dc tempest-VolumesSnapshotTestJSON-999544861 None] Volume ea03ccba-d5e5-4708-b5f6-bdee1d758a98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea03ccba-d5e5-4708-b5f6-bdee1d758a98', 'volume_size': 1} Sep 15 16:25:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b6a0f921-9094-4659-ac21-a8e3cfc6f3dc tempest-VolumesSnapshotTestJSON-999544861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:25:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b6a0f921-9094-4659-ac21-a8e3cfc6f3dc tempest-VolumesSnapshotTestJSON-999544861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:25:06 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-b6a0f921-9094-4659-ac21-a8e3cfc6f3dc tempest-VolumesSnapshotTestJSON-999544861 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:25:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-230369079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea03ccba-d5e5-4708-b5f6-bdee1d758a98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98963f0df68643a7885de5021e1b8ff4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:25:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:25:06Z,use_quota=True,user_id='274fbf9eed974fbf8903d2cfaeae0224',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:25:06 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-b6a0f921-9094-4659-ac21-a8e3cfc6f3dc tempest-VolumesSnapshotTestJSON-999544861 None] Creating volume ea03ccba-d5e5-4708-b5f6-bdee1d758a98 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:25:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b6a0f921-9094-4659-ac21-a8e3cfc6f3dc tempest-VolumesSnapshotTestJSON-999544861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:25:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b6a0f921-9094-4659-ac21-a8e3cfc6f3dc tempest-VolumesSnapshotTestJSON-999544861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:25:06 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-b6a0f921-9094-4659-ac21-a8e3cfc6f3dc tempest-VolumesSnapshotTestJSON-999544861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:25:06 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-b6a0f921-9094-4659-ac21-a8e3cfc6f3dc tempest-VolumesSnapshotTestJSON-999544861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:25:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b6a0f921-9094-4659-ac21-a8e3cfc6f3dc tempest-VolumesSnapshotTestJSON-999544861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:25:06 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-b6a0f921-9094-4659-ac21-a8e3cfc6f3dc tempest-VolumesSnapshotTestJSON-999544861 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:25:06 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-b6a0f921-9094-4659-ac21-a8e3cfc6f3dc tempest-VolumesSnapshotTestJSON-999544861 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:25:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b6a0f921-9094-4659-ac21-a8e3cfc6f3dc tempest-VolumesSnapshotTestJSON-999544861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ea03ccba-d5e5-4708-b5f6-bdee1d758a98 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:25:06 devstack sudo[97719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ea03ccba-d5e5-4708-b5f6-bdee1d758a98 1073741824 Sep 15 16:25:06 devstack sudo[97719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:25:06 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-549b0c41-e691-4895-b0b1-242fb8302f7d tempest-GroupsTest-1303038423 None] Acquiring lock "cinder-quobyte-19a9fcd5-4bf5-47db-8c68-dfc6a32c8324" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:25:06 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-549b0c41-e691-4895-b0b1-242fb8302f7d tempest-GroupsTest-1303038423 None] Lock "cinder-quobyte-19a9fcd5-4bf5-47db-8c68-dfc6a32c8324" acquired by "delete_volume" :: waited 0.035s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:25:06 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff7a7475-8f93-41a5-b850-854b14764680]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:25:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-549b0c41-e691-4895-b0b1-242fb8302f7d tempest-GroupsTest-1303038423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-19a9fcd5-4bf5-47db-8c68-dfc6a32c8324 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:25:06 devstack sudo[97725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-19a9fcd5-4bf5-47db-8c68-dfc6a32c8324 Sep 15 16:25:06 devstack sudo[97725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:25:06 devstack sudo[97719]: pam_unix(sudo:session): session closed for user root Sep 15 16:25:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b6a0f921-9094-4659-ac21-a8e3cfc6f3dc tempest-VolumesSnapshotTestJSON-999544861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ea03ccba-d5e5-4708-b5f6-bdee1d758a98 1073741824" returned: 0 in 0.776s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:25:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b6a0f921-9094-4659-ac21-a8e3cfc6f3dc tempest-VolumesSnapshotTestJSON-999544861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ea03ccba-d5e5-4708-b5f6-bdee1d758a98 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:25:06 devstack sudo[97728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ea03ccba-d5e5-4708-b5f6-bdee1d758a98 Sep 15 16:25:06 devstack sudo[97728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:25:07 devstack sudo[97728]: pam_unix(sudo:session): session closed for user root Sep 15 16:25:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b6a0f921-9094-4659-ac21-a8e3cfc6f3dc tempest-VolumesSnapshotTestJSON-999544861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ea03ccba-d5e5-4708-b5f6-bdee1d758a98" returned: 0 in 0.310s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:25:07 devstack sudo[97725]: pam_unix(sudo:session): session closed for user root Sep 15 16:25:07 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-b6a0f921-9094-4659-ac21-a8e3cfc6f3dc tempest-VolumesSnapshotTestJSON-999544861 None] <== create_volume: return (1177ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:25:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b6a0f921-9094-4659-ac21-a8e3cfc6f3dc tempest-VolumesSnapshotTestJSON-999544861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.182s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:25:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-549b0c41-e691-4895-b0b1-242fb8302f7d tempest-GroupsTest-1303038423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-19a9fcd5-4bf5-47db-8c68-dfc6a32c8324" returned: 0 in 0.627s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:25:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-549b0c41-e691-4895-b0b1-242fb8302f7d tempest-GroupsTest-1303038423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-19a9fcd5-4bf5-47db-8c68-dfc6a32c8324 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:25:07 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b6a0f921-9094-4659-ac21-a8e3cfc6f3dc tempest-VolumesSnapshotTestJSON-999544861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22c91b2d-34a6-4df9-b6f1-d81d384f7040) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea03ccba-d5e5-4708-b5f6-bdee1d758a98', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:25:07 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b6a0f921-9094-4659-ac21-a8e3cfc6f3dc tempest-VolumesSnapshotTestJSON-999544861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb3a6e69-df20-404a-b754-41be951ec4f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:25:07 devstack sudo[97735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-19a9fcd5-4bf5-47db-8c68-dfc6a32c8324 Sep 15 16:25:07 devstack sudo[97735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:25:07 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-b6a0f921-9094-4659-ac21-a8e3cfc6f3dc tempest-VolumesSnapshotTestJSON-999544861 None] Volume volume-ea03ccba-d5e5-4708-b5f6-bdee1d758a98 (ea03ccba-d5e5-4708-b5f6-bdee1d758a98): created successfully Sep 15 16:25:07 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b6a0f921-9094-4659-ac21-a8e3cfc6f3dc tempest-VolumesSnapshotTestJSON-999544861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb3a6e69-df20-404a-b754-41be951ec4f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:25:07 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b6a0f921-9094-4659-ac21-a8e3cfc6f3dc tempest-VolumesSnapshotTestJSON-999544861 None] Flow 'volume_create_manager' (0cc8c9b8-0c09-4f1f-8345-b9a90acb6b08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:25:07 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-b6a0f921-9094-4659-ac21-a8e3cfc6f3dc tempest-VolumesSnapshotTestJSON-999544861 None] Created volume successfully. Sep 15 16:25:07 devstack sudo[97735]: pam_unix(sudo:session): session closed for user root Sep 15 16:25:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-549b0c41-e691-4895-b0b1-242fb8302f7d tempest-GroupsTest-1303038423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-19a9fcd5-4bf5-47db-8c68-dfc6a32c8324" returned: 0 in 0.350s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:25:07 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-549b0c41-e691-4895-b0b1-242fb8302f7d tempest-GroupsTest-1303038423 None] Lock "cinder-quobyte-19a9fcd5-4bf5-47db-8c68-dfc6a32c8324" released by "delete_volume" :: held 1.057s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:25:07 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-549b0c41-e691-4895-b0b1-242fb8302f7d tempest-GroupsTest-1303038423 None] Acquiring lock "cinder-quobyte-4403263f-432f-4b1e-b35f-f74b4c7936aa" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:25:07 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-549b0c41-e691-4895-b0b1-242fb8302f7d tempest-GroupsTest-1303038423 None] Lock "cinder-quobyte-4403263f-432f-4b1e-b35f-f74b4c7936aa" acquired by "delete_volume" :: waited 0.020s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:25:07 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[13199b6c-7b00-4333-b070-236a5fd88292]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:25:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-549b0c41-e691-4895-b0b1-242fb8302f7d tempest-GroupsTest-1303038423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-4403263f-432f-4b1e-b35f-f74b4c7936aa {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:25:07 devstack sudo[97739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-4403263f-432f-4b1e-b35f-f74b4c7936aa Sep 15 16:25:07 devstack sudo[97739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:25:08 devstack sudo[97739]: pam_unix(sudo:session): session closed for user root Sep 15 16:25:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-549b0c41-e691-4895-b0b1-242fb8302f7d tempest-GroupsTest-1303038423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-4403263f-432f-4b1e-b35f-f74b4c7936aa" returned: 0 in 0.522s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:25:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-549b0c41-e691-4895-b0b1-242fb8302f7d tempest-GroupsTest-1303038423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-4403263f-432f-4b1e-b35f-f74b4c7936aa {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:25:08 devstack sudo[97745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-4403263f-432f-4b1e-b35f-f74b4c7936aa Sep 15 16:25:08 devstack sudo[97745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:25:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-128d2a4c-da87-4f2a-aec2-68cf5b7ba902 tempest-VolumesSnapshotTestJSON-999544861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:25:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-128d2a4c-da87-4f2a-aec2-68cf5b7ba902 tempest-VolumesSnapshotTestJSON-999544861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:25:08 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-128d2a4c-da87-4f2a-aec2-68cf5b7ba902 tempest-VolumesSnapshotTestJSON-999544861 None] Creating offline snapshot dff496f9-78fb-4fc4-8ca9-a70e33e9f058 of volume ea03ccba-d5e5-4708-b5f6-bdee1d758a98 {{(pid=86082) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 15 16:25:08 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1bad1a1-e7a8-4a09-99ba-fa62a409ba47]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:25:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-128d2a4c-da87-4f2a-aec2-68cf5b7ba902 tempest-VolumesSnapshotTestJSON-999544861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ea03ccba-d5e5-4708-b5f6-bdee1d758a98 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:25:08 devstack sudo[97745]: pam_unix(sudo:session): session closed for user root Sep 15 16:25:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-549b0c41-e691-4895-b0b1-242fb8302f7d tempest-GroupsTest-1303038423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-4403263f-432f-4b1e-b35f-f74b4c7936aa" returned: 0 in 0.328s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:25:08 devstack sudo[97747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ea03ccba-d5e5-4708-b5f6-bdee1d758a98 Sep 15 16:25:08 devstack sudo[97747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:25:08 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-549b0c41-e691-4895-b0b1-242fb8302f7d tempest-GroupsTest-1303038423 None] Lock "cinder-quobyte-4403263f-432f-4b1e-b35f-f74b4c7936aa" released by "delete_volume" :: held 0.946s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:25:08 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-549b0c41-e691-4895-b0b1-242fb8302f7d tempest-GroupsTest-1303038423 None] Created reservations ['93795949-8c3f-4a9d-ae6a-1a5728e1d919'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:25:08 devstack cinder-volume[86082]: WARNING cinder.quota [None req-549b0c41-e691-4895-b0b1-242fb8302f7d tempest-GroupsTest-1303038423 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1111653000 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1111653000, it is now deprecated. Please use the default quota class for default quota. Sep 15 16:25:08 devstack cinder-volume[86082]: WARNING cinder.quota [None req-549b0c41-e691-4895-b0b1-242fb8302f7d tempest-GroupsTest-1303038423 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1111653000 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1111653000, it is now deprecated. Please use the default quota class for default quota. Sep 15 16:25:08 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-549b0c41-e691-4895-b0b1-242fb8302f7d tempest-GroupsTest-1303038423 None] Created reservations ['b31baf82-188e-436b-b62f-51836d4972d4', '00ea4c35-7da6-4f14-b1f0-0635608b29fc', 'cfe9402d-02b5-4d3a-b50d-55953b00310d', '2e957e5d-4b6e-4819-8c87-0fbb05494b81'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:25:08 devstack sudo[97747]: pam_unix(sudo:session): session closed for user root Sep 15 16:25:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-128d2a4c-da87-4f2a-aec2-68cf5b7ba902 tempest-VolumesSnapshotTestJSON-999544861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ea03ccba-d5e5-4708-b5f6-bdee1d758a98" returned: 0 in 0.471s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:25:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-128d2a4c-da87-4f2a-aec2-68cf5b7ba902 tempest-VolumesSnapshotTestJSON-999544861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ea03ccba-d5e5-4708-b5f6-bdee1d758a98,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ea03ccba-d5e5-4708-b5f6-bdee1d758a98.dff496f9-78fb-4fc4-8ca9-a70e33e9f058 1G {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:25:08 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-549b0c41-e691-4895-b0b1-242fb8302f7d tempest-GroupsTest-1303038423 None] Created reservations ['07529ea1-de5f-401b-8d9b-c75a63c3be5e', '22df3bf1-6c6c-45c6-ae60-d4a049704b49', '2cc38f40-b37f-405c-9d9e-316cbf543bf5', '0a81038d-6fcd-46f4-8de2-c73817f85656'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:25:08 devstack sudo[97757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ea03ccba-d5e5-4708-b5f6-bdee1d758a98,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ea03ccba-d5e5-4708-b5f6-bdee1d758a98.dff496f9-78fb-4fc4-8ca9-a70e33e9f058 1G Sep 15 16:25:08 devstack sudo[97757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:25:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-549b0c41-e691-4895-b0b1-242fb8302f7d tempest-GroupsTest-1303038423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:25:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-549b0c41-e691-4895-b0b1-242fb8302f7d tempest-GroupsTest-1303038423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:25:09 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-549b0c41-e691-4895-b0b1-242fb8302f7d tempest-GroupsTest-1303038423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:25:09 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-549b0c41-e691-4895-b0b1-242fb8302f7d tempest-GroupsTest-1303038423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:25:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-549b0c41-e691-4895-b0b1-242fb8302f7d tempest-GroupsTest-1303038423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:25:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-549b0c41-e691-4895-b0b1-242fb8302f7d tempest-GroupsTest-1303038423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:25:09 devstack sudo[97766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:25:09 devstack sudo[97766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:25:09 devstack sudo[97766]: pam_unix(sudo:session): session closed for user root Sep 15 16:25:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-549b0c41-e691-4895-b0b1-242fb8302f7d tempest-GroupsTest-1303038423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.369s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:25:09 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-549b0c41-e691-4895-b0b1-242fb8302f7d tempest-GroupsTest-1303038423 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:25:09 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-549b0c41-e691-4895-b0b1-242fb8302f7d tempest-GroupsTest-1303038423 None] Delete group completed successfully. Sep 15 16:25:09 devstack sudo[97757]: pam_unix(sudo:session): session closed for user root Sep 15 16:25:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-128d2a4c-da87-4f2a-aec2-68cf5b7ba902 tempest-VolumesSnapshotTestJSON-999544861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ea03ccba-d5e5-4708-b5f6-bdee1d758a98,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ea03ccba-d5e5-4708-b5f6-bdee1d758a98.dff496f9-78fb-4fc4-8ca9-a70e33e9f058 1G" returned: 0 in 0.710s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:25:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-128d2a4c-da87-4f2a-aec2-68cf5b7ba902 tempest-VolumesSnapshotTestJSON-999544861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea03ccba-d5e5-4708-b5f6-bdee1d758a98 -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ea03ccba-d5e5-4708-b5f6-bdee1d758a98.dff496f9-78fb-4fc4-8ca9-a70e33e9f058 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:25:09 devstack sudo[97781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea03ccba-d5e5-4708-b5f6-bdee1d758a98 -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ea03ccba-d5e5-4708-b5f6-bdee1d758a98.dff496f9-78fb-4fc4-8ca9-a70e33e9f058 Sep 15 16:25:09 devstack sudo[97781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:25:09 devstack sudo[97781]: pam_unix(sudo:session): session closed for user root Sep 15 16:25:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-128d2a4c-da87-4f2a-aec2-68cf5b7ba902 tempest-VolumesSnapshotTestJSON-999544861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea03ccba-d5e5-4708-b5f6-bdee1d758a98 -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ea03ccba-d5e5-4708-b5f6-bdee1d758a98.dff496f9-78fb-4fc4-8ca9-a70e33e9f058" returned: 0 in 0.337s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:25:09 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-128d2a4c-da87-4f2a-aec2-68cf5b7ba902 tempest-VolumesSnapshotTestJSON-999544861 None] /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ea03ccba-d5e5-4708-b5f6-bdee1d758a98.dff496f9-78fb-4fc4-8ca9-a70e33e9f058 is being set with open permissions: ugo+rw Sep 15 16:25:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-128d2a4c-da87-4f2a-aec2-68cf5b7ba902 tempest-VolumesSnapshotTestJSON-999544861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ea03ccba-d5e5-4708-b5f6-bdee1d758a98.dff496f9-78fb-4fc4-8ca9-a70e33e9f058 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:25:09 devstack sudo[97792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ea03ccba-d5e5-4708-b5f6-bdee1d758a98.dff496f9-78fb-4fc4-8ca9-a70e33e9f058 Sep 15 16:25:09 devstack sudo[97792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:25:10 devstack sudo[97792]: pam_unix(sudo:session): session closed for user root Sep 15 16:25:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-128d2a4c-da87-4f2a-aec2-68cf5b7ba902 tempest-VolumesSnapshotTestJSON-999544861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ea03ccba-d5e5-4708-b5f6-bdee1d758a98.dff496f9-78fb-4fc4-8ca9-a70e33e9f058" returned: 0 in 0.308s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:25:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-128d2a4c-da87-4f2a-aec2-68cf5b7ba902 tempest-VolumesSnapshotTestJSON-999544861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ea03ccba-d5e5-4708-b5f6-bdee1d758a98.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:25:10 devstack sudo[97795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ea03ccba-d5e5-4708-b5f6-bdee1d758a98.info Sep 15 16:25:10 devstack sudo[97795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:25:10 devstack sudo[97795]: pam_unix(sudo:session): session closed for user root Sep 15 16:25:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-128d2a4c-da87-4f2a-aec2-68cf5b7ba902 tempest-VolumesSnapshotTestJSON-999544861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ea03ccba-d5e5-4708-b5f6-bdee1d758a98.info" returned: 0 in 0.332s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:25:10 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-128d2a4c-da87-4f2a-aec2-68cf5b7ba902 tempest-VolumesSnapshotTestJSON-999544861 None] /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ea03ccba-d5e5-4708-b5f6-bdee1d758a98.info is being set with open permissions: ugo+rw Sep 15 16:25:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-128d2a4c-da87-4f2a-aec2-68cf5b7ba902 tempest-VolumesSnapshotTestJSON-999544861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ea03ccba-d5e5-4708-b5f6-bdee1d758a98.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:25:10 devstack sudo[97798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ea03ccba-d5e5-4708-b5f6-bdee1d758a98.info Sep 15 16:25:10 devstack sudo[97798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:25:10 devstack cinder-volume[86082]: INFO cinder.volume.manager [req-b5b3e5f3-cd3a-40be-afa6-65dea52fb20a req-2ffb71ff-9dbb-493d-b242-c6426b01e561 tempest-TestInstancesWithCinderVolumes-1798748222 None] Terminate volume connection completed successfully. Sep 15 16:25:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-b5b3e5f3-cd3a-40be-afa6-65dea52fb20a req-2ffb71ff-9dbb-493d-b242-c6426b01e561 tempest-TestInstancesWithCinderVolumes-1798748222 None] Deleting attachment b660fcfe-8bb1-447b-8b82-54e409ddac5c. {{(pid=86082) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 15 16:25:10 devstack sudo[97798]: pam_unix(sudo:session): session closed for user root Sep 15 16:25:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-128d2a4c-da87-4f2a-aec2-68cf5b7ba902 tempest-VolumesSnapshotTestJSON-999544861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ea03ccba-d5e5-4708-b5f6-bdee1d758a98.info" returned: 0 in 0.319s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:25:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-128d2a4c-da87-4f2a-aec2-68cf5b7ba902 tempest-VolumesSnapshotTestJSON-999544861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.640s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:25:11 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-128d2a4c-da87-4f2a-aec2-68cf5b7ba902 tempest-VolumesSnapshotTestJSON-999544861 None] Create snapshot completed successfully Sep 15 16:25:11 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-5055ef6e-4c06-4267-a2a6-7172644bed29 tempest-TestInstancesWithCinderVolumes-1798748222 None] Acquiring lock "cinder-ca88091b-1150-43b1-8661-0fea45cc3e17-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:25:11 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-5055ef6e-4c06-4267-a2a6-7172644bed29 tempest-TestInstancesWithCinderVolumes-1798748222 None] Lock "cinder-ca88091b-1150-43b1-8661-0fea45cc3e17-delete_volume" acquired by "delete_volume" :: waited 0.084s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:25:11 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-5055ef6e-4c06-4267-a2a6-7172644bed29 tempest-TestInstancesWithCinderVolumes-1798748222 None] Acquiring lock "cinder-quobyte-ca88091b-1150-43b1-8661-0fea45cc3e17" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:25:11 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-5055ef6e-4c06-4267-a2a6-7172644bed29 tempest-TestInstancesWithCinderVolumes-1798748222 None] Lock "cinder-quobyte-ca88091b-1150-43b1-8661-0fea45cc3e17" acquired by "delete_volume" :: waited 0.024s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:25:11 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[71a865a2-db28-402c-9aa9-e02570f20936]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:25:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5055ef6e-4c06-4267-a2a6-7172644bed29 tempest-TestInstancesWithCinderVolumes-1798748222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ca88091b-1150-43b1-8661-0fea45cc3e17 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:25:12 devstack sudo[97807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ca88091b-1150-43b1-8661-0fea45cc3e17 Sep 15 16:25:12 devstack sudo[97807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:25:12 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-740c0ae8-a76a-4306-92b8-f4cef6176cd1 tempest-VolumesSnapshotTestJSON-999544861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:25:12 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-740c0ae8-a76a-4306-92b8-f4cef6176cd1 tempest-VolumesSnapshotTestJSON-999544861 None] Flow 'volume_create_manager' (4f46f71f-1e08-487a-9b9c-6aa357b468cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:25:12 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-740c0ae8-a76a-4306-92b8-f4cef6176cd1 tempest-VolumesSnapshotTestJSON-999544861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c33180c7-f027-47e1-bce4-fb469fcc9e69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:25:12 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-740c0ae8-a76a-4306-92b8-f4cef6176cd1 tempest-VolumesSnapshotTestJSON-999544861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c33180c7-f027-47e1-bce4-fb469fcc9e69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:25:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-212899802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe181cf6-4542-41d6-9bda-0c14a9cc51eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98963f0df68643a7885de5021e1b8ff4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:25:12Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=dff496f9-78fb-4fc4-8ca9-a70e33e9f058,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:25:12Z,use_quota=True,user_id='274fbf9eed974fbf8903d2cfaeae0224',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:25:12 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-740c0ae8-a76a-4306-92b8-f4cef6176cd1 tempest-VolumesSnapshotTestJSON-999544861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc1f5adf-8a08-4052-980c-cbf4dbcda7e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:25:12 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-740c0ae8-a76a-4306-92b8-f4cef6176cd1 tempest-VolumesSnapshotTestJSON-999544861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc1f5adf-8a08-4052-980c-cbf4dbcda7e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:25:12 devstack sudo[97807]: pam_unix(sudo:session): session closed for user root Sep 15 16:25:12 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-740c0ae8-a76a-4306-92b8-f4cef6176cd1 tempest-VolumesSnapshotTestJSON-999544861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (255cb15d-12b4-4bdc-adb6-4dfb41bcb453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:25:12 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-740c0ae8-a76a-4306-92b8-f4cef6176cd1 tempest-VolumesSnapshotTestJSON-999544861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (255cb15d-12b4-4bdc-adb6-4dfb41bcb453) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'fe181cf6-4542-41d6-9bda-0c14a9cc51eb', 'volume_name': 'volume-fe181cf6-4542-41d6-9bda-0c14a9cc51eb', 'volume_size': 2, 'snapshot_id': 'dff496f9-78fb-4fc4-8ca9-a70e33e9f058'}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:25:12 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-740c0ae8-a76a-4306-92b8-f4cef6176cd1 tempest-VolumesSnapshotTestJSON-999544861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25136796-8775-4640-b223-fe47ff3f5564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:25:12 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-740c0ae8-a76a-4306-92b8-f4cef6176cd1 tempest-VolumesSnapshotTestJSON-999544861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25136796-8775-4640-b223-fe47ff3f5564) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:25:12 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-740c0ae8-a76a-4306-92b8-f4cef6176cd1 tempest-VolumesSnapshotTestJSON-999544861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4227cd9c-f7fe-4acf-8e37-4a2b06afaab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:25:12 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-740c0ae8-a76a-4306-92b8-f4cef6176cd1 tempest-VolumesSnapshotTestJSON-999544861 None] Volume fe181cf6-4542-41d6-9bda-0c14a9cc51eb: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-fe181cf6-4542-41d6-9bda-0c14a9cc51eb', 'volume_size': 2, 'snapshot_id': 'dff496f9-78fb-4fc4-8ca9-a70e33e9f058'} Sep 15 16:25:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5055ef6e-4c06-4267-a2a6-7172644bed29 tempest-TestInstancesWithCinderVolumes-1798748222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ca88091b-1150-43b1-8661-0fea45cc3e17" returned: 0 in 0.694s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:25:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5055ef6e-4c06-4267-a2a6-7172644bed29 tempest-TestInstancesWithCinderVolumes-1798748222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ca88091b-1150-43b1-8661-0fea45cc3e17 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:25:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-740c0ae8-a76a-4306-92b8-f4cef6176cd1 tempest-VolumesSnapshotTestJSON-999544861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:25:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-740c0ae8-a76a-4306-92b8-f4cef6176cd1 tempest-VolumesSnapshotTestJSON-999544861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:25:12 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-740c0ae8-a76a-4306-92b8-f4cef6176cd1 tempest-VolumesSnapshotTestJSON-999544861 None] Acquiring lock "cinder-quobyte-dff496f9-78fb-4fc4-8ca9-a70e33e9f058-fe181cf6-4542-41d6-9bda-0c14a9cc51eb" by "_create_volume_from_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:25:12 devstack sudo[97812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ca88091b-1150-43b1-8661-0fea45cc3e17 Sep 15 16:25:12 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-740c0ae8-a76a-4306-92b8-f4cef6176cd1 tempest-VolumesSnapshotTestJSON-999544861 None] Lock "cinder-quobyte-dff496f9-78fb-4fc4-8ca9-a70e33e9f058-fe181cf6-4542-41d6-9bda-0c14a9cc51eb" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:25:12 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-740c0ae8-a76a-4306-92b8-f4cef6176cd1 tempest-VolumesSnapshotTestJSON-999544861 None] Creating volume fe181cf6-4542-41d6-9bda-0c14a9cc51eb from snapshot dff496f9-78fb-4fc4-8ca9-a70e33e9f058 {{(pid=86082) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 15 16:25:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-740c0ae8-a76a-4306-92b8-f4cef6176cd1 tempest-VolumesSnapshotTestJSON-999544861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:25:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-740c0ae8-a76a-4306-92b8-f4cef6176cd1 tempest-VolumesSnapshotTestJSON-999544861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:25:12 devstack sudo[97812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:25:12 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-740c0ae8-a76a-4306-92b8-f4cef6176cd1 tempest-VolumesSnapshotTestJSON-999544861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:25:12 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-740c0ae8-a76a-4306-92b8-f4cef6176cd1 tempest-VolumesSnapshotTestJSON-999544861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:25:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-740c0ae8-a76a-4306-92b8-f4cef6176cd1 tempest-VolumesSnapshotTestJSON-999544861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:25:12 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-740c0ae8-a76a-4306-92b8-f4cef6176cd1 tempest-VolumesSnapshotTestJSON-999544861 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:25:12 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-740c0ae8-a76a-4306-92b8-f4cef6176cd1 tempest-VolumesSnapshotTestJSON-999544861 None] Acquiring lock "cinder-quobyte-fe181cf6-4542-41d6-9bda-0c14a9cc51eb" by "_copy_volume_from_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:25:12 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-740c0ae8-a76a-4306-92b8-f4cef6176cd1 tempest-VolumesSnapshotTestJSON-999544861 None] Lock "cinder-quobyte-fe181cf6-4542-41d6-9bda-0c14a9cc51eb" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:25:12 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-740c0ae8-a76a-4306-92b8-f4cef6176cd1 tempest-VolumesSnapshotTestJSON-999544861 None] snapshot: dff496f9-78fb-4fc4-8ca9-a70e33e9f058, volume: fe181cf6-4542-41d6-9bda-0c14a9cc51eb, {{(pid=86082) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 15 16:25:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-740c0ae8-a76a-4306-92b8-f4cef6176cd1 tempest-VolumesSnapshotTestJSON-999544861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:25:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-740c0ae8-a76a-4306-92b8-f4cef6176cd1 tempest-VolumesSnapshotTestJSON-999544861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:25:12 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-740c0ae8-a76a-4306-92b8-f4cef6176cd1 tempest-VolumesSnapshotTestJSON-999544861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:25:12 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-740c0ae8-a76a-4306-92b8-f4cef6176cd1 tempest-VolumesSnapshotTestJSON-999544861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:25:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-740c0ae8-a76a-4306-92b8-f4cef6176cd1 tempest-VolumesSnapshotTestJSON-999544861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:25:12 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ac75a06-f0c1-4098-aa9a-7fdd7a918556]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:25:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-740c0ae8-a76a-4306-92b8-f4cef6176cd1 tempest-VolumesSnapshotTestJSON-999544861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ea03ccba-d5e5-4708-b5f6-bdee1d758a98.dff496f9-78fb-4fc4-8ca9-a70e33e9f058 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:25:12 devstack sudo[97814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ea03ccba-d5e5-4708-b5f6-bdee1d758a98.dff496f9-78fb-4fc4-8ca9-a70e33e9f058 Sep 15 16:25:12 devstack sudo[97814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:25:12 devstack sudo[97812]: pam_unix(sudo:session): session closed for user root Sep 15 16:25:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5055ef6e-4c06-4267-a2a6-7172644bed29 tempest-TestInstancesWithCinderVolumes-1798748222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ca88091b-1150-43b1-8661-0fea45cc3e17" returned: 0 in 0.442s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:25:12 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-5055ef6e-4c06-4267-a2a6-7172644bed29 tempest-TestInstancesWithCinderVolumes-1798748222 None] Lock "cinder-quobyte-ca88091b-1150-43b1-8661-0fea45cc3e17" released by "delete_volume" :: held 1.211s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:25:13 devstack cinder-volume[86082]: WARNING cinder.quota [None req-5055ef6e-4c06-4267-a2a6-7172644bed29 tempest-TestInstancesWithCinderVolumes-1798748222 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-343594713-1773901915 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-343594713-1773901915, it is now deprecated. Please use the default quota class for default quota. Sep 15 16:25:13 devstack cinder-volume[86082]: WARNING cinder.quota [None req-5055ef6e-4c06-4267-a2a6-7172644bed29 tempest-TestInstancesWithCinderVolumes-1798748222 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-343594713-1773901915 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-343594713-1773901915, it is now deprecated. Please use the default quota class for default quota. Sep 15 16:25:13 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-5055ef6e-4c06-4267-a2a6-7172644bed29 tempest-TestInstancesWithCinderVolumes-1798748222 None] Created reservations ['388391c0-f93d-4106-aeb5-079a605ac40a', 'f4081cb8-f4e3-4168-9faf-14fe9c74263e', '998a0e17-1e2e-4477-83d6-5dabf7ddf273', '72c3b666-f07c-459e-a00a-501bd9f01df7'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:25:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-5055ef6e-4c06-4267-a2a6-7172644bed29 tempest-TestInstancesWithCinderVolumes-1798748222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:25:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-5055ef6e-4c06-4267-a2a6-7172644bed29 tempest-TestInstancesWithCinderVolumes-1798748222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:25:13 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-5055ef6e-4c06-4267-a2a6-7172644bed29 tempest-TestInstancesWithCinderVolumes-1798748222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:25:13 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-5055ef6e-4c06-4267-a2a6-7172644bed29 tempest-TestInstancesWithCinderVolumes-1798748222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:25:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-5055ef6e-4c06-4267-a2a6-7172644bed29 tempest-TestInstancesWithCinderVolumes-1798748222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:25:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5055ef6e-4c06-4267-a2a6-7172644bed29 tempest-TestInstancesWithCinderVolumes-1798748222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:25:13 devstack sudo[97904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:25:13 devstack sudo[97904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:25:13 devstack sudo[97814]: pam_unix(sudo:session): session closed for user root Sep 15 16:25:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-740c0ae8-a76a-4306-92b8-f4cef6176cd1 tempest-VolumesSnapshotTestJSON-999544861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ea03ccba-d5e5-4708-b5f6-bdee1d758a98.dff496f9-78fb-4fc4-8ca9-a70e33e9f058" returned: 0 in 0.847s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:25:13 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-740c0ae8-a76a-4306-92b8-f4cef6176cd1 tempest-VolumesSnapshotTestJSON-999544861 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ea03ccba-d5e5-4708-b5f6-bdee1d758a98(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 16:25:13 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6cd6b3b-288b-4c1e-ac11-31b107674b89]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:25:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-740c0ae8-a76a-4306-92b8-f4cef6176cd1 tempest-VolumesSnapshotTestJSON-999544861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ea03ccba-d5e5-4708-b5f6-bdee1d758a98 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:25:13 devstack sudo[97904]: pam_unix(sudo:session): session closed for user root Sep 15 16:25:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5055ef6e-4c06-4267-a2a6-7172644bed29 tempest-TestInstancesWithCinderVolumes-1798748222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.548s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:25:13 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-5055ef6e-4c06-4267-a2a6-7172644bed29 tempest-TestInstancesWithCinderVolumes-1798748222 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:25:13 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-5055ef6e-4c06-4267-a2a6-7172644bed29 tempest-TestInstancesWithCinderVolumes-1798748222 None] Deleted volume successfully. Sep 15 16:25:13 devstack sudo[97942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ea03ccba-d5e5-4708-b5f6-bdee1d758a98 Sep 15 16:25:13 devstack sudo[97942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:25:13 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-5055ef6e-4c06-4267-a2a6-7172644bed29 tempest-TestInstancesWithCinderVolumes-1798748222 None] Lock "cinder-ca88091b-1150-43b1-8661-0fea45cc3e17-delete_volume" released by "delete_volume" :: held 2.085s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:25:14 devstack sudo[97942]: pam_unix(sudo:session): session closed for user root Sep 15 16:25:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-740c0ae8-a76a-4306-92b8-f4cef6176cd1 tempest-VolumesSnapshotTestJSON-999544861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ea03ccba-d5e5-4708-b5f6-bdee1d758a98" returned: 0 in 0.573s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:25:14 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-740c0ae8-a76a-4306-92b8-f4cef6176cd1 tempest-VolumesSnapshotTestJSON-999544861 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ea03ccba-d5e5-4708-b5f6-bdee1d758a98 {{(pid=86082) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 15 16:25:14 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-740c0ae8-a76a-4306-92b8-f4cef6176cd1 tempest-VolumesSnapshotTestJSON-999544861 None] Creating direct copy from snapshot {{(pid=86082) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 15 16:25:14 devstack cinder-volume[86082]: DEBUG cinder.utils [None req-740c0ae8-a76a-4306-92b8-f4cef6176cd1 tempest-VolumesSnapshotTestJSON-999544861 None] Path /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-fe181cf6-4542-41d6-9bda-0c14a9cc51eb not found in is_blk_device check {{(pid=86082) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 15 16:25:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-740c0ae8-a76a-4306-92b8-f4cef6176cd1 tempest-VolumesSnapshotTestJSON-999544861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ea03ccba-d5e5-4708-b5f6-bdee1d758a98 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-fe181cf6-4542-41d6-9bda-0c14a9cc51eb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:25:14 devstack sudo[97950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ea03ccba-d5e5-4708-b5f6-bdee1d758a98 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-fe181cf6-4542-41d6-9bda-0c14a9cc51eb Sep 15 16:25:14 devstack sudo[97950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:25:17 devstack cinder-volume[86082]: INFO cinder.volume.manager [req-344d1b47-df20-40bf-803b-45d94cfc7c92 req-507f5903-10b4-42ac-bce8-cb5354407c74 tempest-TestInstancesWithCinderVolumes-1798748222 None] Terminate volume connection completed successfully. Sep 15 16:25:17 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-344d1b47-df20-40bf-803b-45d94cfc7c92 req-507f5903-10b4-42ac-bce8-cb5354407c74 tempest-TestInstancesWithCinderVolumes-1798748222 None] Deleting attachment c8b4f0a7-525a-4428-a962-ce2221ed9584. {{(pid=86082) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 15 16:25:17 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-957a758d-c507-4f55-a598-2715c8e3d84b tempest-TestInstancesWithCinderVolumes-1798748222 None] Acquiring lock "cinder-0a6bf931-2c01-4b85-b693-21030ecbaccd-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:25:17 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-957a758d-c507-4f55-a598-2715c8e3d84b tempest-TestInstancesWithCinderVolumes-1798748222 None] Lock "cinder-0a6bf931-2c01-4b85-b693-21030ecbaccd-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:25:18 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-957a758d-c507-4f55-a598-2715c8e3d84b tempest-TestInstancesWithCinderVolumes-1798748222 None] Acquiring lock "cinder-quobyte-0a6bf931-2c01-4b85-b693-21030ecbaccd" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:25:18 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-957a758d-c507-4f55-a598-2715c8e3d84b tempest-TestInstancesWithCinderVolumes-1798748222 None] Lock "cinder-quobyte-0a6bf931-2c01-4b85-b693-21030ecbaccd" acquired by "delete_volume" :: waited 0.025s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:25:18 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9ddd9ca-a022-468e-88b2-85479ec22f75]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:25:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-957a758d-c507-4f55-a598-2715c8e3d84b tempest-TestInstancesWithCinderVolumes-1798748222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0a6bf931-2c01-4b85-b693-21030ecbaccd {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:25:18 devstack sudo[97987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0a6bf931-2c01-4b85-b693-21030ecbaccd Sep 15 16:25:18 devstack sudo[97987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:25:19 devstack sudo[97987]: pam_unix(sudo:session): session closed for user root Sep 15 16:25:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-957a758d-c507-4f55-a598-2715c8e3d84b tempest-TestInstancesWithCinderVolumes-1798748222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0a6bf931-2c01-4b85-b693-21030ecbaccd" returned: 0 in 1.017s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:25:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-957a758d-c507-4f55-a598-2715c8e3d84b tempest-TestInstancesWithCinderVolumes-1798748222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0a6bf931-2c01-4b85-b693-21030ecbaccd {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:25:19 devstack sudo[97992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0a6bf931-2c01-4b85-b693-21030ecbaccd Sep 15 16:25:19 devstack sudo[97992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:25:19 devstack sudo[97992]: pam_unix(sudo:session): session closed for user root Sep 15 16:25:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-957a758d-c507-4f55-a598-2715c8e3d84b tempest-TestInstancesWithCinderVolumes-1798748222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0a6bf931-2c01-4b85-b693-21030ecbaccd" returned: 0 in 0.645s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:25:19 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-957a758d-c507-4f55-a598-2715c8e3d84b tempest-TestInstancesWithCinderVolumes-1798748222 None] Lock "cinder-quobyte-0a6bf931-2c01-4b85-b693-21030ecbaccd" released by "delete_volume" :: held 1.804s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:25:19 devstack cinder-volume[86082]: WARNING cinder.quota [None req-957a758d-c507-4f55-a598-2715c8e3d84b tempest-TestInstancesWithCinderVolumes-1798748222 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1498188740-271134218 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1498188740-271134218, it is now deprecated. Please use the default quota class for default quota. Sep 15 16:25:19 devstack cinder-volume[86082]: WARNING cinder.quota [None req-957a758d-c507-4f55-a598-2715c8e3d84b tempest-TestInstancesWithCinderVolumes-1798748222 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1498188740-271134218 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1498188740-271134218, it is now deprecated. Please use the default quota class for default quota. Sep 15 16:25:20 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-957a758d-c507-4f55-a598-2715c8e3d84b tempest-TestInstancesWithCinderVolumes-1798748222 None] Created reservations ['32fc432e-6828-449a-931e-2086a6a9aa6d', '384151d8-14a7-4c11-b3e3-cceee79050fd', '2b2191a5-e8e6-4753-b864-1aa7336f6686', '3c5758d4-ab40-4ac7-a551-04cec098e6ea'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:25:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-957a758d-c507-4f55-a598-2715c8e3d84b tempest-TestInstancesWithCinderVolumes-1798748222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:25:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-957a758d-c507-4f55-a598-2715c8e3d84b tempest-TestInstancesWithCinderVolumes-1798748222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:25:20 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-957a758d-c507-4f55-a598-2715c8e3d84b tempest-TestInstancesWithCinderVolumes-1798748222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:25:20 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-957a758d-c507-4f55-a598-2715c8e3d84b tempest-TestInstancesWithCinderVolumes-1798748222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:25:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-957a758d-c507-4f55-a598-2715c8e3d84b tempest-TestInstancesWithCinderVolumes-1798748222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:25:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-957a758d-c507-4f55-a598-2715c8e3d84b tempest-TestInstancesWithCinderVolumes-1798748222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:25:20 devstack sudo[97995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:25:20 devstack sudo[97995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:25:21 devstack sudo[97995]: pam_unix(sudo:session): session closed for user root Sep 15 16:25:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-957a758d-c507-4f55-a598-2715c8e3d84b tempest-TestInstancesWithCinderVolumes-1798748222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.841s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:25:21 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-957a758d-c507-4f55-a598-2715c8e3d84b tempest-TestInstancesWithCinderVolumes-1798748222 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:25:21 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-957a758d-c507-4f55-a598-2715c8e3d84b tempest-TestInstancesWithCinderVolumes-1798748222 None] Deleted volume successfully. Sep 15 16:25:21 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-957a758d-c507-4f55-a598-2715c8e3d84b tempest-TestInstancesWithCinderVolumes-1798748222 None] Lock "cinder-0a6bf931-2c01-4b85-b693-21030ecbaccd-delete_volume" released by "delete_volume" :: held 3.176s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:25:23 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-8998d792-d2ae-4fa0-8533-55536649274d tempest-GroupsV320Test-363585455 None] Group tempest-GroupsV320Test-Group-634179040: creating Sep 15 16:25:23 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-8998d792-d2ae-4fa0-8533-55536649274d tempest-GroupsV320Test-363585455 None] Group tempest-GroupsV320Test-Group-634179040: created successfully Sep 15 16:25:23 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-8998d792-d2ae-4fa0-8533-55536649274d tempest-GroupsV320Test-363585455 None] Create group completed successfully. Sep 15 16:25:23 devstack sudo[97950]: pam_unix(sudo:session): session closed for user root Sep 15 16:25:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-740c0ae8-a76a-4306-92b8-f4cef6176cd1 tempest-VolumesSnapshotTestJSON-999544861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ea03ccba-d5e5-4708-b5f6-bdee1d758a98 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-fe181cf6-4542-41d6-9bda-0c14a9cc51eb" returned: 0 in 9.309s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:25:23 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-740c0ae8-a76a-4306-92b8-f4cef6176cd1 tempest-VolumesSnapshotTestJSON-999544861 None] Image conversion details: src /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ea03ccba-d5e5-4708-b5f6-bdee1d758a98, size 1024.00 MB, duration 9.31 sec, destination /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-fe181cf6-4542-41d6-9bda-0c14a9cc51eb {{(pid=86082) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 15 16:25:23 devstack cinder-volume[86082]: INFO cinder.image.image_utils [None req-740c0ae8-a76a-4306-92b8-f4cef6176cd1 tempest-VolumesSnapshotTestJSON-999544861 None] Converted 1024.00 MB image at 109.98 MB/s Sep 15 16:25:23 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-740c0ae8-a76a-4306-92b8-f4cef6176cd1 tempest-VolumesSnapshotTestJSON-999544861 None] /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-fe181cf6-4542-41d6-9bda-0c14a9cc51eb is being set with open permissions: ugo+rw Sep 15 16:25:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-740c0ae8-a76a-4306-92b8-f4cef6176cd1 tempest-VolumesSnapshotTestJSON-999544861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-fe181cf6-4542-41d6-9bda-0c14a9cc51eb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:25:23 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-3bc7caa3-b9c0-424a-b2ed-01a46eef0750 tempest-GroupSnapshotsTest-280274705 None] Group tempest-GroupSnapshotsTest-Group-1801360108: creating Sep 15 16:25:23 devstack sudo[97999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-fe181cf6-4542-41d6-9bda-0c14a9cc51eb Sep 15 16:25:23 devstack sudo[97999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:25:23 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-3bc7caa3-b9c0-424a-b2ed-01a46eef0750 tempest-GroupSnapshotsTest-280274705 None] Group tempest-GroupSnapshotsTest-Group-1801360108: created successfully Sep 15 16:25:23 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-3bc7caa3-b9c0-424a-b2ed-01a46eef0750 tempest-GroupSnapshotsTest-280274705 None] Create group completed successfully. Sep 15 16:25:23 devstack sudo[97999]: pam_unix(sudo:session): session closed for user root Sep 15 16:25:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-740c0ae8-a76a-4306-92b8-f4cef6176cd1 tempest-VolumesSnapshotTestJSON-999544861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-fe181cf6-4542-41d6-9bda-0c14a9cc51eb" returned: 0 in 0.258s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:25:23 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-740c0ae8-a76a-4306-92b8-f4cef6176cd1 tempest-VolumesSnapshotTestJSON-999544861 None] Lock "cinder-quobyte-fe181cf6-4542-41d6-9bda-0c14a9cc51eb" released by "_copy_volume_from_snapshot" :: held 11.121s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:25:23 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-740c0ae8-a76a-4306-92b8-f4cef6176cd1 tempest-VolumesSnapshotTestJSON-999544861 None] Lock "cinder-quobyte-dff496f9-78fb-4fc4-8ca9-a70e33e9f058-fe181cf6-4542-41d6-9bda-0c14a9cc51eb" released by "_create_volume_from_snapshot" :: held 11.210s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:25:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-740c0ae8-a76a-4306-92b8-f4cef6176cd1 tempest-VolumesSnapshotTestJSON-999544861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.231s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:25:23 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-740c0ae8-a76a-4306-92b8-f4cef6176cd1 tempest-VolumesSnapshotTestJSON-999544861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4227cd9c-f7fe-4acf-8e37-4a2b06afaab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe181cf6-4542-41d6-9bda-0c14a9cc51eb', 'volume_size': 2, 'snapshot_id': 'dff496f9-78fb-4fc4-8ca9-a70e33e9f058'}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:25:23 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-740c0ae8-a76a-4306-92b8-f4cef6176cd1 tempest-VolumesSnapshotTestJSON-999544861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a367905-ba34-4f53-9b25-f13e187478fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:25:23 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-740c0ae8-a76a-4306-92b8-f4cef6176cd1 tempest-VolumesSnapshotTestJSON-999544861 None] Volume volume-fe181cf6-4542-41d6-9bda-0c14a9cc51eb (fe181cf6-4542-41d6-9bda-0c14a9cc51eb): created successfully Sep 15 16:25:23 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-740c0ae8-a76a-4306-92b8-f4cef6176cd1 tempest-VolumesSnapshotTestJSON-999544861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a367905-ba34-4f53-9b25-f13e187478fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:25:23 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-740c0ae8-a76a-4306-92b8-f4cef6176cd1 tempest-VolumesSnapshotTestJSON-999544861 None] Flow 'volume_create_manager' (4f46f71f-1e08-487a-9b9c-6aa357b468cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:25:23 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-740c0ae8-a76a-4306-92b8-f4cef6176cd1 tempest-VolumesSnapshotTestJSON-999544861 None] Created volume successfully. Sep 15 16:25:24 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-4941c654-032e-49af-a41b-edfb51c16f24 tempest-GroupsV320Test-363585455 None] Created reservations ['45c45738-f223-4b4e-a877-239e3cdda469'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:25:24 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-0fc05c73-6585-41e8-b4a7-8df30282686f tempest-VolumesSnapshotTestJSON-999544861 None] Acquiring lock "cinder-fe181cf6-4542-41d6-9bda-0c14a9cc51eb-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:25:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-4941c654-032e-49af-a41b-edfb51c16f24 tempest-GroupsV320Test-363585455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:25:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-4941c654-032e-49af-a41b-edfb51c16f24 tempest-GroupsV320Test-363585455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:25:24 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-4941c654-032e-49af-a41b-edfb51c16f24 tempest-GroupsV320Test-363585455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:25:24 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-4941c654-032e-49af-a41b-edfb51c16f24 tempest-GroupsV320Test-363585455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:25:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-4941c654-032e-49af-a41b-edfb51c16f24 tempest-GroupsV320Test-363585455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:25:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4941c654-032e-49af-a41b-edfb51c16f24 tempest-GroupsV320Test-363585455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:25:24 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-0fc05c73-6585-41e8-b4a7-8df30282686f tempest-VolumesSnapshotTestJSON-999544861 None] Lock "cinder-fe181cf6-4542-41d6-9bda-0c14a9cc51eb-delete_volume" acquired by "delete_volume" :: waited 0.083s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:25:24 devstack sudo[98007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:25:24 devstack sudo[98007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:25:25 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-0fc05c73-6585-41e8-b4a7-8df30282686f tempest-VolumesSnapshotTestJSON-999544861 None] Acquiring lock "cinder-quobyte-fe181cf6-4542-41d6-9bda-0c14a9cc51eb" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:25:25 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-0fc05c73-6585-41e8-b4a7-8df30282686f tempest-VolumesSnapshotTestJSON-999544861 None] Lock "cinder-quobyte-fe181cf6-4542-41d6-9bda-0c14a9cc51eb" acquired by "delete_volume" :: waited 0.024s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:25:25 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[8336b1fd-c590-42ba-abc8-8a135975d8fd]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:25:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0fc05c73-6585-41e8-b4a7-8df30282686f tempest-VolumesSnapshotTestJSON-999544861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-fe181cf6-4542-41d6-9bda-0c14a9cc51eb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:25:25 devstack sudo[98007]: pam_unix(sudo:session): session closed for user root Sep 15 16:25:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4941c654-032e-49af-a41b-edfb51c16f24 tempest-GroupsV320Test-363585455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.401s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:25:25 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-4941c654-032e-49af-a41b-edfb51c16f24 tempest-GroupsV320Test-363585455 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:25:25 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-4941c654-032e-49af-a41b-edfb51c16f24 tempest-GroupsV320Test-363585455 None] Delete group completed successfully. Sep 15 16:25:25 devstack sudo[98022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-fe181cf6-4542-41d6-9bda-0c14a9cc51eb Sep 15 16:25:25 devstack sudo[98022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:25:25 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-161e9f18-7ba9-4041-a360-9b0a8fdfb1cf tempest-GroupSnapshotsTest-280274705 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:25:25 devstack sudo[98022]: pam_unix(sudo:session): session closed for user root Sep 15 16:25:25 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-161e9f18-7ba9-4041-a360-9b0a8fdfb1cf tempest-GroupSnapshotsTest-280274705 None] Flow 'volume_create_manager' (4b29624e-58e8-4653-835b-9d2f9c2e16d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:25:25 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-161e9f18-7ba9-4041-a360-9b0a8fdfb1cf tempest-GroupSnapshotsTest-280274705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b00abe9-17c5-4dfd-9c86-a7d6f4715657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:25:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0fc05c73-6585-41e8-b4a7-8df30282686f tempest-VolumesSnapshotTestJSON-999544861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-fe181cf6-4542-41d6-9bda-0c14a9cc51eb" returned: 0 in 0.553s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:25:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0fc05c73-6585-41e8-b4a7-8df30282686f tempest-VolumesSnapshotTestJSON-999544861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-fe181cf6-4542-41d6-9bda-0c14a9cc51eb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:25:25 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-161e9f18-7ba9-4041-a360-9b0a8fdfb1cf tempest-GroupSnapshotsTest-280274705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b00abe9-17c5-4dfd-9c86-a7d6f4715657) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:25:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1363992588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=cb856ad6-5b89-4ebe-9e03-ef7685584458,host='devstack@QuobyteHD#QuobyteHD',id=74acef54-e046-4043-9c4e-b3efffa9170d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='293c2399eae1433ab0ed844313ad3ede',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:25:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:25:26Z,use_quota=True,user_id='f1accc1a486645fdb84f42d2c33b632e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13354f55-fb8b-4484-9948-55f066df73ca),volume_type_id=13354f55-fb8b-4484-9948-55f066df73ca)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:25:25 devstack sudo[98033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-fe181cf6-4542-41d6-9bda-0c14a9cc51eb Sep 15 16:25:25 devstack sudo[98033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:25:25 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-161e9f18-7ba9-4041-a360-9b0a8fdfb1cf tempest-GroupSnapshotsTest-280274705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9247336-ff69-4399-94f8-b626f32755c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:25:25 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-161e9f18-7ba9-4041-a360-9b0a8fdfb1cf tempest-GroupSnapshotsTest-280274705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9247336-ff69-4399-94f8-b626f32755c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:25:25 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-161e9f18-7ba9-4041-a360-9b0a8fdfb1cf tempest-GroupSnapshotsTest-280274705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa4a4488-6e6c-469a-a8cf-72e581cadb7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:25:25 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-161e9f18-7ba9-4041-a360-9b0a8fdfb1cf tempest-GroupSnapshotsTest-280274705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa4a4488-6e6c-469a-a8cf-72e581cadb7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74acef54-e046-4043-9c4e-b3efffa9170d', 'volume_name': 'volume-74acef54-e046-4043-9c4e-b3efffa9170d', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:25:25 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-161e9f18-7ba9-4041-a360-9b0a8fdfb1cf tempest-GroupSnapshotsTest-280274705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d710261-4fae-49e1-8f57-f0de3cb74dc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:25:25 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-161e9f18-7ba9-4041-a360-9b0a8fdfb1cf tempest-GroupSnapshotsTest-280274705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d710261-4fae-49e1-8f57-f0de3cb74dc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:25:25 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-161e9f18-7ba9-4041-a360-9b0a8fdfb1cf tempest-GroupSnapshotsTest-280274705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cd29280-67d1-429b-9657-50356bd7da15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:25:25 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-161e9f18-7ba9-4041-a360-9b0a8fdfb1cf tempest-GroupSnapshotsTest-280274705 None] Volume 74acef54-e046-4043-9c4e-b3efffa9170d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74acef54-e046-4043-9c4e-b3efffa9170d', 'volume_size': 1} Sep 15 16:25:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-161e9f18-7ba9-4041-a360-9b0a8fdfb1cf tempest-GroupSnapshotsTest-280274705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:25:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-161e9f18-7ba9-4041-a360-9b0a8fdfb1cf tempest-GroupSnapshotsTest-280274705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:25:25 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-161e9f18-7ba9-4041-a360-9b0a8fdfb1cf tempest-GroupSnapshotsTest-280274705 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=cb856ad6-5b89-4ebe-9e03-ef7685584458,created_at=2026-09-15T14:25:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1363992588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=cb856ad6-5b89-4ebe-9e03-ef7685584458,host='devstack@QuobyteHD#QuobyteHD',id=74acef54-e046-4043-9c4e-b3efffa9170d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='293c2399eae1433ab0ed844313ad3ede',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:25:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:25:26Z,use_quota=True,user_id='f1accc1a486645fdb84f42d2c33b632e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13354f55-fb8b-4484-9948-55f066df73ca),volume_type_id=13354f55-fb8b-4484-9948-55f066df73ca)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:25:25 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-161e9f18-7ba9-4041-a360-9b0a8fdfb1cf tempest-GroupSnapshotsTest-280274705 None] Creating volume 74acef54-e046-4043-9c4e-b3efffa9170d {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:25:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-161e9f18-7ba9-4041-a360-9b0a8fdfb1cf tempest-GroupSnapshotsTest-280274705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:25:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-161e9f18-7ba9-4041-a360-9b0a8fdfb1cf tempest-GroupSnapshotsTest-280274705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:25:25 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-161e9f18-7ba9-4041-a360-9b0a8fdfb1cf tempest-GroupSnapshotsTest-280274705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:25:25 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-161e9f18-7ba9-4041-a360-9b0a8fdfb1cf tempest-GroupSnapshotsTest-280274705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:25:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-161e9f18-7ba9-4041-a360-9b0a8fdfb1cf tempest-GroupSnapshotsTest-280274705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:25:25 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-161e9f18-7ba9-4041-a360-9b0a8fdfb1cf tempest-GroupSnapshotsTest-280274705 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:25:25 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-161e9f18-7ba9-4041-a360-9b0a8fdfb1cf tempest-GroupSnapshotsTest-280274705 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:25:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-161e9f18-7ba9-4041-a360-9b0a8fdfb1cf tempest-GroupSnapshotsTest-280274705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-74acef54-e046-4043-9c4e-b3efffa9170d 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:25:25 devstack sudo[98035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-74acef54-e046-4043-9c4e-b3efffa9170d 1073741824 Sep 15 16:25:25 devstack sudo[98035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:25:26 devstack sudo[98033]: pam_unix(sudo:session): session closed for user root Sep 15 16:25:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0fc05c73-6585-41e8-b4a7-8df30282686f tempest-VolumesSnapshotTestJSON-999544861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-fe181cf6-4542-41d6-9bda-0c14a9cc51eb" returned: 0 in 0.401s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:25:26 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-0fc05c73-6585-41e8-b4a7-8df30282686f tempest-VolumesSnapshotTestJSON-999544861 None] Lock "cinder-quobyte-fe181cf6-4542-41d6-9bda-0c14a9cc51eb" released by "delete_volume" :: held 1.104s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:25:26 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-0fc05c73-6585-41e8-b4a7-8df30282686f tempest-VolumesSnapshotTestJSON-999544861 None] Created reservations ['e3b49817-4ede-46b7-9dde-81bf5d687770', '1380b50c-8ee4-4c60-9375-4b2ec7016674', '36eba3e7-2042-4237-8e90-4c930fc8b1b6', '7598b7c9-9b62-453b-b3da-cbed8c38e5d8'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:25:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-0fc05c73-6585-41e8-b4a7-8df30282686f tempest-VolumesSnapshotTestJSON-999544861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:25:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-0fc05c73-6585-41e8-b4a7-8df30282686f tempest-VolumesSnapshotTestJSON-999544861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:25:26 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-0fc05c73-6585-41e8-b4a7-8df30282686f tempest-VolumesSnapshotTestJSON-999544861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:25:26 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-0fc05c73-6585-41e8-b4a7-8df30282686f tempest-VolumesSnapshotTestJSON-999544861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:25:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-0fc05c73-6585-41e8-b4a7-8df30282686f tempest-VolumesSnapshotTestJSON-999544861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:25:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0fc05c73-6585-41e8-b4a7-8df30282686f tempest-VolumesSnapshotTestJSON-999544861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:25:26 devstack sudo[98042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:25:26 devstack sudo[98042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:25:26 devstack sudo[98035]: pam_unix(sudo:session): session closed for user root Sep 15 16:25:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-161e9f18-7ba9-4041-a360-9b0a8fdfb1cf tempest-GroupSnapshotsTest-280274705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-74acef54-e046-4043-9c4e-b3efffa9170d 1073741824" returned: 0 in 0.734s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:25:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-161e9f18-7ba9-4041-a360-9b0a8fdfb1cf tempest-GroupSnapshotsTest-280274705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-74acef54-e046-4043-9c4e-b3efffa9170d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:25:26 devstack sudo[98042]: pam_unix(sudo:session): session closed for user root Sep 15 16:25:26 devstack sudo[98048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-74acef54-e046-4043-9c4e-b3efffa9170d Sep 15 16:25:26 devstack sudo[98048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:25:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0fc05c73-6585-41e8-b4a7-8df30282686f tempest-VolumesSnapshotTestJSON-999544861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.381s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:25:26 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-0fc05c73-6585-41e8-b4a7-8df30282686f tempest-VolumesSnapshotTestJSON-999544861 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:25:26 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-0fc05c73-6585-41e8-b4a7-8df30282686f tempest-VolumesSnapshotTestJSON-999544861 None] Deleted volume successfully. Sep 15 16:25:26 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-0fc05c73-6585-41e8-b4a7-8df30282686f tempest-VolumesSnapshotTestJSON-999544861 None] Lock "cinder-fe181cf6-4542-41d6-9bda-0c14a9cc51eb-delete_volume" released by "delete_volume" :: held 1.811s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:25:26 devstack cinder-volume[86082]: INFO cinder.volume.manager [req-eee98ec3-4d10-4257-bdfa-5327dea2768c req-88050510-4462-4a2c-848c-a325f2f103f3 tempest-TestInstancesWithCinderVolumes-1798748222 None] Terminate volume connection completed successfully. Sep 15 16:25:26 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-eee98ec3-4d10-4257-bdfa-5327dea2768c req-88050510-4462-4a2c-848c-a325f2f103f3 tempest-TestInstancesWithCinderVolumes-1798748222 None] Deleting attachment a00dc9a7-41dc-4bc5-bb9f-0e151d29c5be. {{(pid=86082) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 15 16:25:26 devstack sudo[98048]: pam_unix(sudo:session): session closed for user root Sep 15 16:25:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-161e9f18-7ba9-4041-a360-9b0a8fdfb1cf tempest-GroupSnapshotsTest-280274705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-74acef54-e046-4043-9c4e-b3efffa9170d" returned: 0 in 0.317s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:25:26 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-161e9f18-7ba9-4041-a360-9b0a8fdfb1cf tempest-GroupSnapshotsTest-280274705 None] <== create_volume: return (1130ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:25:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-161e9f18-7ba9-4041-a360-9b0a8fdfb1cf tempest-GroupSnapshotsTest-280274705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.134s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:25:27 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-161e9f18-7ba9-4041-a360-9b0a8fdfb1cf tempest-GroupSnapshotsTest-280274705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cd29280-67d1-429b-9657-50356bd7da15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74acef54-e046-4043-9c4e-b3efffa9170d', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:25:27 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-161e9f18-7ba9-4041-a360-9b0a8fdfb1cf tempest-GroupSnapshotsTest-280274705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f532c14b-9db4-4ccc-89e9-6fc9c8ea62c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:25:27 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-161e9f18-7ba9-4041-a360-9b0a8fdfb1cf tempest-GroupSnapshotsTest-280274705 None] Volume volume-74acef54-e046-4043-9c4e-b3efffa9170d (74acef54-e046-4043-9c4e-b3efffa9170d): created successfully Sep 15 16:25:27 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-161e9f18-7ba9-4041-a360-9b0a8fdfb1cf tempest-GroupSnapshotsTest-280274705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f532c14b-9db4-4ccc-89e9-6fc9c8ea62c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:25:27 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-161e9f18-7ba9-4041-a360-9b0a8fdfb1cf tempest-GroupSnapshotsTest-280274705 None] Flow 'volume_create_manager' (4b29624e-58e8-4653-835b-9d2f9c2e16d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:25:27 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-161e9f18-7ba9-4041-a360-9b0a8fdfb1cf tempest-GroupSnapshotsTest-280274705 None] Created volume successfully. Sep 15 16:25:27 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-bad1e440-940b-4ca3-82a6-2622f6038593 tempest-VolumesSnapshotTestJSON-999544861 None] Acquiring lock "cinder-dff496f9-78fb-4fc4-8ca9-a70e33e9f058-delete_snapshot" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:25:27 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-bad1e440-940b-4ca3-82a6-2622f6038593 tempest-VolumesSnapshotTestJSON-999544861 None] Lock "cinder-dff496f9-78fb-4fc4-8ca9-a70e33e9f058-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:25:27 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-bad1e440-940b-4ca3-82a6-2622f6038593 tempest-VolumesSnapshotTestJSON-999544861 None] Acquiring lock "cinder-quobyte-ea03ccba-d5e5-4708-b5f6-bdee1d758a98" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:25:27 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-bad1e440-940b-4ca3-82a6-2622f6038593 tempest-VolumesSnapshotTestJSON-999544861 None] Lock "cinder-quobyte-ea03ccba-d5e5-4708-b5f6-bdee1d758a98" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:25:27 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-bad1e440-940b-4ca3-82a6-2622f6038593 tempest-VolumesSnapshotTestJSON-999544861 None] Acquiring lock "cinder-quobyte-dff496f9-78fb-4fc4-8ca9-a70e33e9f058" by "_delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:25:27 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-bad1e440-940b-4ca3-82a6-2622f6038593 tempest-VolumesSnapshotTestJSON-999544861 None] Lock "cinder-quobyte-dff496f9-78fb-4fc4-8ca9-a70e33e9f058" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:25:27 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-bad1e440-940b-4ca3-82a6-2622f6038593 tempest-VolumesSnapshotTestJSON-999544861 None] Deleting offline snapshot dff496f9-78fb-4fc4-8ca9-a70e33e9f058 of volume ea03ccba-d5e5-4708-b5f6-bdee1d758a98 {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 15 16:25:27 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-bad1e440-940b-4ca3-82a6-2622f6038593 tempest-VolumesSnapshotTestJSON-999544861 None] snapshot_file for this snap is: volume-ea03ccba-d5e5-4708-b5f6-bdee1d758a98.dff496f9-78fb-4fc4-8ca9-a70e33e9f058 {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 15 16:25:27 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[587e8e52-abfc-4a80-ab42-e2e3d6325f3e]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:25:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-bad1e440-940b-4ca3-82a6-2622f6038593 tempest-VolumesSnapshotTestJSON-999544861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ea03ccba-d5e5-4708-b5f6-bdee1d758a98.dff496f9-78fb-4fc4-8ca9-a70e33e9f058 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:25:27 devstack sudo[98051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ea03ccba-d5e5-4708-b5f6-bdee1d758a98.dff496f9-78fb-4fc4-8ca9-a70e33e9f058 Sep 15 16:25:27 devstack sudo[98051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:25:27 devstack sudo[98051]: pam_unix(sudo:session): session closed for user root Sep 15 16:25:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-bad1e440-940b-4ca3-82a6-2622f6038593 tempest-VolumesSnapshotTestJSON-999544861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ea03ccba-d5e5-4708-b5f6-bdee1d758a98.dff496f9-78fb-4fc4-8ca9-a70e33e9f058" returned: 0 in 0.446s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:25:27 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-bad1e440-940b-4ca3-82a6-2622f6038593 tempest-VolumesSnapshotTestJSON-999544861 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ea03ccba-d5e5-4708-b5f6-bdee1d758a98(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 16:25:27 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[85243454-8ecc-439a-b051-04fa3237cddd]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:25:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-bad1e440-940b-4ca3-82a6-2622f6038593 tempest-VolumesSnapshotTestJSON-999544861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ea03ccba-d5e5-4708-b5f6-bdee1d758a98 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:25:27 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-3e7ef465-4d2e-490f-9df5-e26735b9acdb tempest-TestInstancesWithCinderVolumes-1798748222 None] Acquiring lock "cinder-f2510a23-d973-45ae-91fa-e844869e3e69-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:25:27 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-3e7ef465-4d2e-490f-9df5-e26735b9acdb tempest-TestInstancesWithCinderVolumes-1798748222 None] Lock "cinder-f2510a23-d973-45ae-91fa-e844869e3e69-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:25:27 devstack sudo[98057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ea03ccba-d5e5-4708-b5f6-bdee1d758a98 Sep 15 16:25:27 devstack sudo[98057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:25:27 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-3e7ef465-4d2e-490f-9df5-e26735b9acdb tempest-TestInstancesWithCinderVolumes-1798748222 None] Acquiring lock "cinder-quobyte-f2510a23-d973-45ae-91fa-e844869e3e69" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:25:28 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-3e7ef465-4d2e-490f-9df5-e26735b9acdb tempest-TestInstancesWithCinderVolumes-1798748222 None] Lock "cinder-quobyte-f2510a23-d973-45ae-91fa-e844869e3e69" acquired by "delete_volume" :: waited 0.025s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:25:28 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e7e1232-48e2-4d0f-bebd-71c71a9fdd04]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:25:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3e7ef465-4d2e-490f-9df5-e26735b9acdb tempest-TestInstancesWithCinderVolumes-1798748222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-f2510a23-d973-45ae-91fa-e844869e3e69 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:25:28 devstack sudo[98059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-f2510a23-d973-45ae-91fa-e844869e3e69 Sep 15 16:25:28 devstack sudo[98059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:25:28 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-fdc2741e-180d-43a6-b48c-0b589f7c85a3 tempest-GroupSnapshotsTest-280274705 None] GroupSnapshot 9c673591-baef-4b45-9744-2bfb28c5d72d: creating. Sep 15 16:25:28 devstack sudo[98057]: pam_unix(sudo:session): session closed for user root Sep 15 16:25:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-bad1e440-940b-4ca3-82a6-2622f6038593 tempest-VolumesSnapshotTestJSON-999544861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ea03ccba-d5e5-4708-b5f6-bdee1d758a98" returned: 0 in 0.658s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:25:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-bad1e440-940b-4ca3-82a6-2622f6038593 tempest-VolumesSnapshotTestJSON-999544861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ea03ccba-d5e5-4708-b5f6-bdee1d758a98.dff496f9-78fb-4fc4-8ca9-a70e33e9f058 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:25:28 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-fdc2741e-180d-43a6-b48c-0b589f7c85a3 tempest-GroupSnapshotsTest-280274705 None] Group snapshot 9c673591-baef-4b45-9744-2bfb28c5d72d: creating. {{(pid=86082) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 15 16:25:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-fdc2741e-180d-43a6-b48c-0b589f7c85a3 tempest-GroupSnapshotsTest-280274705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:25:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-fdc2741e-180d-43a6-b48c-0b589f7c85a3 tempest-GroupSnapshotsTest-280274705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:25:28 devstack sudo[98064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ea03ccba-d5e5-4708-b5f6-bdee1d758a98.dff496f9-78fb-4fc4-8ca9-a70e33e9f058 Sep 15 16:25:28 devstack sudo[98064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:25:28 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-fdc2741e-180d-43a6-b48c-0b589f7c85a3 tempest-GroupSnapshotsTest-280274705 None] Creating offline snapshot affe1081-f831-406f-a6ab-14ff89e9a7de of volume 74acef54-e046-4043-9c4e-b3efffa9170d {{(pid=86082) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 15 16:25:28 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[579c2769-38ff-4653-89ca-ad1b0847710e]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:25:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-fdc2741e-180d-43a6-b48c-0b589f7c85a3 tempest-GroupSnapshotsTest-280274705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-74acef54-e046-4043-9c4e-b3efffa9170d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:25:28 devstack sudo[98059]: pam_unix(sudo:session): session closed for user root Sep 15 16:25:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3e7ef465-4d2e-490f-9df5-e26735b9acdb tempest-TestInstancesWithCinderVolumes-1798748222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-f2510a23-d973-45ae-91fa-e844869e3e69" returned: 0 in 0.557s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:25:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3e7ef465-4d2e-490f-9df5-e26735b9acdb tempest-TestInstancesWithCinderVolumes-1798748222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-f2510a23-d973-45ae-91fa-e844869e3e69 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:25:28 devstack sudo[98070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-f2510a23-d973-45ae-91fa-e844869e3e69 Sep 15 16:25:28 devstack sudo[98070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:25:28 devstack sudo[98069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-74acef54-e046-4043-9c4e-b3efffa9170d Sep 15 16:25:28 devstack sudo[98069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:25:28 devstack sudo[98064]: pam_unix(sudo:session): session closed for user root Sep 15 16:25:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-bad1e440-940b-4ca3-82a6-2622f6038593 tempest-VolumesSnapshotTestJSON-999544861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ea03ccba-d5e5-4708-b5f6-bdee1d758a98.dff496f9-78fb-4fc4-8ca9-a70e33e9f058" returned: 0 in 0.441s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:25:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-bad1e440-940b-4ca3-82a6-2622f6038593 tempest-VolumesSnapshotTestJSON-999544861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ea03ccba-d5e5-4708-b5f6-bdee1d758a98.dff496f9-78fb-4fc4-8ca9-a70e33e9f058 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:25:28 devstack sudo[98079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ea03ccba-d5e5-4708-b5f6-bdee1d758a98.dff496f9-78fb-4fc4-8ca9-a70e33e9f058 Sep 15 16:25:28 devstack sudo[98079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:25:28 devstack sudo[98070]: pam_unix(sudo:session): session closed for user root Sep 15 16:25:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3e7ef465-4d2e-490f-9df5-e26735b9acdb tempest-TestInstancesWithCinderVolumes-1798748222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-f2510a23-d973-45ae-91fa-e844869e3e69" returned: 0 in 0.353s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:25:29 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-3e7ef465-4d2e-490f-9df5-e26735b9acdb tempest-TestInstancesWithCinderVolumes-1798748222 None] Lock "cinder-quobyte-f2510a23-d973-45ae-91fa-e844869e3e69" released by "delete_volume" :: held 0.997s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:25:29 devstack cinder-volume[86082]: WARNING cinder.quota [None req-3e7ef465-4d2e-490f-9df5-e26735b9acdb tempest-TestInstancesWithCinderVolumes-1798748222 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-610863133-1074341395 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-610863133-1074341395, it is now deprecated. Please use the default quota class for default quota. Sep 15 16:25:29 devstack cinder-volume[86082]: WARNING cinder.quota [None req-3e7ef465-4d2e-490f-9df5-e26735b9acdb tempest-TestInstancesWithCinderVolumes-1798748222 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-610863133-1074341395 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-610863133-1074341395, it is now deprecated. Please use the default quota class for default quota. Sep 15 16:25:29 devstack sudo[98069]: pam_unix(sudo:session): session closed for user root Sep 15 16:25:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-fdc2741e-180d-43a6-b48c-0b589f7c85a3 tempest-GroupSnapshotsTest-280274705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-74acef54-e046-4043-9c4e-b3efffa9170d" returned: 0 in 0.494s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:25:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-fdc2741e-180d-43a6-b48c-0b589f7c85a3 tempest-GroupSnapshotsTest-280274705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-74acef54-e046-4043-9c4e-b3efffa9170d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-74acef54-e046-4043-9c4e-b3efffa9170d.affe1081-f831-406f-a6ab-14ff89e9a7de 1G {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:25:29 devstack sudo[98083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-74acef54-e046-4043-9c4e-b3efffa9170d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-74acef54-e046-4043-9c4e-b3efffa9170d.affe1081-f831-406f-a6ab-14ff89e9a7de 1G Sep 15 16:25:29 devstack sudo[98083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:25:29 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-3e7ef465-4d2e-490f-9df5-e26735b9acdb tempest-TestInstancesWithCinderVolumes-1798748222 None] Created reservations ['67471a00-6d73-4d56-a16e-1a49c4745bbe', 'b5a54c0f-f35d-4f9d-b4c9-25a34c118b23', 'f8742c02-32dc-401a-8617-278e99952d7e', '17afc05d-5145-4032-9e37-7306d676dd06'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:25:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-3e7ef465-4d2e-490f-9df5-e26735b9acdb tempest-TestInstancesWithCinderVolumes-1798748222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:25:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-3e7ef465-4d2e-490f-9df5-e26735b9acdb tempest-TestInstancesWithCinderVolumes-1798748222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:25:29 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-3e7ef465-4d2e-490f-9df5-e26735b9acdb tempest-TestInstancesWithCinderVolumes-1798748222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:25:29 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-3e7ef465-4d2e-490f-9df5-e26735b9acdb tempest-TestInstancesWithCinderVolumes-1798748222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:25:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-3e7ef465-4d2e-490f-9df5-e26735b9acdb tempest-TestInstancesWithCinderVolumes-1798748222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:25:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3e7ef465-4d2e-490f-9df5-e26735b9acdb tempest-TestInstancesWithCinderVolumes-1798748222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:25:29 devstack sudo[98079]: pam_unix(sudo:session): session closed for user root Sep 15 16:25:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-bad1e440-940b-4ca3-82a6-2622f6038593 tempest-VolumesSnapshotTestJSON-999544861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ea03ccba-d5e5-4708-b5f6-bdee1d758a98.dff496f9-78fb-4fc4-8ca9-a70e33e9f058" returned: 0 in 0.297s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:25:29 devstack sudo[98086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:25:29 devstack sudo[98086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:25:29 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-bad1e440-940b-4ca3-82a6-2622f6038593 tempest-VolumesSnapshotTestJSON-999544861 None] Lock "cinder-quobyte-dff496f9-78fb-4fc4-8ca9-a70e33e9f058" released by "_delete_snapshot" :: held 1.999s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:25:29 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-bad1e440-940b-4ca3-82a6-2622f6038593 tempest-VolumesSnapshotTestJSON-999544861 None] Lock "cinder-quobyte-ea03ccba-d5e5-4708-b5f6-bdee1d758a98" released by "delete_snapshot" :: held 2.033s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:25:29 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-bad1e440-940b-4ca3-82a6-2622f6038593 tempest-VolumesSnapshotTestJSON-999544861 None] Created reservations ['aa3e2e2c-571f-42ee-bc5e-4e7f651d1c10', 'be223b84-4a47-4d80-8eaa-6e74f1ecbcba', 'd51322a5-fa4c-45cc-ab51-5294a01f1639', 'e17d8ffc-b531-4aa3-a798-d023ceb2a393'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:25:29 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-bad1e440-940b-4ca3-82a6-2622f6038593 tempest-VolumesSnapshotTestJSON-999544861 None] Delete snapshot completed successfully. Sep 15 16:25:29 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-bad1e440-940b-4ca3-82a6-2622f6038593 tempest-VolumesSnapshotTestJSON-999544861 None] Lock "cinder-dff496f9-78fb-4fc4-8ca9-a70e33e9f058-delete_snapshot" released by "delete_snapshot" :: held 2.243s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:25:29 devstack sudo[98086]: pam_unix(sudo:session): session closed for user root Sep 15 16:25:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3e7ef465-4d2e-490f-9df5-e26735b9acdb tempest-TestInstancesWithCinderVolumes-1798748222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.314s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:25:29 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-3e7ef465-4d2e-490f-9df5-e26735b9acdb tempest-TestInstancesWithCinderVolumes-1798748222 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:25:29 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-3e7ef465-4d2e-490f-9df5-e26735b9acdb tempest-TestInstancesWithCinderVolumes-1798748222 None] Deleted volume successfully. Sep 15 16:25:29 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-3e7ef465-4d2e-490f-9df5-e26735b9acdb tempest-TestInstancesWithCinderVolumes-1798748222 None] Lock "cinder-f2510a23-d973-45ae-91fa-e844869e3e69-delete_volume" released by "delete_volume" :: held 1.642s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:25:29 devstack sudo[98083]: pam_unix(sudo:session): session closed for user root Sep 15 16:25:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-fdc2741e-180d-43a6-b48c-0b589f7c85a3 tempest-GroupSnapshotsTest-280274705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-74acef54-e046-4043-9c4e-b3efffa9170d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-74acef54-e046-4043-9c4e-b3efffa9170d.affe1081-f831-406f-a6ab-14ff89e9a7de 1G" returned: 0 in 0.583s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:25:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-fdc2741e-180d-43a6-b48c-0b589f7c85a3 tempest-GroupSnapshotsTest-280274705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74acef54-e046-4043-9c4e-b3efffa9170d -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-74acef54-e046-4043-9c4e-b3efffa9170d.affe1081-f831-406f-a6ab-14ff89e9a7de {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:25:29 devstack sudo[98093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74acef54-e046-4043-9c4e-b3efffa9170d -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-74acef54-e046-4043-9c4e-b3efffa9170d.affe1081-f831-406f-a6ab-14ff89e9a7de Sep 15 16:25:29 devstack sudo[98093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:25:29 devstack sudo[98093]: pam_unix(sudo:session): session closed for user root Sep 15 16:25:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-fdc2741e-180d-43a6-b48c-0b589f7c85a3 tempest-GroupSnapshotsTest-280274705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-74acef54-e046-4043-9c4e-b3efffa9170d -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-74acef54-e046-4043-9c4e-b3efffa9170d.affe1081-f831-406f-a6ab-14ff89e9a7de" returned: 0 in 0.303s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:25:29 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-fdc2741e-180d-43a6-b48c-0b589f7c85a3 tempest-GroupSnapshotsTest-280274705 None] /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-74acef54-e046-4043-9c4e-b3efffa9170d.affe1081-f831-406f-a6ab-14ff89e9a7de is being set with open permissions: ugo+rw: NotImplementedError Sep 15 16:25:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-fdc2741e-180d-43a6-b48c-0b589f7c85a3 tempest-GroupSnapshotsTest-280274705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-74acef54-e046-4043-9c4e-b3efffa9170d.affe1081-f831-406f-a6ab-14ff89e9a7de {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:25:29 devstack sudo[98099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-74acef54-e046-4043-9c4e-b3efffa9170d.affe1081-f831-406f-a6ab-14ff89e9a7de Sep 15 16:25:29 devstack sudo[98099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:25:30 devstack sudo[98099]: pam_unix(sudo:session): session closed for user root Sep 15 16:25:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-fdc2741e-180d-43a6-b48c-0b589f7c85a3 tempest-GroupSnapshotsTest-280274705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-74acef54-e046-4043-9c4e-b3efffa9170d.affe1081-f831-406f-a6ab-14ff89e9a7de" returned: 0 in 0.257s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:25:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-fdc2741e-180d-43a6-b48c-0b589f7c85a3 tempest-GroupSnapshotsTest-280274705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-74acef54-e046-4043-9c4e-b3efffa9170d.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:25:30 devstack sudo[98102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-74acef54-e046-4043-9c4e-b3efffa9170d.info Sep 15 16:25:30 devstack sudo[98102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:25:30 devstack sudo[98102]: pam_unix(sudo:session): session closed for user root Sep 15 16:25:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-fdc2741e-180d-43a6-b48c-0b589f7c85a3 tempest-GroupSnapshotsTest-280274705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-74acef54-e046-4043-9c4e-b3efffa9170d.info" returned: 0 in 0.301s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:25:30 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-fdc2741e-180d-43a6-b48c-0b589f7c85a3 tempest-GroupSnapshotsTest-280274705 None] /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-74acef54-e046-4043-9c4e-b3efffa9170d.info is being set with open permissions: ugo+rw: NotImplementedError Sep 15 16:25:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-fdc2741e-180d-43a6-b48c-0b589f7c85a3 tempest-GroupSnapshotsTest-280274705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-74acef54-e046-4043-9c4e-b3efffa9170d.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:25:30 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-a936e710-4b4d-4fb8-beef-22afee5f589b tempest-VolumesSnapshotTestJSON-999544861 None] Acquiring lock "cinder-ea03ccba-d5e5-4708-b5f6-bdee1d758a98-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:25:30 devstack sudo[98105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-74acef54-e046-4043-9c4e-b3efffa9170d.info Sep 15 16:25:30 devstack sudo[98105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:25:30 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-a936e710-4b4d-4fb8-beef-22afee5f589b tempest-VolumesSnapshotTestJSON-999544861 None] Lock "cinder-ea03ccba-d5e5-4708-b5f6-bdee1d758a98-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:25:30 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-a936e710-4b4d-4fb8-beef-22afee5f589b tempest-VolumesSnapshotTestJSON-999544861 None] Acquiring lock "cinder-quobyte-ea03ccba-d5e5-4708-b5f6-bdee1d758a98" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:25:30 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-a936e710-4b4d-4fb8-beef-22afee5f589b tempest-VolumesSnapshotTestJSON-999544861 None] Lock "cinder-quobyte-ea03ccba-d5e5-4708-b5f6-bdee1d758a98" acquired by "delete_volume" :: waited 0.023s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:25:30 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ac0c730-7d5f-4a92-94c0-a73f1197abf3]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:25:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a936e710-4b4d-4fb8-beef-22afee5f589b tempest-VolumesSnapshotTestJSON-999544861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ea03ccba-d5e5-4708-b5f6-bdee1d758a98 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:25:30 devstack sudo[98107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ea03ccba-d5e5-4708-b5f6-bdee1d758a98 Sep 15 16:25:30 devstack sudo[98107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:25:30 devstack sudo[98105]: pam_unix(sudo:session): session closed for user root Sep 15 16:25:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-fdc2741e-180d-43a6-b48c-0b589f7c85a3 tempest-GroupSnapshotsTest-280274705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-74acef54-e046-4043-9c4e-b3efffa9170d.info" returned: 0 in 0.390s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:25:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-fdc2741e-180d-43a6-b48c-0b589f7c85a3 tempest-GroupSnapshotsTest-280274705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.463s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:25:31 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-fdc2741e-180d-43a6-b48c-0b589f7c85a3 tempest-GroupSnapshotsTest-280274705 None] group_snapshot 9c673591-baef-4b45-9744-2bfb28c5d72d: created successfully Sep 15 16:25:31 devstack sudo[98107]: pam_unix(sudo:session): session closed for user root Sep 15 16:25:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a936e710-4b4d-4fb8-beef-22afee5f589b tempest-VolumesSnapshotTestJSON-999544861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ea03ccba-d5e5-4708-b5f6-bdee1d758a98" returned: 0 in 0.434s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:25:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a936e710-4b4d-4fb8-beef-22afee5f589b tempest-VolumesSnapshotTestJSON-999544861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ea03ccba-d5e5-4708-b5f6-bdee1d758a98 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:25:31 devstack sudo[98119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ea03ccba-d5e5-4708-b5f6-bdee1d758a98 Sep 15 16:25:31 devstack sudo[98119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:25:31 devstack sudo[98119]: pam_unix(sudo:session): session closed for user root Sep 15 16:25:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a936e710-4b4d-4fb8-beef-22afee5f589b tempest-VolumesSnapshotTestJSON-999544861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ea03ccba-d5e5-4708-b5f6-bdee1d758a98" returned: 0 in 0.274s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:25:31 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-a936e710-4b4d-4fb8-beef-22afee5f589b tempest-VolumesSnapshotTestJSON-999544861 None] Lock "cinder-quobyte-ea03ccba-d5e5-4708-b5f6-bdee1d758a98" released by "delete_volume" :: held 0.800s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:25:31 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-a936e710-4b4d-4fb8-beef-22afee5f589b tempest-VolumesSnapshotTestJSON-999544861 None] Created reservations ['bca1d753-5b52-4039-a309-83e94933afa4', 'e367ab3b-5692-4fe0-a90e-1a4fa6647766', 'a0eb3934-ab98-4766-8c65-cbe664504af3', '179704d7-b88d-4c97-834d-298feef9aa3e'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:25:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-a936e710-4b4d-4fb8-beef-22afee5f589b tempest-VolumesSnapshotTestJSON-999544861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:25:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-a936e710-4b4d-4fb8-beef-22afee5f589b tempest-VolumesSnapshotTestJSON-999544861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:25:31 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-a936e710-4b4d-4fb8-beef-22afee5f589b tempest-VolumesSnapshotTestJSON-999544861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:25:31 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-a936e710-4b4d-4fb8-beef-22afee5f589b tempest-VolumesSnapshotTestJSON-999544861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:25:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-a936e710-4b4d-4fb8-beef-22afee5f589b tempest-VolumesSnapshotTestJSON-999544861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:25:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a936e710-4b4d-4fb8-beef-22afee5f589b tempest-VolumesSnapshotTestJSON-999544861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:25:31 devstack sudo[98122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:25:31 devstack sudo[98122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:25:31 devstack sudo[98122]: pam_unix(sudo:session): session closed for user root Sep 15 16:25:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a936e710-4b4d-4fb8-beef-22afee5f589b tempest-VolumesSnapshotTestJSON-999544861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.367s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:25:32 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-a936e710-4b4d-4fb8-beef-22afee5f589b tempest-VolumesSnapshotTestJSON-999544861 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:25:32 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-a936e710-4b4d-4fb8-beef-22afee5f589b tempest-VolumesSnapshotTestJSON-999544861 None] Deleted volume successfully. Sep 15 16:25:32 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-a936e710-4b4d-4fb8-beef-22afee5f589b tempest-VolumesSnapshotTestJSON-999544861 None] Lock "cinder-ea03ccba-d5e5-4708-b5f6-bdee1d758a98-delete_volume" released by "delete_volume" :: held 1.446s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:25:32 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f1ceabf-5c09-4979-9b38-d1cb5bf75f80 tempest-VolumesSnapshotTestJSON-999544861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:25:32 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8f1ceabf-5c09-4979-9b38-d1cb5bf75f80 tempest-VolumesSnapshotTestJSON-999544861 None] Flow 'volume_create_manager' (e00bec3b-4ef8-4426-89cf-aeddf6091933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:25:32 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8f1ceabf-5c09-4979-9b38-d1cb5bf75f80 tempest-VolumesSnapshotTestJSON-999544861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd17ee12-48dc-463c-9df2-b71879ff1dd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:25:32 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8f1ceabf-5c09-4979-9b38-d1cb5bf75f80 tempest-VolumesSnapshotTestJSON-999544861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd17ee12-48dc-463c-9df2-b71879ff1dd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:25:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1862675316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=330210a8-582b-48ec-bcb5-c77ce019f7b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98963f0df68643a7885de5021e1b8ff4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:25:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:25:32Z,use_quota=True,user_id='274fbf9eed974fbf8903d2cfaeae0224',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:25:32 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8f1ceabf-5c09-4979-9b38-d1cb5bf75f80 tempest-VolumesSnapshotTestJSON-999544861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc54d1cc-2c0a-46a4-bae9-bced5ae13c99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:25:32 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8f1ceabf-5c09-4979-9b38-d1cb5bf75f80 tempest-VolumesSnapshotTestJSON-999544861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc54d1cc-2c0a-46a4-bae9-bced5ae13c99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:25:32 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8f1ceabf-5c09-4979-9b38-d1cb5bf75f80 tempest-VolumesSnapshotTestJSON-999544861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (609c24c3-2e15-4245-9daf-c950e18977c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:25:32 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8f1ceabf-5c09-4979-9b38-d1cb5bf75f80 tempest-VolumesSnapshotTestJSON-999544861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (609c24c3-2e15-4245-9daf-c950e18977c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '330210a8-582b-48ec-bcb5-c77ce019f7b3', 'volume_name': 'volume-330210a8-582b-48ec-bcb5-c77ce019f7b3', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:25:32 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8f1ceabf-5c09-4979-9b38-d1cb5bf75f80 tempest-VolumesSnapshotTestJSON-999544861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd62c226-1afc-4237-a3f2-2bcc270f8822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:25:32 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8f1ceabf-5c09-4979-9b38-d1cb5bf75f80 tempest-VolumesSnapshotTestJSON-999544861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd62c226-1afc-4237-a3f2-2bcc270f8822) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:25:32 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8f1ceabf-5c09-4979-9b38-d1cb5bf75f80 tempest-VolumesSnapshotTestJSON-999544861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e22367d9-3ef2-49f1-ba7f-3570562cdc6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:25:32 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-8f1ceabf-5c09-4979-9b38-d1cb5bf75f80 tempest-VolumesSnapshotTestJSON-999544861 None] Volume 330210a8-582b-48ec-bcb5-c77ce019f7b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-330210a8-582b-48ec-bcb5-c77ce019f7b3', 'volume_size': 1} Sep 15 16:25:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-8f1ceabf-5c09-4979-9b38-d1cb5bf75f80 tempest-VolumesSnapshotTestJSON-999544861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:25:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-8f1ceabf-5c09-4979-9b38-d1cb5bf75f80 tempest-VolumesSnapshotTestJSON-999544861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:25:32 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-8f1ceabf-5c09-4979-9b38-d1cb5bf75f80 tempest-VolumesSnapshotTestJSON-999544861 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:25:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1862675316',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=330210a8-582b-48ec-bcb5-c77ce019f7b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98963f0df68643a7885de5021e1b8ff4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:25:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:25:32Z,use_quota=True,user_id='274fbf9eed974fbf8903d2cfaeae0224',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:25:32 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-8f1ceabf-5c09-4979-9b38-d1cb5bf75f80 tempest-VolumesSnapshotTestJSON-999544861 None] Creating volume 330210a8-582b-48ec-bcb5-c77ce019f7b3 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:25:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-8f1ceabf-5c09-4979-9b38-d1cb5bf75f80 tempest-VolumesSnapshotTestJSON-999544861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:25:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-8f1ceabf-5c09-4979-9b38-d1cb5bf75f80 tempest-VolumesSnapshotTestJSON-999544861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:25:32 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-8f1ceabf-5c09-4979-9b38-d1cb5bf75f80 tempest-VolumesSnapshotTestJSON-999544861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:25:32 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-8f1ceabf-5c09-4979-9b38-d1cb5bf75f80 tempest-VolumesSnapshotTestJSON-999544861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:25:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-8f1ceabf-5c09-4979-9b38-d1cb5bf75f80 tempest-VolumesSnapshotTestJSON-999544861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:25:32 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-8f1ceabf-5c09-4979-9b38-d1cb5bf75f80 tempest-VolumesSnapshotTestJSON-999544861 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:25:32 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-8f1ceabf-5c09-4979-9b38-d1cb5bf75f80 tempest-VolumesSnapshotTestJSON-999544861 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:25:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8f1ceabf-5c09-4979-9b38-d1cb5bf75f80 tempest-VolumesSnapshotTestJSON-999544861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-330210a8-582b-48ec-bcb5-c77ce019f7b3 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:25:32 devstack sudo[98125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-330210a8-582b-48ec-bcb5-c77ce019f7b3 1073741824 Sep 15 16:25:32 devstack sudo[98125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:25:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-edc642b0-08e2-48a6-a15f-59ef64e721a9 tempest-GroupSnapshotsTest-280274705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:25:33 devstack sudo[98125]: pam_unix(sudo:session): session closed for user root Sep 15 16:25:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8f1ceabf-5c09-4979-9b38-d1cb5bf75f80 tempest-VolumesSnapshotTestJSON-999544861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-330210a8-582b-48ec-bcb5-c77ce019f7b3 1073741824" returned: 0 in 0.599s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:25:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8f1ceabf-5c09-4979-9b38-d1cb5bf75f80 tempest-VolumesSnapshotTestJSON-999544861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-330210a8-582b-48ec-bcb5-c77ce019f7b3 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:25:33 devstack sudo[98132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-330210a8-582b-48ec-bcb5-c77ce019f7b3 Sep 15 16:25:33 devstack sudo[98132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:25:33 devstack sudo[98132]: pam_unix(sudo:session): session closed for user root Sep 15 16:25:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8f1ceabf-5c09-4979-9b38-d1cb5bf75f80 tempest-VolumesSnapshotTestJSON-999544861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-330210a8-582b-48ec-bcb5-c77ce019f7b3" returned: 0 in 0.275s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:25:33 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-8f1ceabf-5c09-4979-9b38-d1cb5bf75f80 tempest-VolumesSnapshotTestJSON-999544861 None] <== create_volume: return (926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:25:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-8f1ceabf-5c09-4979-9b38-d1cb5bf75f80 tempest-VolumesSnapshotTestJSON-999544861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.929s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:25:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-edc642b0-08e2-48a6-a15f-59ef64e721a9 tempest-GroupSnapshotsTest-280274705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.835s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:25:33 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-edc642b0-08e2-48a6-a15f-59ef64e721a9 tempest-GroupSnapshotsTest-280274705 None] Acquiring lock "cinder-quobyte-affe1081-f831-406f-a6ab-14ff89e9a7de-a7a9ad12-3b51-4157-a246-0699bd775a51" by "_create_volume_from_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:25:33 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8f1ceabf-5c09-4979-9b38-d1cb5bf75f80 tempest-VolumesSnapshotTestJSON-999544861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e22367d9-3ef2-49f1-ba7f-3570562cdc6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-330210a8-582b-48ec-bcb5-c77ce019f7b3', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:25:33 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8f1ceabf-5c09-4979-9b38-d1cb5bf75f80 tempest-VolumesSnapshotTestJSON-999544861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63fffa1a-4ff2-4d4f-8a8b-c5865e3a52ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:25:33 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-edc642b0-08e2-48a6-a15f-59ef64e721a9 tempest-GroupSnapshotsTest-280274705 None] Lock "cinder-quobyte-affe1081-f831-406f-a6ab-14ff89e9a7de-a7a9ad12-3b51-4157-a246-0699bd775a51" acquired by "_create_volume_from_snapshot" :: waited 0.038s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:25:33 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-edc642b0-08e2-48a6-a15f-59ef64e721a9 tempest-GroupSnapshotsTest-280274705 None] Creating volume a7a9ad12-3b51-4157-a246-0699bd775a51 from snapshot affe1081-f831-406f-a6ab-14ff89e9a7de {{(pid=86082) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 15 16:25:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-edc642b0-08e2-48a6-a15f-59ef64e721a9 tempest-GroupSnapshotsTest-280274705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:25:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-edc642b0-08e2-48a6-a15f-59ef64e721a9 tempest-GroupSnapshotsTest-280274705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:25:33 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-edc642b0-08e2-48a6-a15f-59ef64e721a9 tempest-GroupSnapshotsTest-280274705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:25:33 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-edc642b0-08e2-48a6-a15f-59ef64e721a9 tempest-GroupSnapshotsTest-280274705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:25:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-edc642b0-08e2-48a6-a15f-59ef64e721a9 tempest-GroupSnapshotsTest-280274705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:25:33 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-edc642b0-08e2-48a6-a15f-59ef64e721a9 tempest-GroupSnapshotsTest-280274705 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:25:33 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-edc642b0-08e2-48a6-a15f-59ef64e721a9 tempest-GroupSnapshotsTest-280274705 None] Acquiring lock "cinder-quobyte-a7a9ad12-3b51-4157-a246-0699bd775a51" by "_copy_volume_from_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:25:33 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-edc642b0-08e2-48a6-a15f-59ef64e721a9 tempest-GroupSnapshotsTest-280274705 None] Lock "cinder-quobyte-a7a9ad12-3b51-4157-a246-0699bd775a51" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:25:33 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-edc642b0-08e2-48a6-a15f-59ef64e721a9 tempest-GroupSnapshotsTest-280274705 None] snapshot: affe1081-f831-406f-a6ab-14ff89e9a7de, volume: a7a9ad12-3b51-4157-a246-0699bd775a51, {{(pid=86082) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 15 16:25:33 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-8f1ceabf-5c09-4979-9b38-d1cb5bf75f80 tempest-VolumesSnapshotTestJSON-999544861 None] Volume volume-330210a8-582b-48ec-bcb5-c77ce019f7b3 (330210a8-582b-48ec-bcb5-c77ce019f7b3): created successfully Sep 15 16:25:33 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8f1ceabf-5c09-4979-9b38-d1cb5bf75f80 tempest-VolumesSnapshotTestJSON-999544861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63fffa1a-4ff2-4d4f-8a8b-c5865e3a52ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:25:33 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8f1ceabf-5c09-4979-9b38-d1cb5bf75f80 tempest-VolumesSnapshotTestJSON-999544861 None] Flow 'volume_create_manager' (e00bec3b-4ef8-4426-89cf-aeddf6091933) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:25:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-edc642b0-08e2-48a6-a15f-59ef64e721a9 tempest-GroupSnapshotsTest-280274705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:25:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-edc642b0-08e2-48a6-a15f-59ef64e721a9 tempest-GroupSnapshotsTest-280274705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:25:33 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-edc642b0-08e2-48a6-a15f-59ef64e721a9 tempest-GroupSnapshotsTest-280274705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:25:33 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-edc642b0-08e2-48a6-a15f-59ef64e721a9 tempest-GroupSnapshotsTest-280274705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:25:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-edc642b0-08e2-48a6-a15f-59ef64e721a9 tempest-GroupSnapshotsTest-280274705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:25:33 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-8f1ceabf-5c09-4979-9b38-d1cb5bf75f80 tempest-VolumesSnapshotTestJSON-999544861 None] Created volume successfully. Sep 15 16:25:33 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cfde6ac-0c62-49ac-bd38-0d45c8b177ad]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:25:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-edc642b0-08e2-48a6-a15f-59ef64e721a9 tempest-GroupSnapshotsTest-280274705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-74acef54-e046-4043-9c4e-b3efffa9170d.affe1081-f831-406f-a6ab-14ff89e9a7de {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:25:33 devstack sudo[98136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-74acef54-e046-4043-9c4e-b3efffa9170d.affe1081-f831-406f-a6ab-14ff89e9a7de Sep 15 16:25:33 devstack sudo[98136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:25:34 devstack sudo[98136]: pam_unix(sudo:session): session closed for user root Sep 15 16:25:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-edc642b0-08e2-48a6-a15f-59ef64e721a9 tempest-GroupSnapshotsTest-280274705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-74acef54-e046-4043-9c4e-b3efffa9170d.affe1081-f831-406f-a6ab-14ff89e9a7de" returned: 0 in 0.413s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:25:34 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-edc642b0-08e2-48a6-a15f-59ef64e721a9 tempest-GroupSnapshotsTest-280274705 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-74acef54-e046-4043-9c4e-b3efffa9170d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 16:25:34 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[573fc094-fcee-4364-9e36-390601d10a1a]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:25:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-edc642b0-08e2-48a6-a15f-59ef64e721a9 tempest-GroupSnapshotsTest-280274705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-74acef54-e046-4043-9c4e-b3efffa9170d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:25:34 devstack sudo[98141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-74acef54-e046-4043-9c4e-b3efffa9170d Sep 15 16:25:34 devstack sudo[98141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:25:34 devstack sudo[98141]: pam_unix(sudo:session): session closed for user root Sep 15 16:25:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-edc642b0-08e2-48a6-a15f-59ef64e721a9 tempest-GroupSnapshotsTest-280274705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-74acef54-e046-4043-9c4e-b3efffa9170d" returned: 0 in 0.525s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:25:34 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-edc642b0-08e2-48a6-a15f-59ef64e721a9 tempest-GroupSnapshotsTest-280274705 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-74acef54-e046-4043-9c4e-b3efffa9170d {{(pid=86082) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 15 16:25:34 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-edc642b0-08e2-48a6-a15f-59ef64e721a9 tempest-GroupSnapshotsTest-280274705 None] Creating direct copy from snapshot {{(pid=86082) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 15 16:25:34 devstack cinder-volume[86082]: DEBUG cinder.utils [None req-edc642b0-08e2-48a6-a15f-59ef64e721a9 tempest-GroupSnapshotsTest-280274705 None] Path /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a7a9ad12-3b51-4157-a246-0699bd775a51 not found in is_blk_device check {{(pid=86082) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 15 16:25:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-edc642b0-08e2-48a6-a15f-59ef64e721a9 tempest-GroupSnapshotsTest-280274705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-74acef54-e046-4043-9c4e-b3efffa9170d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a7a9ad12-3b51-4157-a246-0699bd775a51 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:25:34 devstack sudo[98147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-74acef54-e046-4043-9c4e-b3efffa9170d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a7a9ad12-3b51-4157-a246-0699bd775a51 Sep 15 16:25:34 devstack sudo[98147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:25:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-dab5d377-2f9e-4e55-98e6-1b747907f4ba tempest-VolumesSnapshotTestJSON-999544861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:25:41 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:SELECT=155,cinder:INSERT=31,cinder:UPDATE=163,cinder:DELETE=8 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 16:25:43 devstack sudo[98147]: pam_unix(sudo:session): session closed for user root Sep 15 16:25:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-edc642b0-08e2-48a6-a15f-59ef64e721a9 tempest-GroupSnapshotsTest-280274705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-74acef54-e046-4043-9c4e-b3efffa9170d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a7a9ad12-3b51-4157-a246-0699bd775a51" returned: 0 in 9.049s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:25:43 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-edc642b0-08e2-48a6-a15f-59ef64e721a9 tempest-GroupSnapshotsTest-280274705 None] Image conversion details: src /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-74acef54-e046-4043-9c4e-b3efffa9170d, size 1024.00 MB, duration 9.05 sec, destination /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a7a9ad12-3b51-4157-a246-0699bd775a51 {{(pid=86082) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 15 16:25:43 devstack cinder-volume[86082]: INFO cinder.image.image_utils [None req-edc642b0-08e2-48a6-a15f-59ef64e721a9 tempest-GroupSnapshotsTest-280274705 None] Converted 1024.00 MB image at 113.15 MB/s Sep 15 16:25:43 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-edc642b0-08e2-48a6-a15f-59ef64e721a9 tempest-GroupSnapshotsTest-280274705 None] /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a7a9ad12-3b51-4157-a246-0699bd775a51 is being set with open permissions: ugo+rw: NotImplementedError Sep 15 16:25:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-edc642b0-08e2-48a6-a15f-59ef64e721a9 tempest-GroupSnapshotsTest-280274705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a7a9ad12-3b51-4157-a246-0699bd775a51 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:25:43 devstack sudo[98167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a7a9ad12-3b51-4157-a246-0699bd775a51 Sep 15 16:25:43 devstack sudo[98167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:25:44 devstack sudo[98167]: pam_unix(sudo:session): session closed for user root Sep 15 16:25:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-edc642b0-08e2-48a6-a15f-59ef64e721a9 tempest-GroupSnapshotsTest-280274705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a7a9ad12-3b51-4157-a246-0699bd775a51" returned: 0 in 0.252s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:25:44 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-edc642b0-08e2-48a6-a15f-59ef64e721a9 tempest-GroupSnapshotsTest-280274705 None] Lock "cinder-quobyte-a7a9ad12-3b51-4157-a246-0699bd775a51" released by "_copy_volume_from_snapshot" :: held 10.395s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:25:44 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:SELECT=167,cinder:INSERT=38,cinder:UPDATE=151,cinder:DELETE=11 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 16:25:44 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-edc642b0-08e2-48a6-a15f-59ef64e721a9 tempest-GroupSnapshotsTest-280274705 None] Lock "cinder-quobyte-affe1081-f831-406f-a6ab-14ff89e9a7de-a7a9ad12-3b51-4157-a246-0699bd775a51" released by "_create_volume_from_snapshot" :: held 10.469s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:25:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-edc642b0-08e2-48a6-a15f-59ef64e721a9 tempest-GroupSnapshotsTest-280274705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.509s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:25:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-dab5d377-2f9e-4e55-98e6-1b747907f4ba tempest-VolumesSnapshotTestJSON-999544861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.220s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:25:44 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-dab5d377-2f9e-4e55-98e6-1b747907f4ba tempest-VolumesSnapshotTestJSON-999544861 None] Creating offline snapshot e0d3a702-039a-4278-96d3-6f02ba6b7442 of volume 330210a8-582b-48ec-bcb5-c77ce019f7b3 {{(pid=86082) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 15 16:25:44 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb919b79-b744-4fcb-8f18-30ce17318deb]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:25:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-dab5d377-2f9e-4e55-98e6-1b747907f4ba tempest-VolumesSnapshotTestJSON-999544861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-330210a8-582b-48ec-bcb5-c77ce019f7b3 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:25:44 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-edc642b0-08e2-48a6-a15f-59ef64e721a9 tempest-GroupSnapshotsTest-280274705 None] Create group from source-snapshot-9c673591-baef-4b45-9744-2bfb28c5d72d completed successfully. Sep 15 16:25:44 devstack sudo[98170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-330210a8-582b-48ec-bcb5-c77ce019f7b3 Sep 15 16:25:44 devstack sudo[98170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:25:44 devstack sudo[98170]: pam_unix(sudo:session): session closed for user root Sep 15 16:25:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-dab5d377-2f9e-4e55-98e6-1b747907f4ba tempest-VolumesSnapshotTestJSON-999544861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-330210a8-582b-48ec-bcb5-c77ce019f7b3" returned: 0 in 0.495s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:25:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-dab5d377-2f9e-4e55-98e6-1b747907f4ba tempest-VolumesSnapshotTestJSON-999544861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-330210a8-582b-48ec-bcb5-c77ce019f7b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-330210a8-582b-48ec-bcb5-c77ce019f7b3.e0d3a702-039a-4278-96d3-6f02ba6b7442 1G {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:25:44 devstack sudo[98175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-330210a8-582b-48ec-bcb5-c77ce019f7b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-330210a8-582b-48ec-bcb5-c77ce019f7b3.e0d3a702-039a-4278-96d3-6f02ba6b7442 1G Sep 15 16:25:44 devstack sudo[98175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:25:44 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-03c71d88-8f19-4d56-adf8-feb6759b424d tempest-GroupSnapshotsTest-280274705 None] Acquiring lock "cinder-quobyte-a7a9ad12-3b51-4157-a246-0699bd775a51" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:25:44 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-03c71d88-8f19-4d56-adf8-feb6759b424d tempest-GroupSnapshotsTest-280274705 None] Lock "cinder-quobyte-a7a9ad12-3b51-4157-a246-0699bd775a51" acquired by "delete_volume" :: waited 0.022s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:25:45 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e34c80b-a9c9-41c8-bd21-2f4a8034eb80]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:25:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-03c71d88-8f19-4d56-adf8-feb6759b424d tempest-GroupSnapshotsTest-280274705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a7a9ad12-3b51-4157-a246-0699bd775a51 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:25:45 devstack sudo[98181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a7a9ad12-3b51-4157-a246-0699bd775a51 Sep 15 16:25:45 devstack sudo[98181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:25:45 devstack sudo[98175]: pam_unix(sudo:session): session closed for user root Sep 15 16:25:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-dab5d377-2f9e-4e55-98e6-1b747907f4ba tempest-VolumesSnapshotTestJSON-999544861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-330210a8-582b-48ec-bcb5-c77ce019f7b3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-330210a8-582b-48ec-bcb5-c77ce019f7b3.e0d3a702-039a-4278-96d3-6f02ba6b7442 1G" returned: 0 in 0.575s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:25:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-dab5d377-2f9e-4e55-98e6-1b747907f4ba tempest-VolumesSnapshotTestJSON-999544861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-330210a8-582b-48ec-bcb5-c77ce019f7b3 -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-330210a8-582b-48ec-bcb5-c77ce019f7b3.e0d3a702-039a-4278-96d3-6f02ba6b7442 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:25:45 devstack sudo[98183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-330210a8-582b-48ec-bcb5-c77ce019f7b3 -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-330210a8-582b-48ec-bcb5-c77ce019f7b3.e0d3a702-039a-4278-96d3-6f02ba6b7442 Sep 15 16:25:45 devstack sudo[98183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:25:45 devstack sudo[98181]: pam_unix(sudo:session): session closed for user root Sep 15 16:25:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-03c71d88-8f19-4d56-adf8-feb6759b424d tempest-GroupSnapshotsTest-280274705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a7a9ad12-3b51-4157-a246-0699bd775a51" returned: 0 in 0.520s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:25:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-03c71d88-8f19-4d56-adf8-feb6759b424d tempest-GroupSnapshotsTest-280274705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a7a9ad12-3b51-4157-a246-0699bd775a51 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:25:45 devstack sudo[98190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a7a9ad12-3b51-4157-a246-0699bd775a51 Sep 15 16:25:45 devstack sudo[98190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:25:45 devstack sudo[98183]: pam_unix(sudo:session): session closed for user root Sep 15 16:25:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-dab5d377-2f9e-4e55-98e6-1b747907f4ba tempest-VolumesSnapshotTestJSON-999544861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-330210a8-582b-48ec-bcb5-c77ce019f7b3 -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-330210a8-582b-48ec-bcb5-c77ce019f7b3.e0d3a702-039a-4278-96d3-6f02ba6b7442" returned: 0 in 0.447s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:25:45 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-dab5d377-2f9e-4e55-98e6-1b747907f4ba tempest-VolumesSnapshotTestJSON-999544861 None] /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-330210a8-582b-48ec-bcb5-c77ce019f7b3.e0d3a702-039a-4278-96d3-6f02ba6b7442 is being set with open permissions: ugo+rw Sep 15 16:25:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-dab5d377-2f9e-4e55-98e6-1b747907f4ba tempest-VolumesSnapshotTestJSON-999544861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-330210a8-582b-48ec-bcb5-c77ce019f7b3.e0d3a702-039a-4278-96d3-6f02ba6b7442 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:25:45 devstack sudo[98195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-330210a8-582b-48ec-bcb5-c77ce019f7b3.e0d3a702-039a-4278-96d3-6f02ba6b7442 Sep 15 16:25:45 devstack sudo[98195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:25:45 devstack sudo[98190]: pam_unix(sudo:session): session closed for user root Sep 15 16:25:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-03c71d88-8f19-4d56-adf8-feb6759b424d tempest-GroupSnapshotsTest-280274705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a7a9ad12-3b51-4157-a246-0699bd775a51" returned: 0 in 0.297s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:25:45 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-03c71d88-8f19-4d56-adf8-feb6759b424d tempest-GroupSnapshotsTest-280274705 None] Lock "cinder-quobyte-a7a9ad12-3b51-4157-a246-0699bd775a51" released by "delete_volume" :: held 0.875s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:25:45 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-03c71d88-8f19-4d56-adf8-feb6759b424d tempest-GroupSnapshotsTest-280274705 None] Created reservations ['3dbfcb2e-ae55-406c-bfa4-815551bff2cd'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:25:45 devstack cinder-volume[86082]: WARNING cinder.quota [None req-03c71d88-8f19-4d56-adf8-feb6759b424d tempest-GroupSnapshotsTest-280274705 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1349912227 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1349912227, it is now deprecated. Please use the default quota class for default quota. Sep 15 16:25:45 devstack cinder-volume[86082]: WARNING cinder.quota [None req-03c71d88-8f19-4d56-adf8-feb6759b424d tempest-GroupSnapshotsTest-280274705 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1349912227 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1349912227, it is now deprecated. Please use the default quota class for default quota. Sep 15 16:25:45 devstack sudo[98195]: pam_unix(sudo:session): session closed for user root Sep 15 16:25:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-dab5d377-2f9e-4e55-98e6-1b747907f4ba tempest-VolumesSnapshotTestJSON-999544861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-330210a8-582b-48ec-bcb5-c77ce019f7b3.e0d3a702-039a-4278-96d3-6f02ba6b7442" returned: 0 in 0.299s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:25:45 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-03c71d88-8f19-4d56-adf8-feb6759b424d tempest-GroupSnapshotsTest-280274705 None] Created reservations ['9d29bf46-8a91-4223-aaae-7f686af00298', '6e87d930-2ed3-4c94-91a5-0aa8c7b25c27', '667182ac-3c27-487f-b828-994c0ec4df42', '23830291-2b6e-47d5-8e51-e7aa3e8e0ad1'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:25:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-dab5d377-2f9e-4e55-98e6-1b747907f4ba tempest-VolumesSnapshotTestJSON-999544861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-330210a8-582b-48ec-bcb5-c77ce019f7b3.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:25:46 devstack sudo[98199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-330210a8-582b-48ec-bcb5-c77ce019f7b3.info Sep 15 16:25:46 devstack sudo[98199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:25:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-03c71d88-8f19-4d56-adf8-feb6759b424d tempest-GroupSnapshotsTest-280274705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:25:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-03c71d88-8f19-4d56-adf8-feb6759b424d tempest-GroupSnapshotsTest-280274705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:25:46 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-03c71d88-8f19-4d56-adf8-feb6759b424d tempest-GroupSnapshotsTest-280274705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:25:46 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-03c71d88-8f19-4d56-adf8-feb6759b424d tempest-GroupSnapshotsTest-280274705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:25:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-03c71d88-8f19-4d56-adf8-feb6759b424d tempest-GroupSnapshotsTest-280274705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:25:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-03c71d88-8f19-4d56-adf8-feb6759b424d tempest-GroupSnapshotsTest-280274705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:25:46 devstack sudo[98201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:25:46 devstack sudo[98201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:25:46 devstack sudo[98199]: pam_unix(sudo:session): session closed for user root Sep 15 16:25:46 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-2cec408b-f617-492c-b49b-c33f21702b11 tempest-GroupSnapshotsTest-280274705 None] group_snapshot 9c673591-baef-4b45-9744-2bfb28c5d72d: deleting Sep 15 16:25:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-dab5d377-2f9e-4e55-98e6-1b747907f4ba tempest-VolumesSnapshotTestJSON-999544861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-330210a8-582b-48ec-bcb5-c77ce019f7b3.info" returned: 0 in 0.344s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:25:46 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-dab5d377-2f9e-4e55-98e6-1b747907f4ba tempest-VolumesSnapshotTestJSON-999544861 None] /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-330210a8-582b-48ec-bcb5-c77ce019f7b3.info is being set with open permissions: ugo+rw Sep 15 16:25:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-dab5d377-2f9e-4e55-98e6-1b747907f4ba tempest-VolumesSnapshotTestJSON-999544861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-330210a8-582b-48ec-bcb5-c77ce019f7b3.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:25:46 devstack sudo[98204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-330210a8-582b-48ec-bcb5-c77ce019f7b3.info Sep 15 16:25:46 devstack sudo[98204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:25:46 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2cec408b-f617-492c-b49b-c33f21702b11 tempest-GroupSnapshotsTest-280274705 None] group_snapshot 9c673591-baef-4b45-9744-2bfb28c5d72d: deleting {{(pid=86082) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 15 16:25:46 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-2cec408b-f617-492c-b49b-c33f21702b11 tempest-GroupSnapshotsTest-280274705 None] Acquiring lock "cinder-quobyte-74acef54-e046-4043-9c4e-b3efffa9170d" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:25:46 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-2cec408b-f617-492c-b49b-c33f21702b11 tempest-GroupSnapshotsTest-280274705 None] Lock "cinder-quobyte-74acef54-e046-4043-9c4e-b3efffa9170d" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:25:46 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-2cec408b-f617-492c-b49b-c33f21702b11 tempest-GroupSnapshotsTest-280274705 None] Acquiring lock "cinder-quobyte-affe1081-f831-406f-a6ab-14ff89e9a7de" by "_delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:25:46 devstack sudo[98201]: pam_unix(sudo:session): session closed for user root Sep 15 16:25:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-03c71d88-8f19-4d56-adf8-feb6759b424d tempest-GroupSnapshotsTest-280274705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.369s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:25:46 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-03c71d88-8f19-4d56-adf8-feb6759b424d tempest-GroupSnapshotsTest-280274705 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:25:46 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-2cec408b-f617-492c-b49b-c33f21702b11 tempest-GroupSnapshotsTest-280274705 None] Lock "cinder-quobyte-affe1081-f831-406f-a6ab-14ff89e9a7de" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:25:46 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-2cec408b-f617-492c-b49b-c33f21702b11 tempest-GroupSnapshotsTest-280274705 None] Deleting offline snapshot affe1081-f831-406f-a6ab-14ff89e9a7de of volume 74acef54-e046-4043-9c4e-b3efffa9170d {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 15 16:25:46 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-2cec408b-f617-492c-b49b-c33f21702b11 tempest-GroupSnapshotsTest-280274705 None] snapshot_file for this snap is: volume-74acef54-e046-4043-9c4e-b3efffa9170d.affe1081-f831-406f-a6ab-14ff89e9a7de {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 15 16:25:46 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-03c71d88-8f19-4d56-adf8-feb6759b424d tempest-GroupSnapshotsTest-280274705 None] Delete group completed successfully. Sep 15 16:25:46 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c160a46-eccc-4362-8cbb-ab32539d9f11]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:25:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2cec408b-f617-492c-b49b-c33f21702b11 tempest-GroupSnapshotsTest-280274705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-74acef54-e046-4043-9c4e-b3efffa9170d.affe1081-f831-406f-a6ab-14ff89e9a7de {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:25:46 devstack sudo[98208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-74acef54-e046-4043-9c4e-b3efffa9170d.affe1081-f831-406f-a6ab-14ff89e9a7de Sep 15 16:25:46 devstack sudo[98208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:25:46 devstack sudo[98204]: pam_unix(sudo:session): session closed for user root Sep 15 16:25:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-dab5d377-2f9e-4e55-98e6-1b747907f4ba tempest-VolumesSnapshotTestJSON-999544861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-330210a8-582b-48ec-bcb5-c77ce019f7b3.info" returned: 0 in 0.416s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:25:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-dab5d377-2f9e-4e55-98e6-1b747907f4ba tempest-VolumesSnapshotTestJSON-999544861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.722s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:25:46 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-dab5d377-2f9e-4e55-98e6-1b747907f4ba tempest-VolumesSnapshotTestJSON-999544861 None] Create snapshot completed successfully Sep 15 16:25:47 devstack sudo[98208]: pam_unix(sudo:session): session closed for user root Sep 15 16:25:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2cec408b-f617-492c-b49b-c33f21702b11 tempest-GroupSnapshotsTest-280274705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-74acef54-e046-4043-9c4e-b3efffa9170d.affe1081-f831-406f-a6ab-14ff89e9a7de" returned: 0 in 0.442s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:25:47 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-2cec408b-f617-492c-b49b-c33f21702b11 tempest-GroupSnapshotsTest-280274705 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-74acef54-e046-4043-9c4e-b3efffa9170d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 16:25:47 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[19da6185-381b-4d72-9f1d-826825421d7d]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:25:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2cec408b-f617-492c-b49b-c33f21702b11 tempest-GroupSnapshotsTest-280274705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-74acef54-e046-4043-9c4e-b3efffa9170d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:25:47 devstack sudo[98214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-74acef54-e046-4043-9c4e-b3efffa9170d Sep 15 16:25:47 devstack sudo[98214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:25:47 devstack sudo[98214]: pam_unix(sudo:session): session closed for user root Sep 15 16:25:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2cec408b-f617-492c-b49b-c33f21702b11 tempest-GroupSnapshotsTest-280274705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-74acef54-e046-4043-9c4e-b3efffa9170d" returned: 0 in 0.648s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:25:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2cec408b-f617-492c-b49b-c33f21702b11 tempest-GroupSnapshotsTest-280274705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-74acef54-e046-4043-9c4e-b3efffa9170d.affe1081-f831-406f-a6ab-14ff89e9a7de {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:25:47 devstack sudo[98219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-74acef54-e046-4043-9c4e-b3efffa9170d.affe1081-f831-406f-a6ab-14ff89e9a7de Sep 15 16:25:47 devstack sudo[98219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:25:48 devstack sudo[98219]: pam_unix(sudo:session): session closed for user root Sep 15 16:25:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2cec408b-f617-492c-b49b-c33f21702b11 tempest-GroupSnapshotsTest-280274705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-74acef54-e046-4043-9c4e-b3efffa9170d.affe1081-f831-406f-a6ab-14ff89e9a7de" returned: 0 in 0.411s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:25:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2cec408b-f617-492c-b49b-c33f21702b11 tempest-GroupSnapshotsTest-280274705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-74acef54-e046-4043-9c4e-b3efffa9170d.affe1081-f831-406f-a6ab-14ff89e9a7de {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:25:48 devstack sudo[98224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-74acef54-e046-4043-9c4e-b3efffa9170d.affe1081-f831-406f-a6ab-14ff89e9a7de Sep 15 16:25:48 devstack sudo[98224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:25:48 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d818b82-5e6d-4741-bcdb-1aa1521b7cff tempest-VolumesSnapshotTestJSON-999544861 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:25:48 devstack sudo[98224]: pam_unix(sudo:session): session closed for user root Sep 15 16:25:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2cec408b-f617-492c-b49b-c33f21702b11 tempest-GroupSnapshotsTest-280274705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-74acef54-e046-4043-9c4e-b3efffa9170d.affe1081-f831-406f-a6ab-14ff89e9a7de" returned: 0 in 0.328s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:25:48 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-2cec408b-f617-492c-b49b-c33f21702b11 tempest-GroupSnapshotsTest-280274705 None] Lock "cinder-quobyte-affe1081-f831-406f-a6ab-14ff89e9a7de" released by "_delete_snapshot" :: held 2.010s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:25:48 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5d818b82-5e6d-4741-bcdb-1aa1521b7cff tempest-VolumesSnapshotTestJSON-999544861 None] Flow 'volume_create_manager' (cb79c7ca-891c-44e2-8428-02eb52310ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:25:48 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5d818b82-5e6d-4741-bcdb-1aa1521b7cff tempest-VolumesSnapshotTestJSON-999544861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f267e50d-ab36-4281-b7cb-40da38ab1c92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:25:48 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-2cec408b-f617-492c-b49b-c33f21702b11 tempest-GroupSnapshotsTest-280274705 None] Lock "cinder-quobyte-74acef54-e046-4043-9c4e-b3efffa9170d" released by "delete_snapshot" :: held 2.069s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:25:48 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5d818b82-5e6d-4741-bcdb-1aa1521b7cff tempest-VolumesSnapshotTestJSON-999544861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f267e50d-ab36-4281-b7cb-40da38ab1c92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:25:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-522764926',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=669a1f11-2b21-4874-b110-9a80f5655779,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='98963f0df68643a7885de5021e1b8ff4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:25:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=e0d3a702-039a-4278-96d3-6f02ba6b7442,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:25:48Z,use_quota=True,user_id='274fbf9eed974fbf8903d2cfaeae0224',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:25:48 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5d818b82-5e6d-4741-bcdb-1aa1521b7cff tempest-VolumesSnapshotTestJSON-999544861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (704cb29a-80c8-47c9-94e7-dbfc3d4ac852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:25:48 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5d818b82-5e6d-4741-bcdb-1aa1521b7cff tempest-VolumesSnapshotTestJSON-999544861 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (704cb29a-80c8-47c9-94e7-dbfc3d4ac852) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:25:48 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5d818b82-5e6d-4741-bcdb-1aa1521b7cff tempest-VolumesSnapshotTestJSON-999544861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d55f6866-4534-4b15-8302-438d32a6889c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:25:48 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5d818b82-5e6d-4741-bcdb-1aa1521b7cff tempest-VolumesSnapshotTestJSON-999544861 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d55f6866-4534-4b15-8302-438d32a6889c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '669a1f11-2b21-4874-b110-9a80f5655779', 'volume_name': 'volume-669a1f11-2b21-4874-b110-9a80f5655779', 'volume_size': 1, 'snapshot_id': 'e0d3a702-039a-4278-96d3-6f02ba6b7442'}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:25:48 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5d818b82-5e6d-4741-bcdb-1aa1521b7cff tempest-VolumesSnapshotTestJSON-999544861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6a639e3-242b-404f-bed9-f056d0937c62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:25:48 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5d818b82-5e6d-4741-bcdb-1aa1521b7cff tempest-VolumesSnapshotTestJSON-999544861 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6a639e3-242b-404f-bed9-f056d0937c62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:25:48 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5d818b82-5e6d-4741-bcdb-1aa1521b7cff tempest-VolumesSnapshotTestJSON-999544861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d43b9c80-a7dd-4868-a23c-b600e668ff82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:25:48 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-5d818b82-5e6d-4741-bcdb-1aa1521b7cff tempest-VolumesSnapshotTestJSON-999544861 None] Volume 669a1f11-2b21-4874-b110-9a80f5655779: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-669a1f11-2b21-4874-b110-9a80f5655779', 'volume_size': 1, 'snapshot_id': 'e0d3a702-039a-4278-96d3-6f02ba6b7442'} Sep 15 16:25:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-5d818b82-5e6d-4741-bcdb-1aa1521b7cff tempest-VolumesSnapshotTestJSON-999544861 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:25:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-5d818b82-5e6d-4741-bcdb-1aa1521b7cff tempest-VolumesSnapshotTestJSON-999544861 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:25:48 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-5d818b82-5e6d-4741-bcdb-1aa1521b7cff tempest-VolumesSnapshotTestJSON-999544861 None] Acquiring lock "cinder-quobyte-e0d3a702-039a-4278-96d3-6f02ba6b7442-669a1f11-2b21-4874-b110-9a80f5655779" by "_create_volume_from_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:25:48 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-5d818b82-5e6d-4741-bcdb-1aa1521b7cff tempest-VolumesSnapshotTestJSON-999544861 None] Lock "cinder-quobyte-e0d3a702-039a-4278-96d3-6f02ba6b7442-669a1f11-2b21-4874-b110-9a80f5655779" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:25:48 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-5d818b82-5e6d-4741-bcdb-1aa1521b7cff tempest-VolumesSnapshotTestJSON-999544861 None] Creating volume 669a1f11-2b21-4874-b110-9a80f5655779 from snapshot e0d3a702-039a-4278-96d3-6f02ba6b7442 {{(pid=86082) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 15 16:25:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-5d818b82-5e6d-4741-bcdb-1aa1521b7cff tempest-VolumesSnapshotTestJSON-999544861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:25:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-5d818b82-5e6d-4741-bcdb-1aa1521b7cff tempest-VolumesSnapshotTestJSON-999544861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:25:48 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-5d818b82-5e6d-4741-bcdb-1aa1521b7cff tempest-VolumesSnapshotTestJSON-999544861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:25:48 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-5d818b82-5e6d-4741-bcdb-1aa1521b7cff tempest-VolumesSnapshotTestJSON-999544861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:25:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-5d818b82-5e6d-4741-bcdb-1aa1521b7cff tempest-VolumesSnapshotTestJSON-999544861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:25:48 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-5d818b82-5e6d-4741-bcdb-1aa1521b7cff tempest-VolumesSnapshotTestJSON-999544861 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:25:48 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-5d818b82-5e6d-4741-bcdb-1aa1521b7cff tempest-VolumesSnapshotTestJSON-999544861 None] Acquiring lock "cinder-quobyte-669a1f11-2b21-4874-b110-9a80f5655779" by "_copy_volume_from_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:25:48 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-5d818b82-5e6d-4741-bcdb-1aa1521b7cff tempest-VolumesSnapshotTestJSON-999544861 None] Lock "cinder-quobyte-669a1f11-2b21-4874-b110-9a80f5655779" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:25:48 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-5d818b82-5e6d-4741-bcdb-1aa1521b7cff tempest-VolumesSnapshotTestJSON-999544861 None] snapshot: e0d3a702-039a-4278-96d3-6f02ba6b7442, volume: 669a1f11-2b21-4874-b110-9a80f5655779, {{(pid=86082) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 15 16:25:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-5d818b82-5e6d-4741-bcdb-1aa1521b7cff tempest-VolumesSnapshotTestJSON-999544861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:25:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-5d818b82-5e6d-4741-bcdb-1aa1521b7cff tempest-VolumesSnapshotTestJSON-999544861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:25:48 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-5d818b82-5e6d-4741-bcdb-1aa1521b7cff tempest-VolumesSnapshotTestJSON-999544861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:25:48 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-5d818b82-5e6d-4741-bcdb-1aa1521b7cff tempest-VolumesSnapshotTestJSON-999544861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:25:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-5d818b82-5e6d-4741-bcdb-1aa1521b7cff tempest-VolumesSnapshotTestJSON-999544861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:25:48 devstack cinder-volume[86082]: WARNING cinder.quota [None req-2cec408b-f617-492c-b49b-c33f21702b11 tempest-GroupSnapshotsTest-280274705 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1349912227 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1349912227, it is now deprecated. Please use the default quota class for default quota. Sep 15 16:25:48 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c9121b4-8d08-4d55-8c4a-3506cde3fa11]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:25:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5d818b82-5e6d-4741-bcdb-1aa1521b7cff tempest-VolumesSnapshotTestJSON-999544861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-330210a8-582b-48ec-bcb5-c77ce019f7b3.e0d3a702-039a-4278-96d3-6f02ba6b7442 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:25:48 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-2cec408b-f617-492c-b49b-c33f21702b11 tempest-GroupSnapshotsTest-280274705 None] Created reservations ['c5e4f84d-2ea3-4bb1-bf6c-4b1fa34ac1f9', '5a11ed9b-8e8e-4ca7-9cc5-09b2210d8435', '99f503e7-b372-4d1d-ad92-05f63bcaca84', '6d65b6b7-1009-416b-9ebf-8064fd80532c'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:25:48 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-2cec408b-f617-492c-b49b-c33f21702b11 tempest-GroupSnapshotsTest-280274705 None] group_snapshot 9c673591-baef-4b45-9744-2bfb28c5d72d: deleted successfully Sep 15 16:25:48 devstack sudo[98227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-330210a8-582b-48ec-bcb5-c77ce019f7b3.e0d3a702-039a-4278-96d3-6f02ba6b7442 Sep 15 16:25:48 devstack sudo[98227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:25:49 devstack sudo[98227]: pam_unix(sudo:session): session closed for user root Sep 15 16:25:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5d818b82-5e6d-4741-bcdb-1aa1521b7cff tempest-VolumesSnapshotTestJSON-999544861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-330210a8-582b-48ec-bcb5-c77ce019f7b3.e0d3a702-039a-4278-96d3-6f02ba6b7442" returned: 0 in 0.461s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:25:49 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-5d818b82-5e6d-4741-bcdb-1aa1521b7cff tempest-VolumesSnapshotTestJSON-999544861 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-330210a8-582b-48ec-bcb5-c77ce019f7b3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 16:25:49 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[58bd48a5-96b8-49ce-a634-2785c4726793]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:25:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5d818b82-5e6d-4741-bcdb-1aa1521b7cff tempest-VolumesSnapshotTestJSON-999544861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-330210a8-582b-48ec-bcb5-c77ce019f7b3 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:25:49 devstack sudo[98232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-330210a8-582b-48ec-bcb5-c77ce019f7b3 Sep 15 16:25:49 devstack sudo[98232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:25:49 devstack sudo[98232]: pam_unix(sudo:session): session closed for user root Sep 15 16:25:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5d818b82-5e6d-4741-bcdb-1aa1521b7cff tempest-VolumesSnapshotTestJSON-999544861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-330210a8-582b-48ec-bcb5-c77ce019f7b3" returned: 0 in 0.473s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:25:49 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-5d818b82-5e6d-4741-bcdb-1aa1521b7cff tempest-VolumesSnapshotTestJSON-999544861 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-330210a8-582b-48ec-bcb5-c77ce019f7b3 {{(pid=86082) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 15 16:25:49 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-5d818b82-5e6d-4741-bcdb-1aa1521b7cff tempest-VolumesSnapshotTestJSON-999544861 None] Creating direct copy from snapshot {{(pid=86082) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 15 16:25:49 devstack cinder-volume[86082]: DEBUG cinder.utils [None req-5d818b82-5e6d-4741-bcdb-1aa1521b7cff tempest-VolumesSnapshotTestJSON-999544861 None] Path /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-669a1f11-2b21-4874-b110-9a80f5655779 not found in is_blk_device check {{(pid=86082) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 15 16:25:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5d818b82-5e6d-4741-bcdb-1aa1521b7cff tempest-VolumesSnapshotTestJSON-999544861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-330210a8-582b-48ec-bcb5-c77ce019f7b3 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-669a1f11-2b21-4874-b110-9a80f5655779 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:25:49 devstack sudo[98237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-330210a8-582b-48ec-bcb5-c77ce019f7b3 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-669a1f11-2b21-4874-b110-9a80f5655779 Sep 15 16:25:49 devstack sudo[98237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:25:50 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-e8e21189-4e88-4a00-b7df-4841a11daf98 tempest-GroupSnapshotsTest-280274705 None] Acquiring lock "cinder-quobyte-74acef54-e046-4043-9c4e-b3efffa9170d" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:25:50 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-e8e21189-4e88-4a00-b7df-4841a11daf98 tempest-GroupSnapshotsTest-280274705 None] Lock "cinder-quobyte-74acef54-e046-4043-9c4e-b3efffa9170d" acquired by "delete_volume" :: waited 0.026s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:25:50 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a5ff6cd-94e5-4ec7-8024-365e9e4b63b9]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:25:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e8e21189-4e88-4a00-b7df-4841a11daf98 tempest-GroupSnapshotsTest-280274705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-74acef54-e046-4043-9c4e-b3efffa9170d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:25:50 devstack sudo[98242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-74acef54-e046-4043-9c4e-b3efffa9170d Sep 15 16:25:50 devstack sudo[98242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:25:50 devstack sudo[98242]: pam_unix(sudo:session): session closed for user root Sep 15 16:25:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e8e21189-4e88-4a00-b7df-4841a11daf98 tempest-GroupSnapshotsTest-280274705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-74acef54-e046-4043-9c4e-b3efffa9170d" returned: 0 in 0.643s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:25:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e8e21189-4e88-4a00-b7df-4841a11daf98 tempest-GroupSnapshotsTest-280274705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-74acef54-e046-4043-9c4e-b3efffa9170d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:25:50 devstack sudo[98254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-74acef54-e046-4043-9c4e-b3efffa9170d Sep 15 16:25:50 devstack sudo[98254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:25:51 devstack sudo[98254]: pam_unix(sudo:session): session closed for user root Sep 15 16:25:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e8e21189-4e88-4a00-b7df-4841a11daf98 tempest-GroupSnapshotsTest-280274705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-74acef54-e046-4043-9c4e-b3efffa9170d" returned: 0 in 0.804s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:25:51 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-e8e21189-4e88-4a00-b7df-4841a11daf98 tempest-GroupSnapshotsTest-280274705 None] Lock "cinder-quobyte-74acef54-e046-4043-9c4e-b3efffa9170d" released by "delete_volume" :: held 1.595s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:25:51 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-e8e21189-4e88-4a00-b7df-4841a11daf98 tempest-GroupSnapshotsTest-280274705 None] Created reservations ['31dd55b5-8ffc-4bea-ad32-7dcc0a698f50'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:25:52 devstack cinder-volume[86082]: WARNING cinder.db.api [None req-e8e21189-4e88-4a00-b7df-4841a11daf98 tempest-GroupSnapshotsTest-280274705 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1349912227'] Sep 15 16:25:52 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-e8e21189-4e88-4a00-b7df-4841a11daf98 tempest-GroupSnapshotsTest-280274705 None] Created reservations ['de5361ab-ce9d-41b8-a958-93f85c8a4b70', 'f364c2bb-313e-4798-a647-3f0e524cc692', 'e8816f30-149d-456b-8e6d-6d3a180b5607', 'bd96d7df-140d-4216-ab21-9f80abe0f02a'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:25:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-e8e21189-4e88-4a00-b7df-4841a11daf98 tempest-GroupSnapshotsTest-280274705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:25:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-e8e21189-4e88-4a00-b7df-4841a11daf98 tempest-GroupSnapshotsTest-280274705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:25:52 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-e8e21189-4e88-4a00-b7df-4841a11daf98 tempest-GroupSnapshotsTest-280274705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:25:52 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-e8e21189-4e88-4a00-b7df-4841a11daf98 tempest-GroupSnapshotsTest-280274705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:25:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-e8e21189-4e88-4a00-b7df-4841a11daf98 tempest-GroupSnapshotsTest-280274705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:25:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e8e21189-4e88-4a00-b7df-4841a11daf98 tempest-GroupSnapshotsTest-280274705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:25:52 devstack sudo[98257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:25:52 devstack sudo[98257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:25:52 devstack sudo[98257]: pam_unix(sudo:session): session closed for user root Sep 15 16:25:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e8e21189-4e88-4a00-b7df-4841a11daf98 tempest-GroupSnapshotsTest-280274705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.526s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:25:52 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-e8e21189-4e88-4a00-b7df-4841a11daf98 tempest-GroupSnapshotsTest-280274705 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:25:52 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-e8e21189-4e88-4a00-b7df-4841a11daf98 tempest-GroupSnapshotsTest-280274705 None] Delete group completed successfully. Sep 15 16:25:53 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-8b9d94d7-0036-40b4-a2d1-abe1ae54912e tempest-GroupSnapshotsTest-280274705 None] Group tempest-GroupSnapshotsTest-Group-116974666: creating Sep 15 16:25:53 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-8b9d94d7-0036-40b4-a2d1-abe1ae54912e tempest-GroupSnapshotsTest-280274705 None] Group tempest-GroupSnapshotsTest-Group-116974666: created successfully Sep 15 16:25:53 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-8b9d94d7-0036-40b4-a2d1-abe1ae54912e tempest-GroupSnapshotsTest-280274705 None] Create group completed successfully. Sep 15 16:25:55 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-a75bf779-b104-4751-9e2a-6d7800b7a574 tempest-GroupSnapshotsTest-280274705 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:25:55 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-a75bf779-b104-4751-9e2a-6d7800b7a574 tempest-GroupSnapshotsTest-280274705 None] Flow 'volume_create_manager' (8f4c48e1-7361-427b-8d80-8774c1174187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:25:56 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-a75bf779-b104-4751-9e2a-6d7800b7a574 tempest-GroupSnapshotsTest-280274705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d36ef801-c1b3-4a1b-a535-43402838b6e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:25:56 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-a75bf779-b104-4751-9e2a-6d7800b7a574 tempest-GroupSnapshotsTest-280274705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d36ef801-c1b3-4a1b-a535-43402838b6e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:25:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1645097002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=59044c47-4da5-45d5-9e66-311f64961976,host='devstack@QuobyteHD#QuobyteHD',id=01e91647-e636-4131-9cfe-43108983ea2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='293c2399eae1433ab0ed844313ad3ede',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:25:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:25:56Z,use_quota=True,user_id='f1accc1a486645fdb84f42d2c33b632e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a2a8ef8b-c93f-4166-9136-ede815b0e75a),volume_type_id=a2a8ef8b-c93f-4166-9136-ede815b0e75a)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:25:56 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-a75bf779-b104-4751-9e2a-6d7800b7a574 tempest-GroupSnapshotsTest-280274705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43280447-fd07-4347-a073-8747336c2da9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:25:56 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-a75bf779-b104-4751-9e2a-6d7800b7a574 tempest-GroupSnapshotsTest-280274705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43280447-fd07-4347-a073-8747336c2da9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:25:56 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-a75bf779-b104-4751-9e2a-6d7800b7a574 tempest-GroupSnapshotsTest-280274705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2d72305-2ab7-4410-8177-5f39db6101f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:25:56 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-a75bf779-b104-4751-9e2a-6d7800b7a574 tempest-GroupSnapshotsTest-280274705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2d72305-2ab7-4410-8177-5f39db6101f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01e91647-e636-4131-9cfe-43108983ea2d', 'volume_name': 'volume-01e91647-e636-4131-9cfe-43108983ea2d', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:25:56 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-a75bf779-b104-4751-9e2a-6d7800b7a574 tempest-GroupSnapshotsTest-280274705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f3270d4-b1e9-4319-9013-4b65c1b01b58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:25:56 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-a75bf779-b104-4751-9e2a-6d7800b7a574 tempest-GroupSnapshotsTest-280274705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f3270d4-b1e9-4319-9013-4b65c1b01b58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:25:56 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-a75bf779-b104-4751-9e2a-6d7800b7a574 tempest-GroupSnapshotsTest-280274705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9caadbc2-bc36-4659-884a-eb369548f262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:25:56 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-a75bf779-b104-4751-9e2a-6d7800b7a574 tempest-GroupSnapshotsTest-280274705 None] Volume 01e91647-e636-4131-9cfe-43108983ea2d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01e91647-e636-4131-9cfe-43108983ea2d', 'volume_size': 1} Sep 15 16:25:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-a75bf779-b104-4751-9e2a-6d7800b7a574 tempest-GroupSnapshotsTest-280274705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:25:58 devstack sudo[98237]: pam_unix(sudo:session): session closed for user root Sep 15 16:25:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5d818b82-5e6d-4741-bcdb-1aa1521b7cff tempest-VolumesSnapshotTestJSON-999544861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-330210a8-582b-48ec-bcb5-c77ce019f7b3 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-669a1f11-2b21-4874-b110-9a80f5655779" returned: 0 in 8.966s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:25:58 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-5d818b82-5e6d-4741-bcdb-1aa1521b7cff tempest-VolumesSnapshotTestJSON-999544861 None] Image conversion details: src /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-330210a8-582b-48ec-bcb5-c77ce019f7b3, size 1024.00 MB, duration 8.97 sec, destination /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-669a1f11-2b21-4874-b110-9a80f5655779 {{(pid=86082) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 15 16:25:58 devstack cinder-volume[86082]: INFO cinder.image.image_utils [None req-5d818b82-5e6d-4741-bcdb-1aa1521b7cff tempest-VolumesSnapshotTestJSON-999544861 None] Converted 1024.00 MB image at 114.20 MB/s Sep 15 16:25:58 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-5d818b82-5e6d-4741-bcdb-1aa1521b7cff tempest-VolumesSnapshotTestJSON-999544861 None] /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-669a1f11-2b21-4874-b110-9a80f5655779 is being set with open permissions: ugo+rw Sep 15 16:25:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5d818b82-5e6d-4741-bcdb-1aa1521b7cff tempest-VolumesSnapshotTestJSON-999544861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-669a1f11-2b21-4874-b110-9a80f5655779 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:25:58 devstack sudo[98262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-669a1f11-2b21-4874-b110-9a80f5655779 Sep 15 16:25:58 devstack sudo[98262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:25:58 devstack sudo[98262]: pam_unix(sudo:session): session closed for user root Sep 15 16:25:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5d818b82-5e6d-4741-bcdb-1aa1521b7cff tempest-VolumesSnapshotTestJSON-999544861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-669a1f11-2b21-4874-b110-9a80f5655779" returned: 0 in 0.271s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:25:58 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-5d818b82-5e6d-4741-bcdb-1aa1521b7cff tempest-VolumesSnapshotTestJSON-999544861 None] Lock "cinder-quobyte-669a1f11-2b21-4874-b110-9a80f5655779" released by "_copy_volume_from_snapshot" :: held 10.286s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:25:59 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-5d818b82-5e6d-4741-bcdb-1aa1521b7cff tempest-VolumesSnapshotTestJSON-999544861 None] Lock "cinder-quobyte-e0d3a702-039a-4278-96d3-6f02ba6b7442-669a1f11-2b21-4874-b110-9a80f5655779" released by "_create_volume_from_snapshot" :: held 10.363s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:25:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-5d818b82-5e6d-4741-bcdb-1aa1521b7cff tempest-VolumesSnapshotTestJSON-999544861 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.386s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:25:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-a75bf779-b104-4751-9e2a-6d7800b7a574 tempest-GroupSnapshotsTest-280274705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.852s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:25:59 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-a75bf779-b104-4751-9e2a-6d7800b7a574 tempest-GroupSnapshotsTest-280274705 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=59044c47-4da5-45d5-9e66-311f64961976,created_at=2026-09-15T14:25:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1645097002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=59044c47-4da5-45d5-9e66-311f64961976,host='devstack@QuobyteHD#QuobyteHD',id=01e91647-e636-4131-9cfe-43108983ea2d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='293c2399eae1433ab0ed844313ad3ede',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:25:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:25:56Z,use_quota=True,user_id='f1accc1a486645fdb84f42d2c33b632e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a2a8ef8b-c93f-4166-9136-ede815b0e75a),volume_type_id=a2a8ef8b-c93f-4166-9136-ede815b0e75a)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:25:59 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-a75bf779-b104-4751-9e2a-6d7800b7a574 tempest-GroupSnapshotsTest-280274705 None] Creating volume 01e91647-e636-4131-9cfe-43108983ea2d {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:25:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-a75bf779-b104-4751-9e2a-6d7800b7a574 tempest-GroupSnapshotsTest-280274705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:25:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-a75bf779-b104-4751-9e2a-6d7800b7a574 tempest-GroupSnapshotsTest-280274705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:25:59 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-a75bf779-b104-4751-9e2a-6d7800b7a574 tempest-GroupSnapshotsTest-280274705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:25:59 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-a75bf779-b104-4751-9e2a-6d7800b7a574 tempest-GroupSnapshotsTest-280274705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:25:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-a75bf779-b104-4751-9e2a-6d7800b7a574 tempest-GroupSnapshotsTest-280274705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:25:59 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-a75bf779-b104-4751-9e2a-6d7800b7a574 tempest-GroupSnapshotsTest-280274705 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:25:59 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-a75bf779-b104-4751-9e2a-6d7800b7a574 tempest-GroupSnapshotsTest-280274705 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:25:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a75bf779-b104-4751-9e2a-6d7800b7a574 tempest-GroupSnapshotsTest-280274705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-01e91647-e636-4131-9cfe-43108983ea2d 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:25:59 devstack sudo[98265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-01e91647-e636-4131-9cfe-43108983ea2d 1073741824 Sep 15 16:25:59 devstack sudo[98265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:25:59 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5d818b82-5e6d-4741-bcdb-1aa1521b7cff tempest-VolumesSnapshotTestJSON-999544861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d43b9c80-a7dd-4868-a23c-b600e668ff82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-669a1f11-2b21-4874-b110-9a80f5655779', 'volume_size': 1, 'snapshot_id': 'e0d3a702-039a-4278-96d3-6f02ba6b7442'}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:25:59 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5d818b82-5e6d-4741-bcdb-1aa1521b7cff tempest-VolumesSnapshotTestJSON-999544861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fb6e5e4-7919-4f0d-89cb-0c20615ab824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:25:59 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-5d818b82-5e6d-4741-bcdb-1aa1521b7cff tempest-VolumesSnapshotTestJSON-999544861 None] Volume volume-669a1f11-2b21-4874-b110-9a80f5655779 (669a1f11-2b21-4874-b110-9a80f5655779): created successfully Sep 15 16:25:59 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5d818b82-5e6d-4741-bcdb-1aa1521b7cff tempest-VolumesSnapshotTestJSON-999544861 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fb6e5e4-7919-4f0d-89cb-0c20615ab824) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:25:59 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5d818b82-5e6d-4741-bcdb-1aa1521b7cff tempest-VolumesSnapshotTestJSON-999544861 None] Flow 'volume_create_manager' (cb79c7ca-891c-44e2-8428-02eb52310ff5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:25:59 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-5d818b82-5e6d-4741-bcdb-1aa1521b7cff tempest-VolumesSnapshotTestJSON-999544861 None] Created volume successfully. Sep 15 16:25:59 devstack sudo[98265]: pam_unix(sudo:session): session closed for user root Sep 15 16:25:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a75bf779-b104-4751-9e2a-6d7800b7a574 tempest-GroupSnapshotsTest-280274705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-01e91647-e636-4131-9cfe-43108983ea2d 1073741824" returned: 0 in 0.604s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:25:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a75bf779-b104-4751-9e2a-6d7800b7a574 tempest-GroupSnapshotsTest-280274705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-01e91647-e636-4131-9cfe-43108983ea2d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:25:59 devstack sudo[98270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-01e91647-e636-4131-9cfe-43108983ea2d Sep 15 16:25:59 devstack sudo[98270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:25:59 devstack cinder-volume[86082]: DEBUG oslo_service.periodic_task [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86082) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 15 16:25:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:25:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:25:59 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:25:59 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:25:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:25:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:25:59 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-2df672fe-a6b0-4160-a87b-971560f6694f tempest-VolumesSnapshotTestJSON-999544861 None] Acquiring lock "cinder-669a1f11-2b21-4874-b110-9a80f5655779-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:25:59 devstack sudo[98272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:25:59 devstack sudo[98272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:25:59 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-2df672fe-a6b0-4160-a87b-971560f6694f tempest-VolumesSnapshotTestJSON-999544861 None] Lock "cinder-669a1f11-2b21-4874-b110-9a80f5655779-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:26:00 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-2df672fe-a6b0-4160-a87b-971560f6694f tempest-VolumesSnapshotTestJSON-999544861 None] Acquiring lock "cinder-quobyte-669a1f11-2b21-4874-b110-9a80f5655779" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:26:00 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-2df672fe-a6b0-4160-a87b-971560f6694f tempest-VolumesSnapshotTestJSON-999544861 None] Lock "cinder-quobyte-669a1f11-2b21-4874-b110-9a80f5655779" acquired by "delete_volume" :: waited 0.021s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:26:00 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8c24518-af81-4904-b629-887b39e1a538]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:26:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2df672fe-a6b0-4160-a87b-971560f6694f tempest-VolumesSnapshotTestJSON-999544861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-669a1f11-2b21-4874-b110-9a80f5655779 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:26:00 devstack sudo[98270]: pam_unix(sudo:session): session closed for user root Sep 15 16:26:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a75bf779-b104-4751-9e2a-6d7800b7a574 tempest-GroupSnapshotsTest-280274705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-01e91647-e636-4131-9cfe-43108983ea2d" returned: 0 in 0.428s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:26:00 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-a75bf779-b104-4751-9e2a-6d7800b7a574 tempest-GroupSnapshotsTest-280274705 None] <== create_volume: return (1100ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:26:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-a75bf779-b104-4751-9e2a-6d7800b7a574 tempest-GroupSnapshotsTest-280274705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.103s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:26:00 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-a75bf779-b104-4751-9e2a-6d7800b7a574 tempest-GroupSnapshotsTest-280274705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9caadbc2-bc36-4659-884a-eb369548f262) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01e91647-e636-4131-9cfe-43108983ea2d', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:26:00 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-a75bf779-b104-4751-9e2a-6d7800b7a574 tempest-GroupSnapshotsTest-280274705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c2f59cd-6ef4-4172-886c-429d62aa84eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:26:00 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-a75bf779-b104-4751-9e2a-6d7800b7a574 tempest-GroupSnapshotsTest-280274705 None] Volume volume-01e91647-e636-4131-9cfe-43108983ea2d (01e91647-e636-4131-9cfe-43108983ea2d): created successfully Sep 15 16:26:00 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-a75bf779-b104-4751-9e2a-6d7800b7a574 tempest-GroupSnapshotsTest-280274705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c2f59cd-6ef4-4172-886c-429d62aa84eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:26:00 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-a75bf779-b104-4751-9e2a-6d7800b7a574 tempest-GroupSnapshotsTest-280274705 None] Flow 'volume_create_manager' (8f4c48e1-7361-427b-8d80-8774c1174187) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:26:00 devstack sudo[98275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-669a1f11-2b21-4874-b110-9a80f5655779 Sep 15 16:26:00 devstack sudo[98275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:26:00 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-a75bf779-b104-4751-9e2a-6d7800b7a574 tempest-GroupSnapshotsTest-280274705 None] Created volume successfully. Sep 15 16:26:00 devstack sudo[98272]: pam_unix(sudo:session): session closed for user root Sep 15 16:26:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.440s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:26:00 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:26:00 devstack cinder-volume[86082]: DEBUG oslo_service.periodic_task [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Running periodic task VolumeManager._thread_info {{(pid=86082) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 15 16:26:00 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] thread count: 28 {{(pid=86082) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 15 16:26:00 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] thread info: [<_MainThread(MainThread, started 124875935469696)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86082) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 15 16:26:00 devstack sudo[98275]: pam_unix(sudo:session): session closed for user root Sep 15 16:26:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2df672fe-a6b0-4160-a87b-971560f6694f tempest-VolumesSnapshotTestJSON-999544861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-669a1f11-2b21-4874-b110-9a80f5655779" returned: 0 in 0.474s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:26:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2df672fe-a6b0-4160-a87b-971560f6694f tempest-VolumesSnapshotTestJSON-999544861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-669a1f11-2b21-4874-b110-9a80f5655779 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:26:00 devstack sudo[98281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-669a1f11-2b21-4874-b110-9a80f5655779 Sep 15 16:26:00 devstack sudo[98281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:26:00 devstack sudo[98281]: pam_unix(sudo:session): session closed for user root Sep 15 16:26:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2df672fe-a6b0-4160-a87b-971560f6694f tempest-VolumesSnapshotTestJSON-999544861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-669a1f11-2b21-4874-b110-9a80f5655779" returned: 0 in 0.259s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:26:00 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-2df672fe-a6b0-4160-a87b-971560f6694f tempest-VolumesSnapshotTestJSON-999544861 None] Lock "cinder-quobyte-669a1f11-2b21-4874-b110-9a80f5655779" released by "delete_volume" :: held 0.818s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:26:00 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-2df672fe-a6b0-4160-a87b-971560f6694f tempest-VolumesSnapshotTestJSON-999544861 None] Created reservations ['106b3bfc-e031-4abb-aeed-b212e70690af', 'd9098b0b-f29b-4b9a-b447-40057dea8320', '124dea8d-3f73-411b-8265-bf606a6ad74f', '58f22ce7-3b5f-4401-9669-b11a253fc447'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:26:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-2df672fe-a6b0-4160-a87b-971560f6694f tempest-VolumesSnapshotTestJSON-999544861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:26:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-2df672fe-a6b0-4160-a87b-971560f6694f tempest-VolumesSnapshotTestJSON-999544861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:26:01 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-2df672fe-a6b0-4160-a87b-971560f6694f tempest-VolumesSnapshotTestJSON-999544861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:26:01 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-2df672fe-a6b0-4160-a87b-971560f6694f tempest-VolumesSnapshotTestJSON-999544861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:26:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-2df672fe-a6b0-4160-a87b-971560f6694f tempest-VolumesSnapshotTestJSON-999544861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:26:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2df672fe-a6b0-4160-a87b-971560f6694f tempest-VolumesSnapshotTestJSON-999544861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:26:01 devstack sudo[98284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:26:01 devstack sudo[98284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:26:01 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-95d6c665-5a6a-4727-8aae-b10261e9b137 tempest-VolumesSnapshotTestJSON-999544861 None] Acquiring lock "cinder-e0d3a702-039a-4278-96d3-6f02ba6b7442-delete_snapshot" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:26:01 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-95d6c665-5a6a-4727-8aae-b10261e9b137 tempest-VolumesSnapshotTestJSON-999544861 None] Lock "cinder-e0d3a702-039a-4278-96d3-6f02ba6b7442-delete_snapshot" acquired by "delete_snapshot" :: waited 0.050s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:26:01 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-95d6c665-5a6a-4727-8aae-b10261e9b137 tempest-VolumesSnapshotTestJSON-999544861 None] Acquiring lock "cinder-quobyte-330210a8-582b-48ec-bcb5-c77ce019f7b3" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:26:01 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-95d6c665-5a6a-4727-8aae-b10261e9b137 tempest-VolumesSnapshotTestJSON-999544861 None] Lock "cinder-quobyte-330210a8-582b-48ec-bcb5-c77ce019f7b3" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:26:01 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-95d6c665-5a6a-4727-8aae-b10261e9b137 tempest-VolumesSnapshotTestJSON-999544861 None] Acquiring lock "cinder-quobyte-e0d3a702-039a-4278-96d3-6f02ba6b7442" by "_delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:26:01 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-95d6c665-5a6a-4727-8aae-b10261e9b137 tempest-VolumesSnapshotTestJSON-999544861 None] Lock "cinder-quobyte-e0d3a702-039a-4278-96d3-6f02ba6b7442" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:26:01 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-95d6c665-5a6a-4727-8aae-b10261e9b137 tempest-VolumesSnapshotTestJSON-999544861 None] Deleting offline snapshot e0d3a702-039a-4278-96d3-6f02ba6b7442 of volume 330210a8-582b-48ec-bcb5-c77ce019f7b3 {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 15 16:26:01 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-95d6c665-5a6a-4727-8aae-b10261e9b137 tempest-VolumesSnapshotTestJSON-999544861 None] snapshot_file for this snap is: volume-330210a8-582b-48ec-bcb5-c77ce019f7b3.e0d3a702-039a-4278-96d3-6f02ba6b7442 {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 15 16:26:01 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f0a44bc-cf62-449a-9844-e9a0f63865ca]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:26:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-95d6c665-5a6a-4727-8aae-b10261e9b137 tempest-VolumesSnapshotTestJSON-999544861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-330210a8-582b-48ec-bcb5-c77ce019f7b3.e0d3a702-039a-4278-96d3-6f02ba6b7442 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:26:01 devstack sudo[98284]: pam_unix(sudo:session): session closed for user root Sep 15 16:26:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2df672fe-a6b0-4160-a87b-971560f6694f tempest-VolumesSnapshotTestJSON-999544861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.527s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:26:01 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-2df672fe-a6b0-4160-a87b-971560f6694f tempest-VolumesSnapshotTestJSON-999544861 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:26:01 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-2df672fe-a6b0-4160-a87b-971560f6694f tempest-VolumesSnapshotTestJSON-999544861 None] Deleted volume successfully. Sep 15 16:26:01 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-2df672fe-a6b0-4160-a87b-971560f6694f tempest-VolumesSnapshotTestJSON-999544861 None] Lock "cinder-669a1f11-2b21-4874-b110-9a80f5655779-delete_volume" released by "delete_volume" :: held 1.748s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:26:01 devstack sudo[98286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-330210a8-582b-48ec-bcb5-c77ce019f7b3.e0d3a702-039a-4278-96d3-6f02ba6b7442 Sep 15 16:26:01 devstack sudo[98286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:26:01 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-54293e55-abea-492d-9199-ceae62b5c0da tempest-GroupSnapshotsTest-280274705 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:26:01 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-54293e55-abea-492d-9199-ceae62b5c0da tempest-GroupSnapshotsTest-280274705 None] Flow 'volume_create_manager' (53a8802a-7558-4505-8ae4-95868ebaa7c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:26:01 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-54293e55-abea-492d-9199-ceae62b5c0da tempest-GroupSnapshotsTest-280274705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f169da8-5069-4d94-8305-f0c92d1ceeb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:26:02 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-54293e55-abea-492d-9199-ceae62b5c0da tempest-GroupSnapshotsTest-280274705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f169da8-5069-4d94-8305-f0c92d1ceeb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:26:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-946506056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=59044c47-4da5-45d5-9e66-311f64961976,host='devstack@QuobyteHD#QuobyteHD',id=0d723edf-fb04-4aa4-a8ad-41d1248f1395,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='293c2399eae1433ab0ed844313ad3ede',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:26:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:26:02Z,use_quota=True,user_id='f1accc1a486645fdb84f42d2c33b632e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a2a8ef8b-c93f-4166-9136-ede815b0e75a),volume_type_id=a2a8ef8b-c93f-4166-9136-ede815b0e75a)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:26:02 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-54293e55-abea-492d-9199-ceae62b5c0da tempest-GroupSnapshotsTest-280274705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88ae594a-a652-4078-ae59-b6be347eabf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:26:02 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-54293e55-abea-492d-9199-ceae62b5c0da tempest-GroupSnapshotsTest-280274705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88ae594a-a652-4078-ae59-b6be347eabf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:26:02 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-54293e55-abea-492d-9199-ceae62b5c0da tempest-GroupSnapshotsTest-280274705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b5a41a9-de87-4bb7-9c6b-70b23c950458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:26:02 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-54293e55-abea-492d-9199-ceae62b5c0da tempest-GroupSnapshotsTest-280274705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b5a41a9-de87-4bb7-9c6b-70b23c950458) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d723edf-fb04-4aa4-a8ad-41d1248f1395', 'volume_name': 'volume-0d723edf-fb04-4aa4-a8ad-41d1248f1395', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:26:02 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-54293e55-abea-492d-9199-ceae62b5c0da tempest-GroupSnapshotsTest-280274705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb09ff65-376d-431d-af9c-5d6d66904d87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:26:02 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-54293e55-abea-492d-9199-ceae62b5c0da tempest-GroupSnapshotsTest-280274705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb09ff65-376d-431d-af9c-5d6d66904d87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:26:02 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-54293e55-abea-492d-9199-ceae62b5c0da tempest-GroupSnapshotsTest-280274705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbd80f4a-0773-42bc-926b-2ca7f4d21f1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:26:02 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-54293e55-abea-492d-9199-ceae62b5c0da tempest-GroupSnapshotsTest-280274705 None] Volume 0d723edf-fb04-4aa4-a8ad-41d1248f1395: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d723edf-fb04-4aa4-a8ad-41d1248f1395', 'volume_size': 1} Sep 15 16:26:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-54293e55-abea-492d-9199-ceae62b5c0da tempest-GroupSnapshotsTest-280274705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:26:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-54293e55-abea-492d-9199-ceae62b5c0da tempest-GroupSnapshotsTest-280274705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:26:02 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-54293e55-abea-492d-9199-ceae62b5c0da tempest-GroupSnapshotsTest-280274705 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=59044c47-4da5-45d5-9e66-311f64961976,created_at=2026-09-15T14:26:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-946506056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=59044c47-4da5-45d5-9e66-311f64961976,host='devstack@QuobyteHD#QuobyteHD',id=0d723edf-fb04-4aa4-a8ad-41d1248f1395,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='293c2399eae1433ab0ed844313ad3ede',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:26:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:26:02Z,use_quota=True,user_id='f1accc1a486645fdb84f42d2c33b632e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a2a8ef8b-c93f-4166-9136-ede815b0e75a),volume_type_id=a2a8ef8b-c93f-4166-9136-ede815b0e75a)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:26:02 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-54293e55-abea-492d-9199-ceae62b5c0da tempest-GroupSnapshotsTest-280274705 None] Creating volume 0d723edf-fb04-4aa4-a8ad-41d1248f1395 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:26:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-54293e55-abea-492d-9199-ceae62b5c0da tempest-GroupSnapshotsTest-280274705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:26:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-54293e55-abea-492d-9199-ceae62b5c0da tempest-GroupSnapshotsTest-280274705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:26:02 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-54293e55-abea-492d-9199-ceae62b5c0da tempest-GroupSnapshotsTest-280274705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:26:02 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-54293e55-abea-492d-9199-ceae62b5c0da tempest-GroupSnapshotsTest-280274705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:26:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-54293e55-abea-492d-9199-ceae62b5c0da tempest-GroupSnapshotsTest-280274705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:26:02 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-54293e55-abea-492d-9199-ceae62b5c0da tempest-GroupSnapshotsTest-280274705 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:26:02 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-54293e55-abea-492d-9199-ceae62b5c0da tempest-GroupSnapshotsTest-280274705 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:26:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-54293e55-abea-492d-9199-ceae62b5c0da tempest-GroupSnapshotsTest-280274705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0d723edf-fb04-4aa4-a8ad-41d1248f1395 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:26:02 devstack sudo[98286]: pam_unix(sudo:session): session closed for user root Sep 15 16:26:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-95d6c665-5a6a-4727-8aae-b10261e9b137 tempest-VolumesSnapshotTestJSON-999544861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-330210a8-582b-48ec-bcb5-c77ce019f7b3.e0d3a702-039a-4278-96d3-6f02ba6b7442" returned: 0 in 0.633s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:26:02 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-95d6c665-5a6a-4727-8aae-b10261e9b137 tempest-VolumesSnapshotTestJSON-999544861 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-330210a8-582b-48ec-bcb5-c77ce019f7b3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 16:26:02 devstack sudo[98292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0d723edf-fb04-4aa4-a8ad-41d1248f1395 1073741824 Sep 15 16:26:02 devstack sudo[98292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:26:02 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[1822de43-d35b-482b-b664-6919fd891d01]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:26:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-95d6c665-5a6a-4727-8aae-b10261e9b137 tempest-VolumesSnapshotTestJSON-999544861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-330210a8-582b-48ec-bcb5-c77ce019f7b3 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:26:02 devstack sudo[98294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-330210a8-582b-48ec-bcb5-c77ce019f7b3 Sep 15 16:26:02 devstack sudo[98294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:26:02 devstack sudo[98292]: pam_unix(sudo:session): session closed for user root Sep 15 16:26:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-54293e55-abea-492d-9199-ceae62b5c0da tempest-GroupSnapshotsTest-280274705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0d723edf-fb04-4aa4-a8ad-41d1248f1395 1073741824" returned: 0 in 0.713s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:26:02 devstack sudo[98294]: pam_unix(sudo:session): session closed for user root Sep 15 16:26:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-95d6c665-5a6a-4727-8aae-b10261e9b137 tempest-VolumesSnapshotTestJSON-999544861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-330210a8-582b-48ec-bcb5-c77ce019f7b3" returned: 0 in 0.691s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:26:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-95d6c665-5a6a-4727-8aae-b10261e9b137 tempest-VolumesSnapshotTestJSON-999544861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-330210a8-582b-48ec-bcb5-c77ce019f7b3.e0d3a702-039a-4278-96d3-6f02ba6b7442 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:26:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-54293e55-abea-492d-9199-ceae62b5c0da tempest-GroupSnapshotsTest-280274705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0d723edf-fb04-4aa4-a8ad-41d1248f1395 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:26:02 devstack sudo[98303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-330210a8-582b-48ec-bcb5-c77ce019f7b3.e0d3a702-039a-4278-96d3-6f02ba6b7442 Sep 15 16:26:02 devstack sudo[98303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:26:02 devstack sudo[98304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0d723edf-fb04-4aa4-a8ad-41d1248f1395 Sep 15 16:26:02 devstack sudo[98304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:26:03 devstack sudo[98304]: pam_unix(sudo:session): session closed for user root Sep 15 16:26:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-54293e55-abea-492d-9199-ceae62b5c0da tempest-GroupSnapshotsTest-280274705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0d723edf-fb04-4aa4-a8ad-41d1248f1395" returned: 0 in 0.311s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:26:03 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-54293e55-abea-492d-9199-ceae62b5c0da tempest-GroupSnapshotsTest-280274705 None] <== create_volume: return (1123ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:26:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-54293e55-abea-492d-9199-ceae62b5c0da tempest-GroupSnapshotsTest-280274705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.129s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:26:03 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-54293e55-abea-492d-9199-ceae62b5c0da tempest-GroupSnapshotsTest-280274705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbd80f4a-0773-42bc-926b-2ca7f4d21f1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d723edf-fb04-4aa4-a8ad-41d1248f1395', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:26:03 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-54293e55-abea-492d-9199-ceae62b5c0da tempest-GroupSnapshotsTest-280274705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab90d5a2-1c6b-422a-8cca-50e1de3feade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:26:03 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-54293e55-abea-492d-9199-ceae62b5c0da tempest-GroupSnapshotsTest-280274705 None] Volume volume-0d723edf-fb04-4aa4-a8ad-41d1248f1395 (0d723edf-fb04-4aa4-a8ad-41d1248f1395): created successfully Sep 15 16:26:03 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-54293e55-abea-492d-9199-ceae62b5c0da tempest-GroupSnapshotsTest-280274705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab90d5a2-1c6b-422a-8cca-50e1de3feade) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:26:03 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-54293e55-abea-492d-9199-ceae62b5c0da tempest-GroupSnapshotsTest-280274705 None] Flow 'volume_create_manager' (53a8802a-7558-4505-8ae4-95868ebaa7c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:26:03 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-54293e55-abea-492d-9199-ceae62b5c0da tempest-GroupSnapshotsTest-280274705 None] Created volume successfully. Sep 15 16:26:03 devstack sudo[98303]: pam_unix(sudo:session): session closed for user root Sep 15 16:26:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-95d6c665-5a6a-4727-8aae-b10261e9b137 tempest-VolumesSnapshotTestJSON-999544861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-330210a8-582b-48ec-bcb5-c77ce019f7b3.e0d3a702-039a-4278-96d3-6f02ba6b7442" returned: 0 in 0.512s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:26:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-95d6c665-5a6a-4727-8aae-b10261e9b137 tempest-VolumesSnapshotTestJSON-999544861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-330210a8-582b-48ec-bcb5-c77ce019f7b3.e0d3a702-039a-4278-96d3-6f02ba6b7442 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:26:03 devstack sudo[98311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-330210a8-582b-48ec-bcb5-c77ce019f7b3.e0d3a702-039a-4278-96d3-6f02ba6b7442 Sep 15 16:26:03 devstack sudo[98311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:26:03 devstack sudo[98311]: pam_unix(sudo:session): session closed for user root Sep 15 16:26:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-95d6c665-5a6a-4727-8aae-b10261e9b137 tempest-VolumesSnapshotTestJSON-999544861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-330210a8-582b-48ec-bcb5-c77ce019f7b3.e0d3a702-039a-4278-96d3-6f02ba6b7442" returned: 0 in 0.310s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:26:03 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-95d6c665-5a6a-4727-8aae-b10261e9b137 tempest-VolumesSnapshotTestJSON-999544861 None] Lock "cinder-quobyte-e0d3a702-039a-4278-96d3-6f02ba6b7442" released by "_delete_snapshot" :: held 2.333s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:26:03 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-95d6c665-5a6a-4727-8aae-b10261e9b137 tempest-VolumesSnapshotTestJSON-999544861 None] Lock "cinder-quobyte-330210a8-582b-48ec-bcb5-c77ce019f7b3" released by "delete_snapshot" :: held 2.376s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:26:03 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-95d6c665-5a6a-4727-8aae-b10261e9b137 tempest-VolumesSnapshotTestJSON-999544861 None] Created reservations ['e90da714-9f85-4150-b0fe-a4f7fbe58a99', '63e08ebb-96b0-48a9-8bf5-0d40faedab4e', '2aae63bc-a08c-43c6-b9c3-4705f2f04fa4', 'b7c87c76-6dcd-4cd8-8248-0784a13d6959'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:26:03 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-95d6c665-5a6a-4727-8aae-b10261e9b137 tempest-VolumesSnapshotTestJSON-999544861 None] Delete snapshot completed successfully. Sep 15 16:26:03 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-95d6c665-5a6a-4727-8aae-b10261e9b137 tempest-VolumesSnapshotTestJSON-999544861 None] Lock "cinder-e0d3a702-039a-4278-96d3-6f02ba6b7442-delete_snapshot" released by "delete_snapshot" :: held 2.579s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:26:04 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-19a2ba68-61e2-4cf7-be71-d65a0c67e403 tempest-GroupSnapshotsTest-280274705 None] Update group completed successfully. Sep 15 16:26:04 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-a14eff26-5dde-4d4e-b2b6-7794ce8b063d tempest-VolumesSnapshotTestJSON-999544861 None] Acquiring lock "cinder-330210a8-582b-48ec-bcb5-c77ce019f7b3-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:26:04 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-a14eff26-5dde-4d4e-b2b6-7794ce8b063d tempest-VolumesSnapshotTestJSON-999544861 None] Lock "cinder-330210a8-582b-48ec-bcb5-c77ce019f7b3-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:26:04 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-a14eff26-5dde-4d4e-b2b6-7794ce8b063d tempest-VolumesSnapshotTestJSON-999544861 None] Acquiring lock "cinder-quobyte-330210a8-582b-48ec-bcb5-c77ce019f7b3" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:26:04 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-a14eff26-5dde-4d4e-b2b6-7794ce8b063d tempest-VolumesSnapshotTestJSON-999544861 None] Lock "cinder-quobyte-330210a8-582b-48ec-bcb5-c77ce019f7b3" acquired by "delete_volume" :: waited 0.018s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:26:04 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa30d6c0-840b-4bbf-a419-72bb147e3be6]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:26:04 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a14eff26-5dde-4d4e-b2b6-7794ce8b063d tempest-VolumesSnapshotTestJSON-999544861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-330210a8-582b-48ec-bcb5-c77ce019f7b3 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:26:05 devstack sudo[98315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-330210a8-582b-48ec-bcb5-c77ce019f7b3 Sep 15 16:26:05 devstack sudo[98315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:26:05 devstack sudo[98315]: pam_unix(sudo:session): session closed for user root Sep 15 16:26:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a14eff26-5dde-4d4e-b2b6-7794ce8b063d tempest-VolumesSnapshotTestJSON-999544861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-330210a8-582b-48ec-bcb5-c77ce019f7b3" returned: 0 in 0.449s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:26:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a14eff26-5dde-4d4e-b2b6-7794ce8b063d tempest-VolumesSnapshotTestJSON-999544861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-330210a8-582b-48ec-bcb5-c77ce019f7b3 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:26:05 devstack sudo[98320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-330210a8-582b-48ec-bcb5-c77ce019f7b3 Sep 15 16:26:05 devstack sudo[98320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:26:05 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-163a8314-ed10-45e4-aa64-bc929f569674 tempest-VolumesServicesTestJSON-315437773 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:26:05 devstack sudo[98320]: pam_unix(sudo:session): session closed for user root Sep 15 16:26:05 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-163a8314-ed10-45e4-aa64-bc929f569674 tempest-VolumesServicesTestJSON-315437773 None] Flow 'volume_create_manager' (2e0137da-5c4c-4409-a3f7-290935f08e80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:26:05 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-163a8314-ed10-45e4-aa64-bc929f569674 tempest-VolumesServicesTestJSON-315437773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de27407b-6f96-4df4-bc96-222d6069c0b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:26:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a14eff26-5dde-4d4e-b2b6-7794ce8b063d tempest-VolumesSnapshotTestJSON-999544861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-330210a8-582b-48ec-bcb5-c77ce019f7b3" returned: 0 in 0.419s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:26:05 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-163a8314-ed10-45e4-aa64-bc929f569674 tempest-VolumesServicesTestJSON-315437773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de27407b-6f96-4df4-bc96-222d6069c0b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:26:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-615820872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38df2128-1f1d-4e63-b7df-12933eb51b5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5b7c3234c3d4f2b88701cb2b7dbcbe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:26:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:26:06Z,use_quota=True,user_id='97e76559c4ac4d05a202fb7ed348f666',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:26:05 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-163a8314-ed10-45e4-aa64-bc929f569674 tempest-VolumesServicesTestJSON-315437773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5408ea3-996d-4fd5-8702-9e0f33958b5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:26:05 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-163a8314-ed10-45e4-aa64-bc929f569674 tempest-VolumesServicesTestJSON-315437773 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5408ea3-996d-4fd5-8702-9e0f33958b5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:26:05 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-163a8314-ed10-45e4-aa64-bc929f569674 tempest-VolumesServicesTestJSON-315437773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c2d3832-3999-470d-8a44-ecc1e02a5664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:26:05 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-163a8314-ed10-45e4-aa64-bc929f569674 tempest-VolumesServicesTestJSON-315437773 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c2d3832-3999-470d-8a44-ecc1e02a5664) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38df2128-1f1d-4e63-b7df-12933eb51b5f', 'volume_name': 'volume-38df2128-1f1d-4e63-b7df-12933eb51b5f', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:26:05 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-163a8314-ed10-45e4-aa64-bc929f569674 tempest-VolumesServicesTestJSON-315437773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3404919-b3ff-4e6d-bf42-202346189af8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:26:05 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-163a8314-ed10-45e4-aa64-bc929f569674 tempest-VolumesServicesTestJSON-315437773 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3404919-b3ff-4e6d-bf42-202346189af8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:26:05 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-163a8314-ed10-45e4-aa64-bc929f569674 tempest-VolumesServicesTestJSON-315437773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0ac3ff1-2310-4dc6-b298-135448acca46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:26:05 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-163a8314-ed10-45e4-aa64-bc929f569674 tempest-VolumesServicesTestJSON-315437773 None] Volume 38df2128-1f1d-4e63-b7df-12933eb51b5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38df2128-1f1d-4e63-b7df-12933eb51b5f', 'volume_size': 1} Sep 15 16:26:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-163a8314-ed10-45e4-aa64-bc929f569674 tempest-VolumesServicesTestJSON-315437773 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:26:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-163a8314-ed10-45e4-aa64-bc929f569674 tempest-VolumesServicesTestJSON-315437773 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:26:05 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-163a8314-ed10-45e4-aa64-bc929f569674 tempest-VolumesServicesTestJSON-315437773 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:26:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-615820872',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38df2128-1f1d-4e63-b7df-12933eb51b5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5b7c3234c3d4f2b88701cb2b7dbcbe6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:26:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:26:06Z,use_quota=True,user_id='97e76559c4ac4d05a202fb7ed348f666',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:26:05 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-163a8314-ed10-45e4-aa64-bc929f569674 tempest-VolumesServicesTestJSON-315437773 None] Creating volume 38df2128-1f1d-4e63-b7df-12933eb51b5f {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:26:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-163a8314-ed10-45e4-aa64-bc929f569674 tempest-VolumesServicesTestJSON-315437773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:26:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-163a8314-ed10-45e4-aa64-bc929f569674 tempest-VolumesServicesTestJSON-315437773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:26:05 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-163a8314-ed10-45e4-aa64-bc929f569674 tempest-VolumesServicesTestJSON-315437773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:26:05 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-163a8314-ed10-45e4-aa64-bc929f569674 tempest-VolumesServicesTestJSON-315437773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:26:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-163a8314-ed10-45e4-aa64-bc929f569674 tempest-VolumesServicesTestJSON-315437773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:26:05 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-163a8314-ed10-45e4-aa64-bc929f569674 tempest-VolumesServicesTestJSON-315437773 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:26:05 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-163a8314-ed10-45e4-aa64-bc929f569674 tempest-VolumesServicesTestJSON-315437773 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:26:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-163a8314-ed10-45e4-aa64-bc929f569674 tempest-VolumesServicesTestJSON-315437773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-38df2128-1f1d-4e63-b7df-12933eb51b5f 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:26:05 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-a14eff26-5dde-4d4e-b2b6-7794ce8b063d tempest-VolumesSnapshotTestJSON-999544861 None] Lock "cinder-quobyte-330210a8-582b-48ec-bcb5-c77ce019f7b3" released by "delete_volume" :: held 1.075s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:26:05 devstack sudo[98323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-38df2128-1f1d-4e63-b7df-12933eb51b5f 1073741824 Sep 15 16:26:05 devstack sudo[98323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:26:06 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-c6dbd9e5-14d6-4dd1-8235-ccf2ae5c8fc8 tempest-GroupSnapshotsTest-280274705 None] Update group completed successfully. Sep 15 16:26:06 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-a14eff26-5dde-4d4e-b2b6-7794ce8b063d tempest-VolumesSnapshotTestJSON-999544861 None] Created reservations ['4d731989-16f7-4d02-84af-5d7b2be6f18e', '572a5300-6032-4601-898d-16ac1b200581', 'dab1840a-2535-4d25-89f6-2256983c456a', '5305a548-4996-4187-9308-375c735ff34b'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:26:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-a14eff26-5dde-4d4e-b2b6-7794ce8b063d tempest-VolumesSnapshotTestJSON-999544861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:26:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-a14eff26-5dde-4d4e-b2b6-7794ce8b063d tempest-VolumesSnapshotTestJSON-999544861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:26:06 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-a14eff26-5dde-4d4e-b2b6-7794ce8b063d tempest-VolumesSnapshotTestJSON-999544861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:26:06 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-a14eff26-5dde-4d4e-b2b6-7794ce8b063d tempest-VolumesSnapshotTestJSON-999544861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:26:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-a14eff26-5dde-4d4e-b2b6-7794ce8b063d tempest-VolumesSnapshotTestJSON-999544861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:26:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a14eff26-5dde-4d4e-b2b6-7794ce8b063d tempest-VolumesSnapshotTestJSON-999544861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:26:06 devstack sudo[98326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:26:06 devstack sudo[98326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:26:06 devstack sudo[98326]: pam_unix(sudo:session): session closed for user root Sep 15 16:26:06 devstack sudo[98323]: pam_unix(sudo:session): session closed for user root Sep 15 16:26:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a14eff26-5dde-4d4e-b2b6-7794ce8b063d tempest-VolumesSnapshotTestJSON-999544861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.324s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:26:06 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-a14eff26-5dde-4d4e-b2b6-7794ce8b063d tempest-VolumesSnapshotTestJSON-999544861 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:26:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-163a8314-ed10-45e4-aa64-bc929f569674 tempest-VolumesServicesTestJSON-315437773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-38df2128-1f1d-4e63-b7df-12933eb51b5f 1073741824" returned: 0 in 0.565s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:26:06 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-a14eff26-5dde-4d4e-b2b6-7794ce8b063d tempest-VolumesSnapshotTestJSON-999544861 None] Deleted volume successfully. Sep 15 16:26:06 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-a14eff26-5dde-4d4e-b2b6-7794ce8b063d tempest-VolumesSnapshotTestJSON-999544861 None] Lock "cinder-330210a8-582b-48ec-bcb5-c77ce019f7b3-delete_volume" released by "delete_volume" :: held 1.741s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:26:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-163a8314-ed10-45e4-aa64-bc929f569674 tempest-VolumesServicesTestJSON-315437773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-38df2128-1f1d-4e63-b7df-12933eb51b5f {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:26:06 devstack sudo[98332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-38df2128-1f1d-4e63-b7df-12933eb51b5f Sep 15 16:26:06 devstack sudo[98332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:26:06 devstack sudo[98332]: pam_unix(sudo:session): session closed for user root Sep 15 16:26:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-163a8314-ed10-45e4-aa64-bc929f569674 tempest-VolumesServicesTestJSON-315437773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-38df2128-1f1d-4e63-b7df-12933eb51b5f" returned: 0 in 0.325s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:26:06 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-163a8314-ed10-45e4-aa64-bc929f569674 tempest-VolumesServicesTestJSON-315437773 None] <== create_volume: return (957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:26:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-163a8314-ed10-45e4-aa64-bc929f569674 tempest-VolumesServicesTestJSON-315437773 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.961s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:26:06 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-163a8314-ed10-45e4-aa64-bc929f569674 tempest-VolumesServicesTestJSON-315437773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0ac3ff1-2310-4dc6-b298-135448acca46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38df2128-1f1d-4e63-b7df-12933eb51b5f', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:26:06 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-163a8314-ed10-45e4-aa64-bc929f569674 tempest-VolumesServicesTestJSON-315437773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (feee7ef5-069d-4065-915d-1b9ff09cafed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:26:06 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-163a8314-ed10-45e4-aa64-bc929f569674 tempest-VolumesServicesTestJSON-315437773 None] Volume volume-38df2128-1f1d-4e63-b7df-12933eb51b5f (38df2128-1f1d-4e63-b7df-12933eb51b5f): created successfully Sep 15 16:26:06 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-163a8314-ed10-45e4-aa64-bc929f569674 tempest-VolumesServicesTestJSON-315437773 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (feee7ef5-069d-4065-915d-1b9ff09cafed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:26:06 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-163a8314-ed10-45e4-aa64-bc929f569674 tempest-VolumesServicesTestJSON-315437773 None] Flow 'volume_create_manager' (2e0137da-5c4c-4409-a3f7-290935f08e80) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:26:06 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-163a8314-ed10-45e4-aa64-bc929f569674 tempest-VolumesServicesTestJSON-315437773 None] Created volume successfully. Sep 15 16:26:07 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-6a6432b4-01d6-4f87-94ab-cf69140cc70b tempest-VolumesSnapshotTestJSON-999544861 None] Acquiring lock "cinder-21496a3e-4636-47a1-a8da-1b96049fe201-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:26:07 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-6a6432b4-01d6-4f87-94ab-cf69140cc70b tempest-VolumesSnapshotTestJSON-999544861 None] Lock "cinder-21496a3e-4636-47a1-a8da-1b96049fe201-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:26:07 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-41d751f8-dacb-4d27-9959-493cfb3ba5ff tempest-GroupSnapshotsTest-280274705 None] Update group completed successfully. Sep 15 16:26:07 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-6a6432b4-01d6-4f87-94ab-cf69140cc70b tempest-VolumesSnapshotTestJSON-999544861 None] Acquiring lock "cinder-quobyte-21496a3e-4636-47a1-a8da-1b96049fe201" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:26:07 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-6a6432b4-01d6-4f87-94ab-cf69140cc70b tempest-VolumesSnapshotTestJSON-999544861 None] Lock "cinder-quobyte-21496a3e-4636-47a1-a8da-1b96049fe201" acquired by "delete_volume" :: waited 0.020s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:26:07 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c3423fa-2e2d-4ade-9095-8bddf6279bc5]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:26:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-6a6432b4-01d6-4f87-94ab-cf69140cc70b tempest-VolumesSnapshotTestJSON-999544861 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-21496a3e-4636-47a1-a8da-1b96049fe201 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:26:07 devstack sudo[98335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-21496a3e-4636-47a1-a8da-1b96049fe201 Sep 15 16:26:07 devstack sudo[98335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:26:07 devstack sudo[98335]: pam_unix(sudo:session): session closed for user root Sep 15 16:26:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-6a6432b4-01d6-4f87-94ab-cf69140cc70b tempest-VolumesSnapshotTestJSON-999544861 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-21496a3e-4636-47a1-a8da-1b96049fe201" returned: 0 in 0.382s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:26:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-6a6432b4-01d6-4f87-94ab-cf69140cc70b tempest-VolumesSnapshotTestJSON-999544861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-21496a3e-4636-47a1-a8da-1b96049fe201 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:26:07 devstack sudo[98340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-21496a3e-4636-47a1-a8da-1b96049fe201 Sep 15 16:26:07 devstack sudo[98340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:26:07 devstack sudo[98340]: pam_unix(sudo:session): session closed for user root Sep 15 16:26:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-6a6432b4-01d6-4f87-94ab-cf69140cc70b tempest-VolumesSnapshotTestJSON-999544861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-21496a3e-4636-47a1-a8da-1b96049fe201" returned: 0 in 0.283s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:26:07 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-6a6432b4-01d6-4f87-94ab-cf69140cc70b tempest-VolumesSnapshotTestJSON-999544861 None] Lock "cinder-quobyte-21496a3e-4636-47a1-a8da-1b96049fe201" released by "delete_volume" :: held 0.748s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:26:08 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-480c8504-0de8-4429-b007-04e579fb9ab1 tempest-VolumesServicesTestJSON-315437773 None] Acquiring lock "cinder-38df2128-1f1d-4e63-b7df-12933eb51b5f-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:26:08 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-480c8504-0de8-4429-b007-04e579fb9ab1 tempest-VolumesServicesTestJSON-315437773 None] Lock "cinder-38df2128-1f1d-4e63-b7df-12933eb51b5f-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:26:08 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-6a6432b4-01d6-4f87-94ab-cf69140cc70b tempest-VolumesSnapshotTestJSON-999544861 None] Created reservations ['558dc515-3798-409e-82bc-fc35fa6803d2', '99343a49-23ed-4198-a92f-e3ed2b5ba2ae', '4956fd5a-fc8a-4089-bbb6-0e094254bc1c', '4e6c3b5a-5a13-4cc0-854f-931bb3d0d8aa'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:26:08 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-480c8504-0de8-4429-b007-04e579fb9ab1 tempest-VolumesServicesTestJSON-315437773 None] Acquiring lock "cinder-quobyte-38df2128-1f1d-4e63-b7df-12933eb51b5f" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:26:08 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-480c8504-0de8-4429-b007-04e579fb9ab1 tempest-VolumesServicesTestJSON-315437773 None] Lock "cinder-quobyte-38df2128-1f1d-4e63-b7df-12933eb51b5f" acquired by "delete_volume" :: waited 0.030s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:26:08 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c99c74a-0a9e-460e-a789-fe5772673326]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:26:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-480c8504-0de8-4429-b007-04e579fb9ab1 tempest-VolumesServicesTestJSON-315437773 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-38df2128-1f1d-4e63-b7df-12933eb51b5f {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:26:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-6a6432b4-01d6-4f87-94ab-cf69140cc70b tempest-VolumesSnapshotTestJSON-999544861 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:26:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-6a6432b4-01d6-4f87-94ab-cf69140cc70b tempest-VolumesSnapshotTestJSON-999544861 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:26:08 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-6a6432b4-01d6-4f87-94ab-cf69140cc70b tempest-VolumesSnapshotTestJSON-999544861 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:26:08 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-6a6432b4-01d6-4f87-94ab-cf69140cc70b tempest-VolumesSnapshotTestJSON-999544861 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:26:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-6a6432b4-01d6-4f87-94ab-cf69140cc70b tempest-VolumesSnapshotTestJSON-999544861 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:26:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-6a6432b4-01d6-4f87-94ab-cf69140cc70b tempest-VolumesSnapshotTestJSON-999544861 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:26:08 devstack sudo[98344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:26:08 devstack sudo[98344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:26:08 devstack sudo[98343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-38df2128-1f1d-4e63-b7df-12933eb51b5f Sep 15 16:26:08 devstack sudo[98343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:26:08 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-3217661f-d197-463c-b192-bcfe82e44218 tempest-GroupSnapshotsTest-280274705 None] Update group completed successfully. Sep 15 16:26:08 devstack sudo[98344]: pam_unix(sudo:session): session closed for user root Sep 15 16:26:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-6a6432b4-01d6-4f87-94ab-cf69140cc70b tempest-VolumesSnapshotTestJSON-999544861 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.381s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:26:08 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-6a6432b4-01d6-4f87-94ab-cf69140cc70b tempest-VolumesSnapshotTestJSON-999544861 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:26:08 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-6a6432b4-01d6-4f87-94ab-cf69140cc70b tempest-VolumesSnapshotTestJSON-999544861 None] Deleted volume successfully. Sep 15 16:26:08 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-6a6432b4-01d6-4f87-94ab-cf69140cc70b tempest-VolumesSnapshotTestJSON-999544861 None] Lock "cinder-21496a3e-4636-47a1-a8da-1b96049fe201-delete_volume" released by "delete_volume" :: held 1.527s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:26:08 devstack sudo[98343]: pam_unix(sudo:session): session closed for user root Sep 15 16:26:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-480c8504-0de8-4429-b007-04e579fb9ab1 tempest-VolumesServicesTestJSON-315437773 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-38df2128-1f1d-4e63-b7df-12933eb51b5f" returned: 0 in 0.534s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:26:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-480c8504-0de8-4429-b007-04e579fb9ab1 tempest-VolumesServicesTestJSON-315437773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-38df2128-1f1d-4e63-b7df-12933eb51b5f {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:26:08 devstack sudo[98353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-38df2128-1f1d-4e63-b7df-12933eb51b5f Sep 15 16:26:08 devstack sudo[98353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:26:09 devstack sudo[98353]: pam_unix(sudo:session): session closed for user root Sep 15 16:26:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-480c8504-0de8-4429-b007-04e579fb9ab1 tempest-VolumesServicesTestJSON-315437773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-38df2128-1f1d-4e63-b7df-12933eb51b5f" returned: 0 in 0.297s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:26:09 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-480c8504-0de8-4429-b007-04e579fb9ab1 tempest-VolumesServicesTestJSON-315437773 None] Lock "cinder-quobyte-38df2128-1f1d-4e63-b7df-12933eb51b5f" released by "delete_volume" :: held 0.901s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:26:09 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-480c8504-0de8-4429-b007-04e579fb9ab1 tempest-VolumesServicesTestJSON-315437773 None] Created reservations ['86af8dc1-964e-47d0-a4a2-6199df308a8a', 'e329882e-2730-43fd-ab20-1d2ad141f62f', '3fc634c2-49ec-45d3-9bd1-ce047f01b8ea', 'c410fd6f-a23c-4649-9b9d-2811d9d07cc5'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:26:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-480c8504-0de8-4429-b007-04e579fb9ab1 tempest-VolumesServicesTestJSON-315437773 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:26:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-480c8504-0de8-4429-b007-04e579fb9ab1 tempest-VolumesServicesTestJSON-315437773 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:26:09 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-480c8504-0de8-4429-b007-04e579fb9ab1 tempest-VolumesServicesTestJSON-315437773 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:26:09 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-480c8504-0de8-4429-b007-04e579fb9ab1 tempest-VolumesServicesTestJSON-315437773 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:26:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-480c8504-0de8-4429-b007-04e579fb9ab1 tempest-VolumesServicesTestJSON-315437773 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:26:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-480c8504-0de8-4429-b007-04e579fb9ab1 tempest-VolumesServicesTestJSON-315437773 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:26:09 devstack sudo[98356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:26:09 devstack sudo[98356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:26:09 devstack sudo[98356]: pam_unix(sudo:session): session closed for user root Sep 15 16:26:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-480c8504-0de8-4429-b007-04e579fb9ab1 tempest-VolumesServicesTestJSON-315437773 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.529s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:26:09 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-480c8504-0de8-4429-b007-04e579fb9ab1 tempest-VolumesServicesTestJSON-315437773 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:26:09 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-480c8504-0de8-4429-b007-04e579fb9ab1 tempest-VolumesServicesTestJSON-315437773 None] Deleted volume successfully. Sep 15 16:26:09 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-480c8504-0de8-4429-b007-04e579fb9ab1 tempest-VolumesServicesTestJSON-315437773 None] Lock "cinder-38df2128-1f1d-4e63-b7df-12933eb51b5f-delete_volume" released by "delete_volume" :: held 1.782s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:26:10 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-e8298120-94c9-47a6-8794-bc6ed8a6cf37 tempest-GroupSnapshotsTest-280274705 None] GroupSnapshot bd681f13-33f7-4389-9dfb-ceb7279f5fb2: creating. Sep 15 16:26:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e8298120-94c9-47a6-8794-bc6ed8a6cf37 tempest-GroupSnapshotsTest-280274705 None] Group snapshot bd681f13-33f7-4389-9dfb-ceb7279f5fb2: creating. {{(pid=86082) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 15 16:26:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-e8298120-94c9-47a6-8794-bc6ed8a6cf37 tempest-GroupSnapshotsTest-280274705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:26:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-e8298120-94c9-47a6-8794-bc6ed8a6cf37 tempest-GroupSnapshotsTest-280274705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:26:10 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-e8298120-94c9-47a6-8794-bc6ed8a6cf37 tempest-GroupSnapshotsTest-280274705 None] Creating offline snapshot 02b5f300-545c-4850-bc01-8fb25edc7c6d of volume 01e91647-e636-4131-9cfe-43108983ea2d {{(pid=86082) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 15 16:26:10 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[61166e82-187a-4926-ae2e-1cd84c22e6d6]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:26:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e8298120-94c9-47a6-8794-bc6ed8a6cf37 tempest-GroupSnapshotsTest-280274705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-01e91647-e636-4131-9cfe-43108983ea2d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:26:10 devstack sudo[98360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-01e91647-e636-4131-9cfe-43108983ea2d Sep 15 16:26:10 devstack sudo[98360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:26:10 devstack sudo[98360]: pam_unix(sudo:session): session closed for user root Sep 15 16:26:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e8298120-94c9-47a6-8794-bc6ed8a6cf37 tempest-GroupSnapshotsTest-280274705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-01e91647-e636-4131-9cfe-43108983ea2d" returned: 0 in 0.519s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:26:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e8298120-94c9-47a6-8794-bc6ed8a6cf37 tempest-GroupSnapshotsTest-280274705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-01e91647-e636-4131-9cfe-43108983ea2d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-01e91647-e636-4131-9cfe-43108983ea2d.02b5f300-545c-4850-bc01-8fb25edc7c6d 1G {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:26:10 devstack sudo[98366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-01e91647-e636-4131-9cfe-43108983ea2d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-01e91647-e636-4131-9cfe-43108983ea2d.02b5f300-545c-4850-bc01-8fb25edc7c6d 1G Sep 15 16:26:10 devstack sudo[98366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:26:11 devstack sudo[98366]: pam_unix(sudo:session): session closed for user root Sep 15 16:26:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e8298120-94c9-47a6-8794-bc6ed8a6cf37 tempest-GroupSnapshotsTest-280274705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-01e91647-e636-4131-9cfe-43108983ea2d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-01e91647-e636-4131-9cfe-43108983ea2d.02b5f300-545c-4850-bc01-8fb25edc7c6d 1G" returned: 0 in 0.517s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:26:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e8298120-94c9-47a6-8794-bc6ed8a6cf37 tempest-GroupSnapshotsTest-280274705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01e91647-e636-4131-9cfe-43108983ea2d -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-01e91647-e636-4131-9cfe-43108983ea2d.02b5f300-545c-4850-bc01-8fb25edc7c6d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:26:11 devstack sudo[98372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01e91647-e636-4131-9cfe-43108983ea2d -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-01e91647-e636-4131-9cfe-43108983ea2d.02b5f300-545c-4850-bc01-8fb25edc7c6d Sep 15 16:26:11 devstack sudo[98372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:26:11 devstack sudo[98372]: pam_unix(sudo:session): session closed for user root Sep 15 16:26:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e8298120-94c9-47a6-8794-bc6ed8a6cf37 tempest-GroupSnapshotsTest-280274705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-01e91647-e636-4131-9cfe-43108983ea2d -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-01e91647-e636-4131-9cfe-43108983ea2d.02b5f300-545c-4850-bc01-8fb25edc7c6d" returned: 0 in 0.298s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:26:11 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-e8298120-94c9-47a6-8794-bc6ed8a6cf37 tempest-GroupSnapshotsTest-280274705 None] /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-01e91647-e636-4131-9cfe-43108983ea2d.02b5f300-545c-4850-bc01-8fb25edc7c6d is being set with open permissions: ugo+rw: NotImplementedError Sep 15 16:26:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e8298120-94c9-47a6-8794-bc6ed8a6cf37 tempest-GroupSnapshotsTest-280274705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-01e91647-e636-4131-9cfe-43108983ea2d.02b5f300-545c-4850-bc01-8fb25edc7c6d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:26:11 devstack sudo[98377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-01e91647-e636-4131-9cfe-43108983ea2d.02b5f300-545c-4850-bc01-8fb25edc7c6d Sep 15 16:26:11 devstack sudo[98377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:26:12 devstack sudo[98377]: pam_unix(sudo:session): session closed for user root Sep 15 16:26:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e8298120-94c9-47a6-8794-bc6ed8a6cf37 tempest-GroupSnapshotsTest-280274705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-01e91647-e636-4131-9cfe-43108983ea2d.02b5f300-545c-4850-bc01-8fb25edc7c6d" returned: 0 in 0.263s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:26:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e8298120-94c9-47a6-8794-bc6ed8a6cf37 tempest-GroupSnapshotsTest-280274705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-01e91647-e636-4131-9cfe-43108983ea2d.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:26:12 devstack sudo[98380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-01e91647-e636-4131-9cfe-43108983ea2d.info Sep 15 16:26:12 devstack sudo[98380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:26:12 devstack sudo[98380]: pam_unix(sudo:session): session closed for user root Sep 15 16:26:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e8298120-94c9-47a6-8794-bc6ed8a6cf37 tempest-GroupSnapshotsTest-280274705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-01e91647-e636-4131-9cfe-43108983ea2d.info" returned: 0 in 0.285s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:26:12 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-e8298120-94c9-47a6-8794-bc6ed8a6cf37 tempest-GroupSnapshotsTest-280274705 None] /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-01e91647-e636-4131-9cfe-43108983ea2d.info is being set with open permissions: ugo+rw: NotImplementedError Sep 15 16:26:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e8298120-94c9-47a6-8794-bc6ed8a6cf37 tempest-GroupSnapshotsTest-280274705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-01e91647-e636-4131-9cfe-43108983ea2d.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:26:12 devstack sudo[98383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-01e91647-e636-4131-9cfe-43108983ea2d.info Sep 15 16:26:12 devstack sudo[98383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:26:12 devstack sudo[98383]: pam_unix(sudo:session): session closed for user root Sep 15 16:26:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e8298120-94c9-47a6-8794-bc6ed8a6cf37 tempest-GroupSnapshotsTest-280274705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-01e91647-e636-4131-9cfe-43108983ea2d.info" returned: 0 in 0.309s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:26:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-e8298120-94c9-47a6-8794-bc6ed8a6cf37 tempest-GroupSnapshotsTest-280274705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.316s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:26:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-e8298120-94c9-47a6-8794-bc6ed8a6cf37 tempest-GroupSnapshotsTest-280274705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:26:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-e8298120-94c9-47a6-8794-bc6ed8a6cf37 tempest-GroupSnapshotsTest-280274705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:26:12 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-e8298120-94c9-47a6-8794-bc6ed8a6cf37 tempest-GroupSnapshotsTest-280274705 None] Creating offline snapshot e5e39204-a337-4182-9404-ec99e2c24384 of volume 0d723edf-fb04-4aa4-a8ad-41d1248f1395 {{(pid=86082) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 15 16:26:12 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[9766edf6-8085-4e47-aea6-8847de670800]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:26:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e8298120-94c9-47a6-8794-bc6ed8a6cf37 tempest-GroupSnapshotsTest-280274705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0d723edf-fb04-4aa4-a8ad-41d1248f1395 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:26:12 devstack sudo[98386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0d723edf-fb04-4aa4-a8ad-41d1248f1395 Sep 15 16:26:12 devstack sudo[98386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:26:13 devstack sudo[98386]: pam_unix(sudo:session): session closed for user root Sep 15 16:26:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e8298120-94c9-47a6-8794-bc6ed8a6cf37 tempest-GroupSnapshotsTest-280274705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0d723edf-fb04-4aa4-a8ad-41d1248f1395" returned: 0 in 0.391s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:26:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e8298120-94c9-47a6-8794-bc6ed8a6cf37 tempest-GroupSnapshotsTest-280274705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0d723edf-fb04-4aa4-a8ad-41d1248f1395,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0d723edf-fb04-4aa4-a8ad-41d1248f1395.e5e39204-a337-4182-9404-ec99e2c24384 1G {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:26:13 devstack sudo[98391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0d723edf-fb04-4aa4-a8ad-41d1248f1395,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0d723edf-fb04-4aa4-a8ad-41d1248f1395.e5e39204-a337-4182-9404-ec99e2c24384 1G Sep 15 16:26:13 devstack sudo[98391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:26:13 devstack sudo[98391]: pam_unix(sudo:session): session closed for user root Sep 15 16:26:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e8298120-94c9-47a6-8794-bc6ed8a6cf37 tempest-GroupSnapshotsTest-280274705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0d723edf-fb04-4aa4-a8ad-41d1248f1395,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0d723edf-fb04-4aa4-a8ad-41d1248f1395.e5e39204-a337-4182-9404-ec99e2c24384 1G" returned: 0 in 0.514s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:26:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e8298120-94c9-47a6-8794-bc6ed8a6cf37 tempest-GroupSnapshotsTest-280274705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d723edf-fb04-4aa4-a8ad-41d1248f1395 -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0d723edf-fb04-4aa4-a8ad-41d1248f1395.e5e39204-a337-4182-9404-ec99e2c24384 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:26:13 devstack sudo[98397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d723edf-fb04-4aa4-a8ad-41d1248f1395 -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0d723edf-fb04-4aa4-a8ad-41d1248f1395.e5e39204-a337-4182-9404-ec99e2c24384 Sep 15 16:26:13 devstack sudo[98397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:26:14 devstack sudo[98397]: pam_unix(sudo:session): session closed for user root Sep 15 16:26:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e8298120-94c9-47a6-8794-bc6ed8a6cf37 tempest-GroupSnapshotsTest-280274705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0d723edf-fb04-4aa4-a8ad-41d1248f1395 -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0d723edf-fb04-4aa4-a8ad-41d1248f1395.e5e39204-a337-4182-9404-ec99e2c24384" returned: 0 in 0.415s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:26:14 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-e8298120-94c9-47a6-8794-bc6ed8a6cf37 tempest-GroupSnapshotsTest-280274705 None] /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0d723edf-fb04-4aa4-a8ad-41d1248f1395.e5e39204-a337-4182-9404-ec99e2c24384 is being set with open permissions: ugo+rw: NotImplementedError Sep 15 16:26:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e8298120-94c9-47a6-8794-bc6ed8a6cf37 tempest-GroupSnapshotsTest-280274705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0d723edf-fb04-4aa4-a8ad-41d1248f1395.e5e39204-a337-4182-9404-ec99e2c24384 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:26:14 devstack sudo[98442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0d723edf-fb04-4aa4-a8ad-41d1248f1395.e5e39204-a337-4182-9404-ec99e2c24384 Sep 15 16:26:14 devstack sudo[98442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:26:14 devstack sudo[98442]: pam_unix(sudo:session): session closed for user root Sep 15 16:26:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e8298120-94c9-47a6-8794-bc6ed8a6cf37 tempest-GroupSnapshotsTest-280274705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0d723edf-fb04-4aa4-a8ad-41d1248f1395.e5e39204-a337-4182-9404-ec99e2c24384" returned: 0 in 0.370s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:26:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e8298120-94c9-47a6-8794-bc6ed8a6cf37 tempest-GroupSnapshotsTest-280274705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0d723edf-fb04-4aa4-a8ad-41d1248f1395.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:26:14 devstack sudo[98447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0d723edf-fb04-4aa4-a8ad-41d1248f1395.info Sep 15 16:26:14 devstack sudo[98447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:26:14 devstack sudo[98447]: pam_unix(sudo:session): session closed for user root Sep 15 16:26:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e8298120-94c9-47a6-8794-bc6ed8a6cf37 tempest-GroupSnapshotsTest-280274705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0d723edf-fb04-4aa4-a8ad-41d1248f1395.info" returned: 0 in 0.312s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:26:14 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-e8298120-94c9-47a6-8794-bc6ed8a6cf37 tempest-GroupSnapshotsTest-280274705 None] /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0d723edf-fb04-4aa4-a8ad-41d1248f1395.info is being set with open permissions: ugo+rw: NotImplementedError Sep 15 16:26:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e8298120-94c9-47a6-8794-bc6ed8a6cf37 tempest-GroupSnapshotsTest-280274705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0d723edf-fb04-4aa4-a8ad-41d1248f1395.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:26:14 devstack sudo[98450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0d723edf-fb04-4aa4-a8ad-41d1248f1395.info Sep 15 16:26:14 devstack sudo[98450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:26:15 devstack sudo[98450]: pam_unix(sudo:session): session closed for user root Sep 15 16:26:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e8298120-94c9-47a6-8794-bc6ed8a6cf37 tempest-GroupSnapshotsTest-280274705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0d723edf-fb04-4aa4-a8ad-41d1248f1395.info" returned: 0 in 0.278s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:26:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-e8298120-94c9-47a6-8794-bc6ed8a6cf37 tempest-GroupSnapshotsTest-280274705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.386s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:26:15 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-e8298120-94c9-47a6-8794-bc6ed8a6cf37 tempest-GroupSnapshotsTest-280274705 None] group_snapshot bd681f13-33f7-4389-9dfb-ceb7279f5fb2: created successfully Sep 15 16:26:15 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-f9d36238-c8f7-400e-8af3-d4e948d45fa1 tempest-GroupSnapshotsTest-280274705 None] group_snapshot bd681f13-33f7-4389-9dfb-ceb7279f5fb2: deleting Sep 15 16:26:15 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f9d36238-c8f7-400e-8af3-d4e948d45fa1 tempest-GroupSnapshotsTest-280274705 None] group_snapshot bd681f13-33f7-4389-9dfb-ceb7279f5fb2: deleting {{(pid=86082) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 15 16:26:15 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f9d36238-c8f7-400e-8af3-d4e948d45fa1 tempest-GroupSnapshotsTest-280274705 None] Acquiring lock "cinder-quobyte-01e91647-e636-4131-9cfe-43108983ea2d" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:26:15 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f9d36238-c8f7-400e-8af3-d4e948d45fa1 tempest-GroupSnapshotsTest-280274705 None] Lock "cinder-quobyte-01e91647-e636-4131-9cfe-43108983ea2d" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:26:15 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f9d36238-c8f7-400e-8af3-d4e948d45fa1 tempest-GroupSnapshotsTest-280274705 None] Acquiring lock "cinder-quobyte-02b5f300-545c-4850-bc01-8fb25edc7c6d" by "_delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:26:16 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f9d36238-c8f7-400e-8af3-d4e948d45fa1 tempest-GroupSnapshotsTest-280274705 None] Lock "cinder-quobyte-02b5f300-545c-4850-bc01-8fb25edc7c6d" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:26:16 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-f9d36238-c8f7-400e-8af3-d4e948d45fa1 tempest-GroupSnapshotsTest-280274705 None] Deleting offline snapshot 02b5f300-545c-4850-bc01-8fb25edc7c6d of volume 01e91647-e636-4131-9cfe-43108983ea2d {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 15 16:26:16 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-f9d36238-c8f7-400e-8af3-d4e948d45fa1 tempest-GroupSnapshotsTest-280274705 None] snapshot_file for this snap is: volume-01e91647-e636-4131-9cfe-43108983ea2d.02b5f300-545c-4850-bc01-8fb25edc7c6d {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 15 16:26:16 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[9924bff6-2699-420e-b2cf-87df6a53e923]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:26:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f9d36238-c8f7-400e-8af3-d4e948d45fa1 tempest-GroupSnapshotsTest-280274705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-01e91647-e636-4131-9cfe-43108983ea2d.02b5f300-545c-4850-bc01-8fb25edc7c6d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:26:16 devstack sudo[98454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-01e91647-e636-4131-9cfe-43108983ea2d.02b5f300-545c-4850-bc01-8fb25edc7c6d Sep 15 16:26:16 devstack sudo[98454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:26:16 devstack sudo[98454]: pam_unix(sudo:session): session closed for user root Sep 15 16:26:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f9d36238-c8f7-400e-8af3-d4e948d45fa1 tempest-GroupSnapshotsTest-280274705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-01e91647-e636-4131-9cfe-43108983ea2d.02b5f300-545c-4850-bc01-8fb25edc7c6d" returned: 0 in 0.600s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:26:16 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-f9d36238-c8f7-400e-8af3-d4e948d45fa1 tempest-GroupSnapshotsTest-280274705 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-01e91647-e636-4131-9cfe-43108983ea2d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 16:26:16 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[703a5b4d-268d-44cd-870d-2c71ca44c282]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:26:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f9d36238-c8f7-400e-8af3-d4e948d45fa1 tempest-GroupSnapshotsTest-280274705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-01e91647-e636-4131-9cfe-43108983ea2d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:26:16 devstack sudo[98461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-01e91647-e636-4131-9cfe-43108983ea2d Sep 15 16:26:16 devstack sudo[98461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:26:17 devstack sudo[98461]: pam_unix(sudo:session): session closed for user root Sep 15 16:26:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f9d36238-c8f7-400e-8af3-d4e948d45fa1 tempest-GroupSnapshotsTest-280274705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-01e91647-e636-4131-9cfe-43108983ea2d" returned: 0 in 0.441s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:26:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f9d36238-c8f7-400e-8af3-d4e948d45fa1 tempest-GroupSnapshotsTest-280274705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-01e91647-e636-4131-9cfe-43108983ea2d.02b5f300-545c-4850-bc01-8fb25edc7c6d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:26:17 devstack sudo[98467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-01e91647-e636-4131-9cfe-43108983ea2d.02b5f300-545c-4850-bc01-8fb25edc7c6d Sep 15 16:26:17 devstack sudo[98467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:26:17 devstack sudo[98467]: pam_unix(sudo:session): session closed for user root Sep 15 16:26:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f9d36238-c8f7-400e-8af3-d4e948d45fa1 tempest-GroupSnapshotsTest-280274705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-01e91647-e636-4131-9cfe-43108983ea2d.02b5f300-545c-4850-bc01-8fb25edc7c6d" returned: 0 in 0.604s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:26:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f9d36238-c8f7-400e-8af3-d4e948d45fa1 tempest-GroupSnapshotsTest-280274705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-01e91647-e636-4131-9cfe-43108983ea2d.02b5f300-545c-4850-bc01-8fb25edc7c6d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:26:17 devstack sudo[98472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-01e91647-e636-4131-9cfe-43108983ea2d.02b5f300-545c-4850-bc01-8fb25edc7c6d Sep 15 16:26:17 devstack sudo[98472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:26:18 devstack sudo[98472]: pam_unix(sudo:session): session closed for user root Sep 15 16:26:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f9d36238-c8f7-400e-8af3-d4e948d45fa1 tempest-GroupSnapshotsTest-280274705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-01e91647-e636-4131-9cfe-43108983ea2d.02b5f300-545c-4850-bc01-8fb25edc7c6d" returned: 0 in 0.414s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:26:18 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f9d36238-c8f7-400e-8af3-d4e948d45fa1 tempest-GroupSnapshotsTest-280274705 None] Lock "cinder-quobyte-02b5f300-545c-4850-bc01-8fb25edc7c6d" released by "_delete_snapshot" :: held 2.224s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:26:18 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f9d36238-c8f7-400e-8af3-d4e948d45fa1 tempest-GroupSnapshotsTest-280274705 None] Lock "cinder-quobyte-01e91647-e636-4131-9cfe-43108983ea2d" released by "delete_snapshot" :: held 2.271s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:26:18 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f9d36238-c8f7-400e-8af3-d4e948d45fa1 tempest-GroupSnapshotsTest-280274705 None] Acquiring lock "cinder-quobyte-0d723edf-fb04-4aa4-a8ad-41d1248f1395" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:26:18 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f9d36238-c8f7-400e-8af3-d4e948d45fa1 tempest-GroupSnapshotsTest-280274705 None] Lock "cinder-quobyte-0d723edf-fb04-4aa4-a8ad-41d1248f1395" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:26:18 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f9d36238-c8f7-400e-8af3-d4e948d45fa1 tempest-GroupSnapshotsTest-280274705 None] Acquiring lock "cinder-quobyte-e5e39204-a337-4182-9404-ec99e2c24384" by "_delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:26:18 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f9d36238-c8f7-400e-8af3-d4e948d45fa1 tempest-GroupSnapshotsTest-280274705 None] Lock "cinder-quobyte-e5e39204-a337-4182-9404-ec99e2c24384" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:26:18 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-f9d36238-c8f7-400e-8af3-d4e948d45fa1 tempest-GroupSnapshotsTest-280274705 None] Deleting offline snapshot e5e39204-a337-4182-9404-ec99e2c24384 of volume 0d723edf-fb04-4aa4-a8ad-41d1248f1395 {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 15 16:26:18 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-f9d36238-c8f7-400e-8af3-d4e948d45fa1 tempest-GroupSnapshotsTest-280274705 None] snapshot_file for this snap is: volume-0d723edf-fb04-4aa4-a8ad-41d1248f1395.e5e39204-a337-4182-9404-ec99e2c24384 {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 15 16:26:18 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e4292b5-0a7b-4563-84b1-b68f6b760d5c]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:26:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f9d36238-c8f7-400e-8af3-d4e948d45fa1 tempest-GroupSnapshotsTest-280274705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0d723edf-fb04-4aa4-a8ad-41d1248f1395.e5e39204-a337-4182-9404-ec99e2c24384 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:26:18 devstack sudo[98475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0d723edf-fb04-4aa4-a8ad-41d1248f1395.e5e39204-a337-4182-9404-ec99e2c24384 Sep 15 16:26:18 devstack sudo[98475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:26:19 devstack sudo[98475]: pam_unix(sudo:session): session closed for user root Sep 15 16:26:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f9d36238-c8f7-400e-8af3-d4e948d45fa1 tempest-GroupSnapshotsTest-280274705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0d723edf-fb04-4aa4-a8ad-41d1248f1395.e5e39204-a337-4182-9404-ec99e2c24384" returned: 0 in 0.670s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:26:19 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-f9d36238-c8f7-400e-8af3-d4e948d45fa1 tempest-GroupSnapshotsTest-280274705 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0d723edf-fb04-4aa4-a8ad-41d1248f1395(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 16:26:19 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c2b3c64-f45e-4d0c-84a3-5768506bc3cc]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:26:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f9d36238-c8f7-400e-8af3-d4e948d45fa1 tempest-GroupSnapshotsTest-280274705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0d723edf-fb04-4aa4-a8ad-41d1248f1395 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:26:19 devstack sudo[98481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0d723edf-fb04-4aa4-a8ad-41d1248f1395 Sep 15 16:26:19 devstack sudo[98481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:26:19 devstack sudo[98481]: pam_unix(sudo:session): session closed for user root Sep 15 16:26:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f9d36238-c8f7-400e-8af3-d4e948d45fa1 tempest-GroupSnapshotsTest-280274705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0d723edf-fb04-4aa4-a8ad-41d1248f1395" returned: 0 in 0.571s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:26:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f9d36238-c8f7-400e-8af3-d4e948d45fa1 tempest-GroupSnapshotsTest-280274705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0d723edf-fb04-4aa4-a8ad-41d1248f1395.e5e39204-a337-4182-9404-ec99e2c24384 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:26:19 devstack sudo[98486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0d723edf-fb04-4aa4-a8ad-41d1248f1395.e5e39204-a337-4182-9404-ec99e2c24384 Sep 15 16:26:19 devstack sudo[98486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:26:20 devstack sudo[98486]: pam_unix(sudo:session): session closed for user root Sep 15 16:26:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f9d36238-c8f7-400e-8af3-d4e948d45fa1 tempest-GroupSnapshotsTest-280274705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0d723edf-fb04-4aa4-a8ad-41d1248f1395.e5e39204-a337-4182-9404-ec99e2c24384" returned: 0 in 0.596s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:26:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f9d36238-c8f7-400e-8af3-d4e948d45fa1 tempest-GroupSnapshotsTest-280274705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0d723edf-fb04-4aa4-a8ad-41d1248f1395.e5e39204-a337-4182-9404-ec99e2c24384 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:26:20 devstack sudo[98492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0d723edf-fb04-4aa4-a8ad-41d1248f1395.e5e39204-a337-4182-9404-ec99e2c24384 Sep 15 16:26:20 devstack sudo[98492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:26:20 devstack sudo[98492]: pam_unix(sudo:session): session closed for user root Sep 15 16:26:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f9d36238-c8f7-400e-8af3-d4e948d45fa1 tempest-GroupSnapshotsTest-280274705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0d723edf-fb04-4aa4-a8ad-41d1248f1395.e5e39204-a337-4182-9404-ec99e2c24384" returned: 0 in 0.294s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:26:20 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f9d36238-c8f7-400e-8af3-d4e948d45fa1 tempest-GroupSnapshotsTest-280274705 None] Lock "cinder-quobyte-e5e39204-a337-4182-9404-ec99e2c24384" released by "_delete_snapshot" :: held 2.287s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:26:20 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f9d36238-c8f7-400e-8af3-d4e948d45fa1 tempest-GroupSnapshotsTest-280274705 None] Lock "cinder-quobyte-0d723edf-fb04-4aa4-a8ad-41d1248f1395" released by "delete_snapshot" :: held 2.328s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:26:20 devstack cinder-volume[86082]: WARNING cinder.quota [None req-f9d36238-c8f7-400e-8af3-d4e948d45fa1 tempest-GroupSnapshotsTest-280274705 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-991274193 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-991274193, it is now deprecated. Please use the default quota class for default quota. Sep 15 16:26:20 devstack cinder-volume[86082]: WARNING cinder.quota [None req-f9d36238-c8f7-400e-8af3-d4e948d45fa1 tempest-GroupSnapshotsTest-280274705 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-991274193 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-991274193, it is now deprecated. Please use the default quota class for default quota. Sep 15 16:26:20 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-f9d36238-c8f7-400e-8af3-d4e948d45fa1 tempest-GroupSnapshotsTest-280274705 None] Created reservations ['e6dc6f12-5d87-4580-9c7e-2c5c6fe45fdb', 'f77b2751-98ec-4ef7-920c-97e09c432de9', 'a66d15c2-7aa3-4ad3-bb43-4d3ad772c5e8', 'a13b2b0d-60f1-47d1-8c9d-b1f8ba91d052'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:26:20 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-f9d36238-c8f7-400e-8af3-d4e948d45fa1 tempest-GroupSnapshotsTest-280274705 None] Created reservations ['7e87c742-3710-48b1-b380-b6b028f90a86', '859b9393-adb1-483a-8af0-d569c359ce8a', '0d0d08c1-0b86-4b3f-a424-a011166141b3', '888515c4-b94a-4563-a1d9-a6fc45a4467f'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:26:21 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-f9d36238-c8f7-400e-8af3-d4e948d45fa1 tempest-GroupSnapshotsTest-280274705 None] group_snapshot bd681f13-33f7-4389-9dfb-ceb7279f5fb2: deleted successfully Sep 15 16:26:21 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-f17bd9a0-b86f-4ecd-a27f-15d4a411eaa9 tempest-VolumesSnapshotListTestJSON-187697852 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:26:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f17bd9a0-b86f-4ecd-a27f-15d4a411eaa9 tempest-VolumesSnapshotListTestJSON-187697852 None] Flow 'volume_create_manager' (30f719c0-9a5e-4c3f-b20e-a295c8954792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:26:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f17bd9a0-b86f-4ecd-a27f-15d4a411eaa9 tempest-VolumesSnapshotListTestJSON-187697852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc7400dc-bb47-423e-ac42-cc776323ed1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:26:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f17bd9a0-b86f-4ecd-a27f-15d4a411eaa9 tempest-VolumesSnapshotListTestJSON-187697852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc7400dc-bb47-423e-ac42-cc776323ed1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:26:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1344312199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bba19694-1e59-4fa8-a71e-7d8401ffe5e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='195d1428e7234aebb14ab43bd0e29343',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:26:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:26:21Z,use_quota=True,user_id='32debab471904bf1be129149b8bdaf2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:26:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f17bd9a0-b86f-4ecd-a27f-15d4a411eaa9 tempest-VolumesSnapshotListTestJSON-187697852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (374b1dab-8d96-4686-8bda-be1c50c7b795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:26:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f17bd9a0-b86f-4ecd-a27f-15d4a411eaa9 tempest-VolumesSnapshotListTestJSON-187697852 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (374b1dab-8d96-4686-8bda-be1c50c7b795) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:26:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f17bd9a0-b86f-4ecd-a27f-15d4a411eaa9 tempest-VolumesSnapshotListTestJSON-187697852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (419d2188-4131-489f-b891-6a40c420b034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:26:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f17bd9a0-b86f-4ecd-a27f-15d4a411eaa9 tempest-VolumesSnapshotListTestJSON-187697852 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (419d2188-4131-489f-b891-6a40c420b034) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bba19694-1e59-4fa8-a71e-7d8401ffe5e7', 'volume_name': 'volume-bba19694-1e59-4fa8-a71e-7d8401ffe5e7', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:26:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f17bd9a0-b86f-4ecd-a27f-15d4a411eaa9 tempest-VolumesSnapshotListTestJSON-187697852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e9b7735-9fd2-4a25-bf41-e2b2f527d8db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:26:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f17bd9a0-b86f-4ecd-a27f-15d4a411eaa9 tempest-VolumesSnapshotListTestJSON-187697852 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e9b7735-9fd2-4a25-bf41-e2b2f527d8db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:26:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f17bd9a0-b86f-4ecd-a27f-15d4a411eaa9 tempest-VolumesSnapshotListTestJSON-187697852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af2b2e57-cd54-4b9c-a61a-06915a0d8912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:26:21 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-f17bd9a0-b86f-4ecd-a27f-15d4a411eaa9 tempest-VolumesSnapshotListTestJSON-187697852 None] Volume bba19694-1e59-4fa8-a71e-7d8401ffe5e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bba19694-1e59-4fa8-a71e-7d8401ffe5e7', 'volume_size': 1} Sep 15 16:26:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f17bd9a0-b86f-4ecd-a27f-15d4a411eaa9 tempest-VolumesSnapshotListTestJSON-187697852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:26:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f17bd9a0-b86f-4ecd-a27f-15d4a411eaa9 tempest-VolumesSnapshotListTestJSON-187697852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:26:21 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-f17bd9a0-b86f-4ecd-a27f-15d4a411eaa9 tempest-VolumesSnapshotListTestJSON-187697852 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:26:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1344312199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bba19694-1e59-4fa8-a71e-7d8401ffe5e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='195d1428e7234aebb14ab43bd0e29343',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:26:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:26:21Z,use_quota=True,user_id='32debab471904bf1be129149b8bdaf2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:26:21 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-f17bd9a0-b86f-4ecd-a27f-15d4a411eaa9 tempest-VolumesSnapshotListTestJSON-187697852 None] Creating volume bba19694-1e59-4fa8-a71e-7d8401ffe5e7 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:26:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f17bd9a0-b86f-4ecd-a27f-15d4a411eaa9 tempest-VolumesSnapshotListTestJSON-187697852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:26:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f17bd9a0-b86f-4ecd-a27f-15d4a411eaa9 tempest-VolumesSnapshotListTestJSON-187697852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:26:21 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-f17bd9a0-b86f-4ecd-a27f-15d4a411eaa9 tempest-VolumesSnapshotListTestJSON-187697852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:26:21 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-f17bd9a0-b86f-4ecd-a27f-15d4a411eaa9 tempest-VolumesSnapshotListTestJSON-187697852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:26:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f17bd9a0-b86f-4ecd-a27f-15d4a411eaa9 tempest-VolumesSnapshotListTestJSON-187697852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:26:21 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-f17bd9a0-b86f-4ecd-a27f-15d4a411eaa9 tempest-VolumesSnapshotListTestJSON-187697852 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:26:21 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-f17bd9a0-b86f-4ecd-a27f-15d4a411eaa9 tempest-VolumesSnapshotListTestJSON-187697852 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:26:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f17bd9a0-b86f-4ecd-a27f-15d4a411eaa9 tempest-VolumesSnapshotListTestJSON-187697852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-bba19694-1e59-4fa8-a71e-7d8401ffe5e7 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:26:21 devstack sudo[98495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-bba19694-1e59-4fa8-a71e-7d8401ffe5e7 1073741824 Sep 15 16:26:21 devstack sudo[98495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:26:22 devstack sudo[98495]: pam_unix(sudo:session): session closed for user root Sep 15 16:26:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f17bd9a0-b86f-4ecd-a27f-15d4a411eaa9 tempest-VolumesSnapshotListTestJSON-187697852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-bba19694-1e59-4fa8-a71e-7d8401ffe5e7 1073741824" returned: 0 in 0.614s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:26:22 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-23d31eb3-7cde-4c20-88f1-d05d8a792fad tempest-GroupSnapshotsTest-280274705 None] Acquiring lock "cinder-quobyte-01e91647-e636-4131-9cfe-43108983ea2d" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:26:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f17bd9a0-b86f-4ecd-a27f-15d4a411eaa9 tempest-VolumesSnapshotListTestJSON-187697852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-bba19694-1e59-4fa8-a71e-7d8401ffe5e7 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:26:22 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-23d31eb3-7cde-4c20-88f1-d05d8a792fad tempest-GroupSnapshotsTest-280274705 None] Lock "cinder-quobyte-01e91647-e636-4131-9cfe-43108983ea2d" acquired by "delete_volume" :: waited 0.043s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:26:22 devstack sudo[98501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-bba19694-1e59-4fa8-a71e-7d8401ffe5e7 Sep 15 16:26:22 devstack sudo[98501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:26:22 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[b226f772-14f1-464c-8ad1-55e96e984502]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:26:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-23d31eb3-7cde-4c20-88f1-d05d8a792fad tempest-GroupSnapshotsTest-280274705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-01e91647-e636-4131-9cfe-43108983ea2d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:26:22 devstack sudo[98503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-01e91647-e636-4131-9cfe-43108983ea2d Sep 15 16:26:22 devstack sudo[98503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:26:22 devstack sudo[98501]: pam_unix(sudo:session): session closed for user root Sep 15 16:26:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f17bd9a0-b86f-4ecd-a27f-15d4a411eaa9 tempest-VolumesSnapshotListTestJSON-187697852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-bba19694-1e59-4fa8-a71e-7d8401ffe5e7" returned: 0 in 0.295s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:26:22 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-f17bd9a0-b86f-4ecd-a27f-15d4a411eaa9 tempest-VolumesSnapshotListTestJSON-187697852 None] <== create_volume: return (991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:26:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f17bd9a0-b86f-4ecd-a27f-15d4a411eaa9 tempest-VolumesSnapshotListTestJSON-187697852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.994s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:26:22 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f17bd9a0-b86f-4ecd-a27f-15d4a411eaa9 tempest-VolumesSnapshotListTestJSON-187697852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af2b2e57-cd54-4b9c-a61a-06915a0d8912) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bba19694-1e59-4fa8-a71e-7d8401ffe5e7', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:26:22 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f17bd9a0-b86f-4ecd-a27f-15d4a411eaa9 tempest-VolumesSnapshotListTestJSON-187697852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5b60556-7147-4f1a-ad1c-c1928ad8d376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:26:22 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-f17bd9a0-b86f-4ecd-a27f-15d4a411eaa9 tempest-VolumesSnapshotListTestJSON-187697852 None] Volume volume-bba19694-1e59-4fa8-a71e-7d8401ffe5e7 (bba19694-1e59-4fa8-a71e-7d8401ffe5e7): created successfully Sep 15 16:26:22 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f17bd9a0-b86f-4ecd-a27f-15d4a411eaa9 tempest-VolumesSnapshotListTestJSON-187697852 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5b60556-7147-4f1a-ad1c-c1928ad8d376) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:26:22 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f17bd9a0-b86f-4ecd-a27f-15d4a411eaa9 tempest-VolumesSnapshotListTestJSON-187697852 None] Flow 'volume_create_manager' (30f719c0-9a5e-4c3f-b20e-a295c8954792) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:26:22 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-f17bd9a0-b86f-4ecd-a27f-15d4a411eaa9 tempest-VolumesSnapshotListTestJSON-187697852 None] Created volume successfully. Sep 15 16:26:22 devstack sudo[98503]: pam_unix(sudo:session): session closed for user root Sep 15 16:26:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-23d31eb3-7cde-4c20-88f1-d05d8a792fad tempest-GroupSnapshotsTest-280274705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-01e91647-e636-4131-9cfe-43108983ea2d" returned: 0 in 0.452s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:26:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-23d31eb3-7cde-4c20-88f1-d05d8a792fad tempest-GroupSnapshotsTest-280274705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-01e91647-e636-4131-9cfe-43108983ea2d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:26:22 devstack sudo[98509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-01e91647-e636-4131-9cfe-43108983ea2d Sep 15 16:26:22 devstack sudo[98509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:26:23 devstack sudo[98509]: pam_unix(sudo:session): session closed for user root Sep 15 16:26:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-23d31eb3-7cde-4c20-88f1-d05d8a792fad tempest-GroupSnapshotsTest-280274705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-01e91647-e636-4131-9cfe-43108983ea2d" returned: 0 in 0.284s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:26:23 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-23d31eb3-7cde-4c20-88f1-d05d8a792fad tempest-GroupSnapshotsTest-280274705 None] Lock "cinder-quobyte-01e91647-e636-4131-9cfe-43108983ea2d" released by "delete_volume" :: held 0.841s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:26:23 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-23d31eb3-7cde-4c20-88f1-d05d8a792fad tempest-GroupSnapshotsTest-280274705 None] Acquiring lock "cinder-quobyte-0d723edf-fb04-4aa4-a8ad-41d1248f1395" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:26:23 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-23d31eb3-7cde-4c20-88f1-d05d8a792fad tempest-GroupSnapshotsTest-280274705 None] Lock "cinder-quobyte-0d723edf-fb04-4aa4-a8ad-41d1248f1395" acquired by "delete_volume" :: waited 0.018s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:26:23 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcf14013-f2e7-45d0-a229-f502cf1603cc]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:26:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-23d31eb3-7cde-4c20-88f1-d05d8a792fad tempest-GroupSnapshotsTest-280274705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0d723edf-fb04-4aa4-a8ad-41d1248f1395 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:26:23 devstack sudo[98512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0d723edf-fb04-4aa4-a8ad-41d1248f1395 Sep 15 16:26:23 devstack sudo[98512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:26:23 devstack sudo[98512]: pam_unix(sudo:session): session closed for user root Sep 15 16:26:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-23d31eb3-7cde-4c20-88f1-d05d8a792fad tempest-GroupSnapshotsTest-280274705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0d723edf-fb04-4aa4-a8ad-41d1248f1395" returned: 0 in 0.537s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:26:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-23d31eb3-7cde-4c20-88f1-d05d8a792fad tempest-GroupSnapshotsTest-280274705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0d723edf-fb04-4aa4-a8ad-41d1248f1395 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:26:23 devstack sudo[98518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0d723edf-fb04-4aa4-a8ad-41d1248f1395 Sep 15 16:26:23 devstack sudo[98518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:26:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c5ea167b-8abd-426d-808e-c4838a55022b tempest-VolumesSnapshotListTestJSON-187697852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:26:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c5ea167b-8abd-426d-808e-c4838a55022b tempest-VolumesSnapshotListTestJSON-187697852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:26:23 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-c5ea167b-8abd-426d-808e-c4838a55022b tempest-VolumesSnapshotListTestJSON-187697852 None] Creating offline snapshot 294a89fc-e6a6-437b-8313-b59ae552683f of volume bba19694-1e59-4fa8-a71e-7d8401ffe5e7 {{(pid=86082) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 15 16:26:23 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[150630af-97c8-4505-b5ca-f19b889d7fa3]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:26:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c5ea167b-8abd-426d-808e-c4838a55022b tempest-VolumesSnapshotListTestJSON-187697852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-bba19694-1e59-4fa8-a71e-7d8401ffe5e7 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:26:23 devstack sudo[98520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-bba19694-1e59-4fa8-a71e-7d8401ffe5e7 Sep 15 16:26:23 devstack sudo[98520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:26:24 devstack sudo[98518]: pam_unix(sudo:session): session closed for user root Sep 15 16:26:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-23d31eb3-7cde-4c20-88f1-d05d8a792fad tempest-GroupSnapshotsTest-280274705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0d723edf-fb04-4aa4-a8ad-41d1248f1395" returned: 0 in 0.315s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:26:24 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-23d31eb3-7cde-4c20-88f1-d05d8a792fad tempest-GroupSnapshotsTest-280274705 None] Lock "cinder-quobyte-0d723edf-fb04-4aa4-a8ad-41d1248f1395" released by "delete_volume" :: held 0.930s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:26:24 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-23d31eb3-7cde-4c20-88f1-d05d8a792fad tempest-GroupSnapshotsTest-280274705 None] Created reservations ['d20597ae-deaa-4274-91bf-b992a8a60fb1'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:26:24 devstack cinder-volume[86082]: WARNING cinder.quota [None req-23d31eb3-7cde-4c20-88f1-d05d8a792fad tempest-GroupSnapshotsTest-280274705 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-991274193 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-991274193, it is now deprecated. Please use the default quota class for default quota. Sep 15 16:26:24 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-23d31eb3-7cde-4c20-88f1-d05d8a792fad tempest-GroupSnapshotsTest-280274705 None] Created reservations ['e8c502bb-420f-4ee7-a6b0-50ab0e603a04', '90b3e8a6-2858-4cba-a55a-35086e2ce459', '9ca4be57-c237-48bc-a661-4906168f1bab', '243cf0f1-053e-492b-bcbe-17170f64ba73'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:26:24 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-23d31eb3-7cde-4c20-88f1-d05d8a792fad tempest-GroupSnapshotsTest-280274705 None] Created reservations ['1cf410dc-d56b-4f77-9a21-010bb1cb677c', '4955d306-3d81-459c-92ad-3484143c0d70', '967449de-6970-4e90-a044-a65181e58479', '70d4c08d-1434-4a75-99c5-2d322422a6f3'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:26:24 devstack sudo[98520]: pam_unix(sudo:session): session closed for user root Sep 15 16:26:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c5ea167b-8abd-426d-808e-c4838a55022b tempest-VolumesSnapshotListTestJSON-187697852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-bba19694-1e59-4fa8-a71e-7d8401ffe5e7" returned: 0 in 0.528s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:26:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c5ea167b-8abd-426d-808e-c4838a55022b tempest-VolumesSnapshotListTestJSON-187697852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-bba19694-1e59-4fa8-a71e-7d8401ffe5e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-bba19694-1e59-4fa8-a71e-7d8401ffe5e7.294a89fc-e6a6-437b-8313-b59ae552683f 1G {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:26:24 devstack sudo[98526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-bba19694-1e59-4fa8-a71e-7d8401ffe5e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-bba19694-1e59-4fa8-a71e-7d8401ffe5e7.294a89fc-e6a6-437b-8313-b59ae552683f 1G Sep 15 16:26:24 devstack sudo[98526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:26:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-23d31eb3-7cde-4c20-88f1-d05d8a792fad tempest-GroupSnapshotsTest-280274705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:26:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-23d31eb3-7cde-4c20-88f1-d05d8a792fad tempest-GroupSnapshotsTest-280274705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:26:24 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-23d31eb3-7cde-4c20-88f1-d05d8a792fad tempest-GroupSnapshotsTest-280274705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:26:24 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-23d31eb3-7cde-4c20-88f1-d05d8a792fad tempest-GroupSnapshotsTest-280274705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:26:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-23d31eb3-7cde-4c20-88f1-d05d8a792fad tempest-GroupSnapshotsTest-280274705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:26:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-23d31eb3-7cde-4c20-88f1-d05d8a792fad tempest-GroupSnapshotsTest-280274705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:26:24 devstack sudo[98528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:26:24 devstack sudo[98528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:26:24 devstack sudo[98528]: pam_unix(sudo:session): session closed for user root Sep 15 16:26:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-23d31eb3-7cde-4c20-88f1-d05d8a792fad tempest-GroupSnapshotsTest-280274705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.355s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:26:24 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-23d31eb3-7cde-4c20-88f1-d05d8a792fad tempest-GroupSnapshotsTest-280274705 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:26:24 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-23d31eb3-7cde-4c20-88f1-d05d8a792fad tempest-GroupSnapshotsTest-280274705 None] Delete group completed successfully. Sep 15 16:26:24 devstack sudo[98526]: pam_unix(sudo:session): session closed for user root Sep 15 16:26:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c5ea167b-8abd-426d-808e-c4838a55022b tempest-VolumesSnapshotListTestJSON-187697852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-bba19694-1e59-4fa8-a71e-7d8401ffe5e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-bba19694-1e59-4fa8-a71e-7d8401ffe5e7.294a89fc-e6a6-437b-8313-b59ae552683f 1G" returned: 0 in 0.585s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:26:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c5ea167b-8abd-426d-808e-c4838a55022b tempest-VolumesSnapshotListTestJSON-187697852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bba19694-1e59-4fa8-a71e-7d8401ffe5e7 -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-bba19694-1e59-4fa8-a71e-7d8401ffe5e7.294a89fc-e6a6-437b-8313-b59ae552683f {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:26:25 devstack sudo[98536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bba19694-1e59-4fa8-a71e-7d8401ffe5e7 -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-bba19694-1e59-4fa8-a71e-7d8401ffe5e7.294a89fc-e6a6-437b-8313-b59ae552683f Sep 15 16:26:25 devstack sudo[98536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:26:25 devstack sudo[98536]: pam_unix(sudo:session): session closed for user root Sep 15 16:26:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c5ea167b-8abd-426d-808e-c4838a55022b tempest-VolumesSnapshotListTestJSON-187697852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bba19694-1e59-4fa8-a71e-7d8401ffe5e7 -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-bba19694-1e59-4fa8-a71e-7d8401ffe5e7.294a89fc-e6a6-437b-8313-b59ae552683f" returned: 0 in 0.369s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:26:25 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-c5ea167b-8abd-426d-808e-c4838a55022b tempest-VolumesSnapshotListTestJSON-187697852 None] /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-bba19694-1e59-4fa8-a71e-7d8401ffe5e7.294a89fc-e6a6-437b-8313-b59ae552683f is being set with open permissions: ugo+rw Sep 15 16:26:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c5ea167b-8abd-426d-808e-c4838a55022b tempest-VolumesSnapshotListTestJSON-187697852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-bba19694-1e59-4fa8-a71e-7d8401ffe5e7.294a89fc-e6a6-437b-8313-b59ae552683f {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:26:25 devstack sudo[98542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-bba19694-1e59-4fa8-a71e-7d8401ffe5e7.294a89fc-e6a6-437b-8313-b59ae552683f Sep 15 16:26:25 devstack sudo[98542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:26:25 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-fb6066fa-e020-459e-8c5d-ff0bbd22d93d tempest-GroupSnapshotsTest-280274705 None] Group tempest-GroupSnapshotsTest-Group-1242487887: creating Sep 15 16:26:25 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-fb6066fa-e020-459e-8c5d-ff0bbd22d93d tempest-GroupSnapshotsTest-280274705 None] Group tempest-GroupSnapshotsTest-Group-1242487887: created successfully Sep 15 16:26:25 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-fb6066fa-e020-459e-8c5d-ff0bbd22d93d tempest-GroupSnapshotsTest-280274705 None] Create group completed successfully. Sep 15 16:26:25 devstack sudo[98542]: pam_unix(sudo:session): session closed for user root Sep 15 16:26:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c5ea167b-8abd-426d-808e-c4838a55022b tempest-VolumesSnapshotListTestJSON-187697852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-bba19694-1e59-4fa8-a71e-7d8401ffe5e7.294a89fc-e6a6-437b-8313-b59ae552683f" returned: 0 in 0.335s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:26:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c5ea167b-8abd-426d-808e-c4838a55022b tempest-VolumesSnapshotListTestJSON-187697852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-bba19694-1e59-4fa8-a71e-7d8401ffe5e7.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:26:25 devstack sudo[98548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-bba19694-1e59-4fa8-a71e-7d8401ffe5e7.info Sep 15 16:26:25 devstack sudo[98548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:26:26 devstack sudo[98548]: pam_unix(sudo:session): session closed for user root Sep 15 16:26:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c5ea167b-8abd-426d-808e-c4838a55022b tempest-VolumesSnapshotListTestJSON-187697852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-bba19694-1e59-4fa8-a71e-7d8401ffe5e7.info" returned: 0 in 0.318s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:26:26 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-c5ea167b-8abd-426d-808e-c4838a55022b tempest-VolumesSnapshotListTestJSON-187697852 None] /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-bba19694-1e59-4fa8-a71e-7d8401ffe5e7.info is being set with open permissions: ugo+rw Sep 15 16:26:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c5ea167b-8abd-426d-808e-c4838a55022b tempest-VolumesSnapshotListTestJSON-187697852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-bba19694-1e59-4fa8-a71e-7d8401ffe5e7.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:26:26 devstack sudo[98551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-bba19694-1e59-4fa8-a71e-7d8401ffe5e7.info Sep 15 16:26:26 devstack sudo[98551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:26:26 devstack sudo[98551]: pam_unix(sudo:session): session closed for user root Sep 15 16:26:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c5ea167b-8abd-426d-808e-c4838a55022b tempest-VolumesSnapshotListTestJSON-187697852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-bba19694-1e59-4fa8-a71e-7d8401ffe5e7.info" returned: 0 in 0.297s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:26:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c5ea167b-8abd-426d-808e-c4838a55022b tempest-VolumesSnapshotListTestJSON-187697852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.566s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:26:26 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-c5ea167b-8abd-426d-808e-c4838a55022b tempest-VolumesSnapshotListTestJSON-187697852 None] Create snapshot completed successfully Sep 15 16:26:27 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-93faefe6-630d-4f0e-986c-eb95c01b696f tempest-GroupSnapshotsTest-280274705 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:26:27 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-93faefe6-630d-4f0e-986c-eb95c01b696f tempest-GroupSnapshotsTest-280274705 None] Flow 'volume_create_manager' (fb4b69cf-5272-449e-a0d2-6959be2712df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:26:27 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-93faefe6-630d-4f0e-986c-eb95c01b696f tempest-GroupSnapshotsTest-280274705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a27b1d99-9c13-4614-a904-c7369c2b6b0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:26:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-bd6a6bed-d2ce-46c7-b28f-fb96750b2272 tempest-VolumesSnapshotListTestJSON-187697852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:26:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-bd6a6bed-d2ce-46c7-b28f-fb96750b2272 tempest-VolumesSnapshotListTestJSON-187697852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:26:27 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-93faefe6-630d-4f0e-986c-eb95c01b696f tempest-GroupSnapshotsTest-280274705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a27b1d99-9c13-4614-a904-c7369c2b6b0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:26:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1720380307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=077ed37a-0a1a-4eda-9317-51a9e93e6ce8,host='devstack@QuobyteHD#QuobyteHD',id=6e4cc28d-6520-4b1d-b5ce-80b6f59c161b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='293c2399eae1433ab0ed844313ad3ede',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:26:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:26:27Z,use_quota=True,user_id='f1accc1a486645fdb84f42d2c33b632e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462bc8b3-e2e6-4177-9afc-81e60356b589),volume_type_id=462bc8b3-e2e6-4177-9afc-81e60356b589)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:26:27 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-93faefe6-630d-4f0e-986c-eb95c01b696f tempest-GroupSnapshotsTest-280274705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97a56051-0fef-46eb-b9bf-1bf1a490cae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:26:27 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-93faefe6-630d-4f0e-986c-eb95c01b696f tempest-GroupSnapshotsTest-280274705 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (97a56051-0fef-46eb-b9bf-1bf1a490cae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:26:27 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-93faefe6-630d-4f0e-986c-eb95c01b696f tempest-GroupSnapshotsTest-280274705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73c7bc67-27ec-465c-b40c-b169b21503bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:26:27 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-93faefe6-630d-4f0e-986c-eb95c01b696f tempest-GroupSnapshotsTest-280274705 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73c7bc67-27ec-465c-b40c-b169b21503bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e4cc28d-6520-4b1d-b5ce-80b6f59c161b', 'volume_name': 'volume-6e4cc28d-6520-4b1d-b5ce-80b6f59c161b', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:26:27 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-93faefe6-630d-4f0e-986c-eb95c01b696f tempest-GroupSnapshotsTest-280274705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6409d232-c238-4516-a9fc-56b78a021e18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:26:27 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-93faefe6-630d-4f0e-986c-eb95c01b696f tempest-GroupSnapshotsTest-280274705 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6409d232-c238-4516-a9fc-56b78a021e18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:26:27 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-93faefe6-630d-4f0e-986c-eb95c01b696f tempest-GroupSnapshotsTest-280274705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03b52cb0-94c6-4821-a1d7-6f36a2ac3b98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:26:27 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-93faefe6-630d-4f0e-986c-eb95c01b696f tempest-GroupSnapshotsTest-280274705 None] Volume 6e4cc28d-6520-4b1d-b5ce-80b6f59c161b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e4cc28d-6520-4b1d-b5ce-80b6f59c161b', 'volume_size': 1} Sep 15 16:26:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-93faefe6-630d-4f0e-986c-eb95c01b696f tempest-GroupSnapshotsTest-280274705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:26:27 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-bd6a6bed-d2ce-46c7-b28f-fb96750b2272 tempest-VolumesSnapshotListTestJSON-187697852 None] Creating offline snapshot 2025e9c3-9cd3-4fbe-9924-d0a07cc6322f of volume bba19694-1e59-4fa8-a71e-7d8401ffe5e7 {{(pid=86082) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 15 16:26:27 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dae6364-5247-4a86-8403-cab385e0c551]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:26:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-bd6a6bed-d2ce-46c7-b28f-fb96750b2272 tempest-VolumesSnapshotListTestJSON-187697852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-bba19694-1e59-4fa8-a71e-7d8401ffe5e7.294a89fc-e6a6-437b-8313-b59ae552683f {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:26:27 devstack sudo[98556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-bba19694-1e59-4fa8-a71e-7d8401ffe5e7.294a89fc-e6a6-437b-8313-b59ae552683f Sep 15 16:26:27 devstack sudo[98556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:26:28 devstack sudo[98556]: pam_unix(sudo:session): session closed for user root Sep 15 16:26:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-bd6a6bed-d2ce-46c7-b28f-fb96750b2272 tempest-VolumesSnapshotListTestJSON-187697852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-bba19694-1e59-4fa8-a71e-7d8401ffe5e7.294a89fc-e6a6-437b-8313-b59ae552683f" returned: 0 in 0.502s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:26:28 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-bd6a6bed-d2ce-46c7-b28f-fb96750b2272 tempest-VolumesSnapshotListTestJSON-187697852 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bba19694-1e59-4fa8-a71e-7d8401ffe5e7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 16:26:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-bd6a6bed-d2ce-46c7-b28f-fb96750b2272 tempest-VolumesSnapshotListTestJSON-187697852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-bba19694-1e59-4fa8-a71e-7d8401ffe5e7.294a89fc-e6a6-437b-8313-b59ae552683f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-bba19694-1e59-4fa8-a71e-7d8401ffe5e7.2025e9c3-9cd3-4fbe-9924-d0a07cc6322f 1G {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:26:28 devstack sudo[98561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-bba19694-1e59-4fa8-a71e-7d8401ffe5e7.294a89fc-e6a6-437b-8313-b59ae552683f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-bba19694-1e59-4fa8-a71e-7d8401ffe5e7.2025e9c3-9cd3-4fbe-9924-d0a07cc6322f 1G Sep 15 16:26:28 devstack sudo[98561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:26:28 devstack sudo[98561]: pam_unix(sudo:session): session closed for user root Sep 15 16:26:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-bd6a6bed-d2ce-46c7-b28f-fb96750b2272 tempest-VolumesSnapshotListTestJSON-187697852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-bba19694-1e59-4fa8-a71e-7d8401ffe5e7.294a89fc-e6a6-437b-8313-b59ae552683f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-bba19694-1e59-4fa8-a71e-7d8401ffe5e7.2025e9c3-9cd3-4fbe-9924-d0a07cc6322f 1G" returned: 0 in 0.720s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:26:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-bd6a6bed-d2ce-46c7-b28f-fb96750b2272 tempest-VolumesSnapshotListTestJSON-187697852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bba19694-1e59-4fa8-a71e-7d8401ffe5e7.294a89fc-e6a6-437b-8313-b59ae552683f -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-bba19694-1e59-4fa8-a71e-7d8401ffe5e7.2025e9c3-9cd3-4fbe-9924-d0a07cc6322f {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:26:28 devstack sudo[98583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bba19694-1e59-4fa8-a71e-7d8401ffe5e7.294a89fc-e6a6-437b-8313-b59ae552683f -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-bba19694-1e59-4fa8-a71e-7d8401ffe5e7.2025e9c3-9cd3-4fbe-9924-d0a07cc6322f Sep 15 16:26:28 devstack sudo[98583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:26:29 devstack sudo[98583]: pam_unix(sudo:session): session closed for user root Sep 15 16:26:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-bd6a6bed-d2ce-46c7-b28f-fb96750b2272 tempest-VolumesSnapshotListTestJSON-187697852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bba19694-1e59-4fa8-a71e-7d8401ffe5e7.294a89fc-e6a6-437b-8313-b59ae552683f -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-bba19694-1e59-4fa8-a71e-7d8401ffe5e7.2025e9c3-9cd3-4fbe-9924-d0a07cc6322f" returned: 0 in 0.377s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:26:29 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-bd6a6bed-d2ce-46c7-b28f-fb96750b2272 tempest-VolumesSnapshotListTestJSON-187697852 None] /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-bba19694-1e59-4fa8-a71e-7d8401ffe5e7.2025e9c3-9cd3-4fbe-9924-d0a07cc6322f is being set with open permissions: ugo+rw Sep 15 16:26:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-bd6a6bed-d2ce-46c7-b28f-fb96750b2272 tempest-VolumesSnapshotListTestJSON-187697852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-bba19694-1e59-4fa8-a71e-7d8401ffe5e7.2025e9c3-9cd3-4fbe-9924-d0a07cc6322f {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:26:29 devstack sudo[98599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-bba19694-1e59-4fa8-a71e-7d8401ffe5e7.2025e9c3-9cd3-4fbe-9924-d0a07cc6322f Sep 15 16:26:29 devstack sudo[98599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:26:29 devstack sudo[98599]: pam_unix(sudo:session): session closed for user root Sep 15 16:26:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-bd6a6bed-d2ce-46c7-b28f-fb96750b2272 tempest-VolumesSnapshotListTestJSON-187697852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-bba19694-1e59-4fa8-a71e-7d8401ffe5e7.2025e9c3-9cd3-4fbe-9924-d0a07cc6322f" returned: 0 in 0.279s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:26:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-bd6a6bed-d2ce-46c7-b28f-fb96750b2272 tempest-VolumesSnapshotListTestJSON-187697852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.108s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:26:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-93faefe6-630d-4f0e-986c-eb95c01b696f tempest-GroupSnapshotsTest-280274705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.043s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:26:29 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-93faefe6-630d-4f0e-986c-eb95c01b696f tempest-GroupSnapshotsTest-280274705 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=077ed37a-0a1a-4eda-9317-51a9e93e6ce8,created_at=2026-09-15T14:26:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1720380307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=077ed37a-0a1a-4eda-9317-51a9e93e6ce8,host='devstack@QuobyteHD#QuobyteHD',id=6e4cc28d-6520-4b1d-b5ce-80b6f59c161b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='293c2399eae1433ab0ed844313ad3ede',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:26:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:26:27Z,use_quota=True,user_id='f1accc1a486645fdb84f42d2c33b632e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(462bc8b3-e2e6-4177-9afc-81e60356b589),volume_type_id=462bc8b3-e2e6-4177-9afc-81e60356b589)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:26:29 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-93faefe6-630d-4f0e-986c-eb95c01b696f tempest-GroupSnapshotsTest-280274705 None] Creating volume 6e4cc28d-6520-4b1d-b5ce-80b6f59c161b {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:26:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-93faefe6-630d-4f0e-986c-eb95c01b696f tempest-GroupSnapshotsTest-280274705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:26:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-93faefe6-630d-4f0e-986c-eb95c01b696f tempest-GroupSnapshotsTest-280274705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:26:29 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-93faefe6-630d-4f0e-986c-eb95c01b696f tempest-GroupSnapshotsTest-280274705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:26:29 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-93faefe6-630d-4f0e-986c-eb95c01b696f tempest-GroupSnapshotsTest-280274705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:26:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-93faefe6-630d-4f0e-986c-eb95c01b696f tempest-GroupSnapshotsTest-280274705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:26:29 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-93faefe6-630d-4f0e-986c-eb95c01b696f tempest-GroupSnapshotsTest-280274705 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:26:29 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-93faefe6-630d-4f0e-986c-eb95c01b696f tempest-GroupSnapshotsTest-280274705 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:26:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-93faefe6-630d-4f0e-986c-eb95c01b696f tempest-GroupSnapshotsTest-280274705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6e4cc28d-6520-4b1d-b5ce-80b6f59c161b 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:26:29 devstack sudo[98609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6e4cc28d-6520-4b1d-b5ce-80b6f59c161b 1073741824 Sep 15 16:26:29 devstack sudo[98609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:26:29 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-bd6a6bed-d2ce-46c7-b28f-fb96750b2272 tempest-VolumesSnapshotListTestJSON-187697852 None] Create snapshot completed successfully Sep 15 16:26:30 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d7233c5-a94f-410d-82e2-4e207fec5f74 tempest-VolumesTransfersTest-2116109669 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:26:30 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2d7233c5-a94f-410d-82e2-4e207fec5f74 tempest-VolumesTransfersTest-2116109669 None] Flow 'volume_create_manager' (cc47904f-9077-4b24-a4c0-523190375b44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:26:30 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2d7233c5-a94f-410d-82e2-4e207fec5f74 tempest-VolumesTransfersTest-2116109669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3b837a5-a933-4e50-b293-e8c760331b10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:26:30 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2d7233c5-a94f-410d-82e2-4e207fec5f74 tempest-VolumesTransfersTest-2116109669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3b837a5-a933-4e50-b293-e8c760331b10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:26:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-660655906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25f9e078-6e71-4d0c-bb73-2e9c6157b683,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99ebd68550d6427f91d9fb22e7001351',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:26:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:26:30Z,use_quota=True,user_id='60c5cff5e56247edb2f0056ac686b987',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:26:30 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2d7233c5-a94f-410d-82e2-4e207fec5f74 tempest-VolumesTransfersTest-2116109669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69764888-d9ed-4594-8bef-07b9f257755e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:26:30 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2d7233c5-a94f-410d-82e2-4e207fec5f74 tempest-VolumesTransfersTest-2116109669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69764888-d9ed-4594-8bef-07b9f257755e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:26:30 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2d7233c5-a94f-410d-82e2-4e207fec5f74 tempest-VolumesTransfersTest-2116109669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a99a2a75-6045-4ccc-ab72-691ead9c4e83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:26:30 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2d7233c5-a94f-410d-82e2-4e207fec5f74 tempest-VolumesTransfersTest-2116109669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a99a2a75-6045-4ccc-ab72-691ead9c4e83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25f9e078-6e71-4d0c-bb73-2e9c6157b683', 'volume_name': 'volume-25f9e078-6e71-4d0c-bb73-2e9c6157b683', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:26:30 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2d7233c5-a94f-410d-82e2-4e207fec5f74 tempest-VolumesTransfersTest-2116109669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a553e778-e72e-418d-9cc3-b7b0e50835cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:26:30 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2d7233c5-a94f-410d-82e2-4e207fec5f74 tempest-VolumesTransfersTest-2116109669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a553e778-e72e-418d-9cc3-b7b0e50835cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:26:30 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2d7233c5-a94f-410d-82e2-4e207fec5f74 tempest-VolumesTransfersTest-2116109669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e3cf3f8-6972-4054-ad4d-e4a0f6029267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:26:30 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-2d7233c5-a94f-410d-82e2-4e207fec5f74 tempest-VolumesTransfersTest-2116109669 None] Volume 25f9e078-6e71-4d0c-bb73-2e9c6157b683: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25f9e078-6e71-4d0c-bb73-2e9c6157b683', 'volume_size': 1} Sep 15 16:26:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-2d7233c5-a94f-410d-82e2-4e207fec5f74 tempest-VolumesTransfersTest-2116109669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:26:30 devstack sudo[98609]: pam_unix(sudo:session): session closed for user root Sep 15 16:26:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-93faefe6-630d-4f0e-986c-eb95c01b696f tempest-GroupSnapshotsTest-280274705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6e4cc28d-6520-4b1d-b5ce-80b6f59c161b 1073741824" returned: 0 in 0.664s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:26:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-93faefe6-630d-4f0e-986c-eb95c01b696f tempest-GroupSnapshotsTest-280274705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6e4cc28d-6520-4b1d-b5ce-80b6f59c161b {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:26:30 devstack sudo[98619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6e4cc28d-6520-4b1d-b5ce-80b6f59c161b Sep 15 16:26:30 devstack sudo[98619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:26:30 devstack sudo[98619]: pam_unix(sudo:session): session closed for user root Sep 15 16:26:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-93faefe6-630d-4f0e-986c-eb95c01b696f tempest-GroupSnapshotsTest-280274705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6e4cc28d-6520-4b1d-b5ce-80b6f59c161b" returned: 0 in 0.265s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:26:30 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-93faefe6-630d-4f0e-986c-eb95c01b696f tempest-GroupSnapshotsTest-280274705 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:26:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-93faefe6-630d-4f0e-986c-eb95c01b696f tempest-GroupSnapshotsTest-280274705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:26:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-2d7233c5-a94f-410d-82e2-4e207fec5f74 tempest-VolumesTransfersTest-2116109669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.318s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:26:30 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-2d7233c5-a94f-410d-82e2-4e207fec5f74 tempest-VolumesTransfersTest-2116109669 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:26:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-660655906',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25f9e078-6e71-4d0c-bb73-2e9c6157b683,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99ebd68550d6427f91d9fb22e7001351',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:26:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:26:30Z,use_quota=True,user_id='60c5cff5e56247edb2f0056ac686b987',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:26:30 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-2d7233c5-a94f-410d-82e2-4e207fec5f74 tempest-VolumesTransfersTest-2116109669 None] Creating volume 25f9e078-6e71-4d0c-bb73-2e9c6157b683 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:26:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-2d7233c5-a94f-410d-82e2-4e207fec5f74 tempest-VolumesTransfersTest-2116109669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:26:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-2d7233c5-a94f-410d-82e2-4e207fec5f74 tempest-VolumesTransfersTest-2116109669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:26:30 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-2d7233c5-a94f-410d-82e2-4e207fec5f74 tempest-VolumesTransfersTest-2116109669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:26:30 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-2d7233c5-a94f-410d-82e2-4e207fec5f74 tempest-VolumesTransfersTest-2116109669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:26:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-2d7233c5-a94f-410d-82e2-4e207fec5f74 tempest-VolumesTransfersTest-2116109669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:26:30 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-2d7233c5-a94f-410d-82e2-4e207fec5f74 tempest-VolumesTransfersTest-2116109669 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:26:30 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-2d7233c5-a94f-410d-82e2-4e207fec5f74 tempest-VolumesTransfersTest-2116109669 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:26:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2d7233c5-a94f-410d-82e2-4e207fec5f74 tempest-VolumesTransfersTest-2116109669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-25f9e078-6e71-4d0c-bb73-2e9c6157b683 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:26:30 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-93faefe6-630d-4f0e-986c-eb95c01b696f tempest-GroupSnapshotsTest-280274705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03b52cb0-94c6-4821-a1d7-6f36a2ac3b98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e4cc28d-6520-4b1d-b5ce-80b6f59c161b', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:26:30 devstack sudo[98622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-25f9e078-6e71-4d0c-bb73-2e9c6157b683 1073741824 Sep 15 16:26:30 devstack sudo[98622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:26:30 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-93faefe6-630d-4f0e-986c-eb95c01b696f tempest-GroupSnapshotsTest-280274705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc4779a1-1bb2-4ce6-a442-9315fc9bfe55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:26:30 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-93faefe6-630d-4f0e-986c-eb95c01b696f tempest-GroupSnapshotsTest-280274705 None] Volume volume-6e4cc28d-6520-4b1d-b5ce-80b6f59c161b (6e4cc28d-6520-4b1d-b5ce-80b6f59c161b): created successfully Sep 15 16:26:30 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-93faefe6-630d-4f0e-986c-eb95c01b696f tempest-GroupSnapshotsTest-280274705 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc4779a1-1bb2-4ce6-a442-9315fc9bfe55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:26:30 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-93faefe6-630d-4f0e-986c-eb95c01b696f tempest-GroupSnapshotsTest-280274705 None] Flow 'volume_create_manager' (fb4b69cf-5272-449e-a0d2-6959be2712df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:26:30 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-93faefe6-630d-4f0e-986c-eb95c01b696f tempest-GroupSnapshotsTest-280274705 None] Created volume successfully. Sep 15 16:26:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-287ae702-be9c-40ce-ae84-c8529a936fc2 tempest-VolumesSnapshotListTestJSON-187697852 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:26:31 devstack sudo[98622]: pam_unix(sudo:session): session closed for user root Sep 15 16:26:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2d7233c5-a94f-410d-82e2-4e207fec5f74 tempest-VolumesTransfersTest-2116109669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-25f9e078-6e71-4d0c-bb73-2e9c6157b683 1073741824" returned: 0 in 0.835s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:26:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2d7233c5-a94f-410d-82e2-4e207fec5f74 tempest-VolumesTransfersTest-2116109669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-25f9e078-6e71-4d0c-bb73-2e9c6157b683 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:26:31 devstack sudo[98684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-25f9e078-6e71-4d0c-bb73-2e9c6157b683 Sep 15 16:26:31 devstack sudo[98684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:26:31 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-e12f647b-f7ee-4f32-a58b-ff58cc33c33e tempest-GroupSnapshotsTest-280274705 None] GroupSnapshot 2ce73290-d58a-4f9b-af7b-18d20c088f0c: creating. Sep 15 16:26:31 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e12f647b-f7ee-4f32-a58b-ff58cc33c33e tempest-GroupSnapshotsTest-280274705 None] Group snapshot 2ce73290-d58a-4f9b-af7b-18d20c088f0c: creating. {{(pid=86082) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 15 16:26:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-e12f647b-f7ee-4f32-a58b-ff58cc33c33e tempest-GroupSnapshotsTest-280274705 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:26:31 devstack sudo[98684]: pam_unix(sudo:session): session closed for user root Sep 15 16:26:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2d7233c5-a94f-410d-82e2-4e207fec5f74 tempest-VolumesTransfersTest-2116109669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-25f9e078-6e71-4d0c-bb73-2e9c6157b683" returned: 0 in 0.313s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:26:31 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-2d7233c5-a94f-410d-82e2-4e207fec5f74 tempest-VolumesTransfersTest-2116109669 None] <== create_volume: return (1207ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:26:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-2d7233c5-a94f-410d-82e2-4e207fec5f74 tempest-VolumesTransfersTest-2116109669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.211s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:26:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-287ae702-be9c-40ce-ae84-c8529a936fc2 tempest-VolumesSnapshotListTestJSON-187697852 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.079s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:26:31 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2d7233c5-a94f-410d-82e2-4e207fec5f74 tempest-VolumesTransfersTest-2116109669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e3cf3f8-6972-4054-ad4d-e4a0f6029267) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25f9e078-6e71-4d0c-bb73-2e9c6157b683', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:26:31 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2d7233c5-a94f-410d-82e2-4e207fec5f74 tempest-VolumesTransfersTest-2116109669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce3083db-4586-40d1-99f7-2da802475d90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:26:31 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-287ae702-be9c-40ce-ae84-c8529a936fc2 tempest-VolumesSnapshotListTestJSON-187697852 None] Creating offline snapshot bb61c464-a547-494d-9d2b-0be0330ac667 of volume bba19694-1e59-4fa8-a71e-7d8401ffe5e7 {{(pid=86082) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 15 16:26:31 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-2d7233c5-a94f-410d-82e2-4e207fec5f74 tempest-VolumesTransfersTest-2116109669 None] Volume volume-25f9e078-6e71-4d0c-bb73-2e9c6157b683 (25f9e078-6e71-4d0c-bb73-2e9c6157b683): created successfully Sep 15 16:26:31 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2d7233c5-a94f-410d-82e2-4e207fec5f74 tempest-VolumesTransfersTest-2116109669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce3083db-4586-40d1-99f7-2da802475d90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:26:31 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2d7233c5-a94f-410d-82e2-4e207fec5f74 tempest-VolumesTransfersTest-2116109669 None] Flow 'volume_create_manager' (cc47904f-9077-4b24-a4c0-523190375b44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:26:32 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[63b7ac82-6073-452a-9175-bd8721cee5d9]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:26:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-287ae702-be9c-40ce-ae84-c8529a936fc2 tempest-VolumesSnapshotListTestJSON-187697852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-bba19694-1e59-4fa8-a71e-7d8401ffe5e7.2025e9c3-9cd3-4fbe-9924-d0a07cc6322f {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:26:32 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-2d7233c5-a94f-410d-82e2-4e207fec5f74 tempest-VolumesTransfersTest-2116109669 None] Created volume successfully. Sep 15 16:26:32 devstack sudo[98697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-bba19694-1e59-4fa8-a71e-7d8401ffe5e7.2025e9c3-9cd3-4fbe-9924-d0a07cc6322f Sep 15 16:26:32 devstack sudo[98697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:26:32 devstack sudo[98697]: pam_unix(sudo:session): session closed for user root Sep 15 16:26:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-287ae702-be9c-40ce-ae84-c8529a936fc2 tempest-VolumesSnapshotListTestJSON-187697852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-bba19694-1e59-4fa8-a71e-7d8401ffe5e7.2025e9c3-9cd3-4fbe-9924-d0a07cc6322f" returned: 0 in 0.564s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:26:32 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-287ae702-be9c-40ce-ae84-c8529a936fc2 tempest-VolumesSnapshotListTestJSON-187697852 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bba19694-1e59-4fa8-a71e-7d8401ffe5e7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 16:26:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-287ae702-be9c-40ce-ae84-c8529a936fc2 tempest-VolumesSnapshotListTestJSON-187697852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-bba19694-1e59-4fa8-a71e-7d8401ffe5e7.2025e9c3-9cd3-4fbe-9924-d0a07cc6322f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-bba19694-1e59-4fa8-a71e-7d8401ffe5e7.bb61c464-a547-494d-9d2b-0be0330ac667 1G {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:26:32 devstack sudo[98709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-bba19694-1e59-4fa8-a71e-7d8401ffe5e7.2025e9c3-9cd3-4fbe-9924-d0a07cc6322f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-bba19694-1e59-4fa8-a71e-7d8401ffe5e7.bb61c464-a547-494d-9d2b-0be0330ac667 1G Sep 15 16:26:32 devstack sudo[98709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:26:33 devstack sudo[98709]: pam_unix(sudo:session): session closed for user root Sep 15 16:26:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-287ae702-be9c-40ce-ae84-c8529a936fc2 tempest-VolumesSnapshotListTestJSON-187697852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-bba19694-1e59-4fa8-a71e-7d8401ffe5e7.2025e9c3-9cd3-4fbe-9924-d0a07cc6322f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-bba19694-1e59-4fa8-a71e-7d8401ffe5e7.bb61c464-a547-494d-9d2b-0be0330ac667 1G" returned: 0 in 0.657s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:26:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-287ae702-be9c-40ce-ae84-c8529a936fc2 tempest-VolumesSnapshotListTestJSON-187697852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bba19694-1e59-4fa8-a71e-7d8401ffe5e7.2025e9c3-9cd3-4fbe-9924-d0a07cc6322f -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-bba19694-1e59-4fa8-a71e-7d8401ffe5e7.bb61c464-a547-494d-9d2b-0be0330ac667 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:26:33 devstack sudo[98717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bba19694-1e59-4fa8-a71e-7d8401ffe5e7.2025e9c3-9cd3-4fbe-9924-d0a07cc6322f -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-bba19694-1e59-4fa8-a71e-7d8401ffe5e7.bb61c464-a547-494d-9d2b-0be0330ac667 Sep 15 16:26:33 devstack sudo[98717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:26:33 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-42e4c572-2a3f-414c-b108-6e1b118f89c6 tempest-VolumesTransfersTest-1323684220 None] Transfer volume completed successfully. Sep 15 16:26:33 devstack sudo[98717]: pam_unix(sudo:session): session closed for user root Sep 15 16:26:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-287ae702-be9c-40ce-ae84-c8529a936fc2 tempest-VolumesSnapshotListTestJSON-187697852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bba19694-1e59-4fa8-a71e-7d8401ffe5e7.2025e9c3-9cd3-4fbe-9924-d0a07cc6322f -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-bba19694-1e59-4fa8-a71e-7d8401ffe5e7.bb61c464-a547-494d-9d2b-0be0330ac667" returned: 0 in 0.369s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:26:33 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-287ae702-be9c-40ce-ae84-c8529a936fc2 tempest-VolumesSnapshotListTestJSON-187697852 None] /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-bba19694-1e59-4fa8-a71e-7d8401ffe5e7.bb61c464-a547-494d-9d2b-0be0330ac667 is being set with open permissions: ugo+rw Sep 15 16:26:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-287ae702-be9c-40ce-ae84-c8529a936fc2 tempest-VolumesSnapshotListTestJSON-187697852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-bba19694-1e59-4fa8-a71e-7d8401ffe5e7.bb61c464-a547-494d-9d2b-0be0330ac667 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:26:33 devstack sudo[98723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-bba19694-1e59-4fa8-a71e-7d8401ffe5e7.bb61c464-a547-494d-9d2b-0be0330ac667 Sep 15 16:26:33 devstack sudo[98723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:26:33 devstack sudo[98723]: pam_unix(sudo:session): session closed for user root Sep 15 16:26:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-287ae702-be9c-40ce-ae84-c8529a936fc2 tempest-VolumesSnapshotListTestJSON-187697852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-bba19694-1e59-4fa8-a71e-7d8401ffe5e7.bb61c464-a547-494d-9d2b-0be0330ac667" returned: 0 in 0.283s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:26:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-287ae702-be9c-40ce-ae84-c8529a936fc2 tempest-VolumesSnapshotListTestJSON-187697852 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.067s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:26:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-e12f647b-f7ee-4f32-a58b-ff58cc33c33e tempest-GroupSnapshotsTest-280274705 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.127s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:26:33 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-e12f647b-f7ee-4f32-a58b-ff58cc33c33e tempest-GroupSnapshotsTest-280274705 None] Creating offline snapshot 208e8c56-fc87-42ef-b63b-a124ff809713 of volume 6e4cc28d-6520-4b1d-b5ce-80b6f59c161b {{(pid=86082) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 15 16:26:33 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-287ae702-be9c-40ce-ae84-c8529a936fc2 tempest-VolumesSnapshotListTestJSON-187697852 None] Create snapshot completed successfully Sep 15 16:26:33 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[a87d8aeb-5bde-4f07-9c5e-a9b94b24246a]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:26:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e12f647b-f7ee-4f32-a58b-ff58cc33c33e tempest-GroupSnapshotsTest-280274705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6e4cc28d-6520-4b1d-b5ce-80b6f59c161b {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:26:34 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-added96f-00bd-4a4d-b5e5-dc4034a3911f tempest-VolumesTransfersTest-415430234 None] Acquiring lock "cinder-25f9e078-6e71-4d0c-bb73-2e9c6157b683-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:26:34 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-added96f-00bd-4a4d-b5e5-dc4034a3911f tempest-VolumesTransfersTest-415430234 None] Lock "cinder-25f9e078-6e71-4d0c-bb73-2e9c6157b683-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:26:34 devstack sudo[98726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6e4cc28d-6520-4b1d-b5ce-80b6f59c161b Sep 15 16:26:34 devstack sudo[98726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:26:34 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-added96f-00bd-4a4d-b5e5-dc4034a3911f tempest-VolumesTransfersTest-415430234 None] Acquiring lock "cinder-quobyte-25f9e078-6e71-4d0c-bb73-2e9c6157b683" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:26:34 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-added96f-00bd-4a4d-b5e5-dc4034a3911f tempest-VolumesTransfersTest-415430234 None] Lock "cinder-quobyte-25f9e078-6e71-4d0c-bb73-2e9c6157b683" acquired by "delete_volume" :: waited 0.046s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:26:34 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[f20b3fbe-14b2-4f0f-85e0-f8372e5a492b]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:26:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-added96f-00bd-4a4d-b5e5-dc4034a3911f tempest-VolumesTransfersTest-415430234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-25f9e078-6e71-4d0c-bb73-2e9c6157b683 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:26:34 devstack sudo[98726]: pam_unix(sudo:session): session closed for user root Sep 15 16:26:34 devstack sudo[98728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-25f9e078-6e71-4d0c-bb73-2e9c6157b683 Sep 15 16:26:34 devstack sudo[98728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:26:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e12f647b-f7ee-4f32-a58b-ff58cc33c33e tempest-GroupSnapshotsTest-280274705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6e4cc28d-6520-4b1d-b5ce-80b6f59c161b" returned: 0 in 0.485s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:26:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e12f647b-f7ee-4f32-a58b-ff58cc33c33e tempest-GroupSnapshotsTest-280274705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6e4cc28d-6520-4b1d-b5ce-80b6f59c161b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6e4cc28d-6520-4b1d-b5ce-80b6f59c161b.208e8c56-fc87-42ef-b63b-a124ff809713 1G {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:26:34 devstack sudo[98733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6e4cc28d-6520-4b1d-b5ce-80b6f59c161b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6e4cc28d-6520-4b1d-b5ce-80b6f59c161b.208e8c56-fc87-42ef-b63b-a124ff809713 1G Sep 15 16:26:34 devstack sudo[98733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:26:34 devstack sudo[98728]: pam_unix(sudo:session): session closed for user root Sep 15 16:26:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-added96f-00bd-4a4d-b5e5-dc4034a3911f tempest-VolumesTransfersTest-415430234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-25f9e078-6e71-4d0c-bb73-2e9c6157b683" returned: 0 in 0.521s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:26:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-added96f-00bd-4a4d-b5e5-dc4034a3911f tempest-VolumesTransfersTest-415430234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-25f9e078-6e71-4d0c-bb73-2e9c6157b683 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:26:34 devstack sudo[98738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-25f9e078-6e71-4d0c-bb73-2e9c6157b683 Sep 15 16:26:34 devstack sudo[98738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:26:35 devstack sudo[98738]: pam_unix(sudo:session): session closed for user root Sep 15 16:26:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-added96f-00bd-4a4d-b5e5-dc4034a3911f tempest-VolumesTransfersTest-415430234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-25f9e078-6e71-4d0c-bb73-2e9c6157b683" returned: 0 in 0.420s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:26:35 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-added96f-00bd-4a4d-b5e5-dc4034a3911f tempest-VolumesTransfersTest-415430234 None] Lock "cinder-quobyte-25f9e078-6e71-4d0c-bb73-2e9c6157b683" released by "delete_volume" :: held 1.039s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:26:35 devstack sudo[98733]: pam_unix(sudo:session): session closed for user root Sep 15 16:26:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e12f647b-f7ee-4f32-a58b-ff58cc33c33e tempest-GroupSnapshotsTest-280274705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6e4cc28d-6520-4b1d-b5ce-80b6f59c161b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6e4cc28d-6520-4b1d-b5ce-80b6f59c161b.208e8c56-fc87-42ef-b63b-a124ff809713 1G" returned: 0 in 0.898s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:26:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e12f647b-f7ee-4f32-a58b-ff58cc33c33e tempest-GroupSnapshotsTest-280274705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e4cc28d-6520-4b1d-b5ce-80b6f59c161b -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6e4cc28d-6520-4b1d-b5ce-80b6f59c161b.208e8c56-fc87-42ef-b63b-a124ff809713 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:26:35 devstack sudo[98744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e4cc28d-6520-4b1d-b5ce-80b6f59c161b -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6e4cc28d-6520-4b1d-b5ce-80b6f59c161b.208e8c56-fc87-42ef-b63b-a124ff809713 Sep 15 16:26:35 devstack sudo[98744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:26:35 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-added96f-00bd-4a4d-b5e5-dc4034a3911f tempest-VolumesTransfersTest-415430234 None] Created reservations ['14603902-10c2-43c7-8201-49a1df7b6a49', 'dcf4ae70-65c9-4c7f-9407-7c55d5292d26', '1500a434-baf2-4e13-98bf-6d15b4731187', '6176262a-8d6e-450f-a49b-285f32022183'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:26:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-added96f-00bd-4a4d-b5e5-dc4034a3911f tempest-VolumesTransfersTest-415430234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:26:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-added96f-00bd-4a4d-b5e5-dc4034a3911f tempest-VolumesTransfersTest-415430234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:26:35 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-added96f-00bd-4a4d-b5e5-dc4034a3911f tempest-VolumesTransfersTest-415430234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:26:35 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-added96f-00bd-4a4d-b5e5-dc4034a3911f tempest-VolumesTransfersTest-415430234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:26:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-added96f-00bd-4a4d-b5e5-dc4034a3911f tempest-VolumesTransfersTest-415430234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:26:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-added96f-00bd-4a4d-b5e5-dc4034a3911f tempest-VolumesTransfersTest-415430234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:26:35 devstack sudo[98746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:26:35 devstack sudo[98746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:26:35 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c886b309-debb-4cc9-9f8b-3c3c172438fd tempest-VolumesSnapshotListTestJSON-187697852 None] Acquiring lock "cinder-bb61c464-a547-494d-9d2b-0be0330ac667-delete_snapshot" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:26:35 devstack sudo[98744]: pam_unix(sudo:session): session closed for user root Sep 15 16:26:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e12f647b-f7ee-4f32-a58b-ff58cc33c33e tempest-GroupSnapshotsTest-280274705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e4cc28d-6520-4b1d-b5ce-80b6f59c161b -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6e4cc28d-6520-4b1d-b5ce-80b6f59c161b.208e8c56-fc87-42ef-b63b-a124ff809713" returned: 0 in 0.465s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:26:35 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-e12f647b-f7ee-4f32-a58b-ff58cc33c33e tempest-GroupSnapshotsTest-280274705 None] /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6e4cc28d-6520-4b1d-b5ce-80b6f59c161b.208e8c56-fc87-42ef-b63b-a124ff809713 is being set with open permissions: ugo+rw: NotImplementedError Sep 15 16:26:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e12f647b-f7ee-4f32-a58b-ff58cc33c33e tempest-GroupSnapshotsTest-280274705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6e4cc28d-6520-4b1d-b5ce-80b6f59c161b.208e8c56-fc87-42ef-b63b-a124ff809713 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:26:35 devstack sudo[98751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6e4cc28d-6520-4b1d-b5ce-80b6f59c161b.208e8c56-fc87-42ef-b63b-a124ff809713 Sep 15 16:26:35 devstack sudo[98751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:26:35 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c886b309-debb-4cc9-9f8b-3c3c172438fd tempest-VolumesSnapshotListTestJSON-187697852 None] Lock "cinder-bb61c464-a547-494d-9d2b-0be0330ac667-delete_snapshot" acquired by "delete_snapshot" :: waited 0.078s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:26:35 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c886b309-debb-4cc9-9f8b-3c3c172438fd tempest-VolumesSnapshotListTestJSON-187697852 None] Acquiring lock "cinder-quobyte-bba19694-1e59-4fa8-a71e-7d8401ffe5e7" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:26:35 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c886b309-debb-4cc9-9f8b-3c3c172438fd tempest-VolumesSnapshotListTestJSON-187697852 None] Lock "cinder-quobyte-bba19694-1e59-4fa8-a71e-7d8401ffe5e7" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:26:35 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c886b309-debb-4cc9-9f8b-3c3c172438fd tempest-VolumesSnapshotListTestJSON-187697852 None] Acquiring lock "cinder-quobyte-bb61c464-a547-494d-9d2b-0be0330ac667" by "_delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:26:35 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c886b309-debb-4cc9-9f8b-3c3c172438fd tempest-VolumesSnapshotListTestJSON-187697852 None] Lock "cinder-quobyte-bb61c464-a547-494d-9d2b-0be0330ac667" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:26:36 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-c886b309-debb-4cc9-9f8b-3c3c172438fd tempest-VolumesSnapshotListTestJSON-187697852 None] Deleting offline snapshot bb61c464-a547-494d-9d2b-0be0330ac667 of volume bba19694-1e59-4fa8-a71e-7d8401ffe5e7 {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 15 16:26:36 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-c886b309-debb-4cc9-9f8b-3c3c172438fd tempest-VolumesSnapshotListTestJSON-187697852 None] snapshot_file for this snap is: volume-bba19694-1e59-4fa8-a71e-7d8401ffe5e7.bb61c464-a547-494d-9d2b-0be0330ac667 {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 15 16:26:36 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[778f7935-339e-4bdc-863a-b63d71fbebea]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:26:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c886b309-debb-4cc9-9f8b-3c3c172438fd tempest-VolumesSnapshotListTestJSON-187697852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-bba19694-1e59-4fa8-a71e-7d8401ffe5e7.bb61c464-a547-494d-9d2b-0be0330ac667 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:26:36 devstack sudo[98746]: pam_unix(sudo:session): session closed for user root Sep 15 16:26:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-added96f-00bd-4a4d-b5e5-dc4034a3911f tempest-VolumesTransfersTest-415430234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.515s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:26:36 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-added96f-00bd-4a4d-b5e5-dc4034a3911f tempest-VolumesTransfersTest-415430234 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:26:36 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-added96f-00bd-4a4d-b5e5-dc4034a3911f tempest-VolumesTransfersTest-415430234 None] Deleted volume successfully. Sep 15 16:26:36 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-added96f-00bd-4a4d-b5e5-dc4034a3911f tempest-VolumesTransfersTest-415430234 None] Lock "cinder-25f9e078-6e71-4d0c-bb73-2e9c6157b683-delete_volume" released by "delete_volume" :: held 2.067s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:26:36 devstack sudo[98751]: pam_unix(sudo:session): session closed for user root Sep 15 16:26:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e12f647b-f7ee-4f32-a58b-ff58cc33c33e tempest-GroupSnapshotsTest-280274705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6e4cc28d-6520-4b1d-b5ce-80b6f59c161b.208e8c56-fc87-42ef-b63b-a124ff809713" returned: 0 in 0.344s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:26:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e12f647b-f7ee-4f32-a58b-ff58cc33c33e tempest-GroupSnapshotsTest-280274705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6e4cc28d-6520-4b1d-b5ce-80b6f59c161b.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:26:36 devstack sudo[98753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-bba19694-1e59-4fa8-a71e-7d8401ffe5e7.bb61c464-a547-494d-9d2b-0be0330ac667 Sep 15 16:26:36 devstack sudo[98753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:26:36 devstack sudo[98756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6e4cc28d-6520-4b1d-b5ce-80b6f59c161b.info Sep 15 16:26:36 devstack sudo[98756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:26:36 devstack sudo[98756]: pam_unix(sudo:session): session closed for user root Sep 15 16:26:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e12f647b-f7ee-4f32-a58b-ff58cc33c33e tempest-GroupSnapshotsTest-280274705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6e4cc28d-6520-4b1d-b5ce-80b6f59c161b.info" returned: 0 in 0.336s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:26:36 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-e12f647b-f7ee-4f32-a58b-ff58cc33c33e tempest-GroupSnapshotsTest-280274705 None] /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6e4cc28d-6520-4b1d-b5ce-80b6f59c161b.info is being set with open permissions: ugo+rw: NotImplementedError Sep 15 16:26:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e12f647b-f7ee-4f32-a58b-ff58cc33c33e tempest-GroupSnapshotsTest-280274705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6e4cc28d-6520-4b1d-b5ce-80b6f59c161b.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:26:36 devstack sudo[98763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6e4cc28d-6520-4b1d-b5ce-80b6f59c161b.info Sep 15 16:26:36 devstack sudo[98763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:26:36 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-7fc7bda0-82bf-471c-9f31-bb4d47fcb584 tempest-TestMinimumBasicScenario-827702894 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:26:36 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7fc7bda0-82bf-471c-9f31-bb4d47fcb584 tempest-TestMinimumBasicScenario-827702894 None] Flow 'volume_create_manager' (934d52a5-37eb-4868-9d54-a558596c4423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:26:36 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7fc7bda0-82bf-471c-9f31-bb4d47fcb584 tempest-TestMinimumBasicScenario-827702894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1618bbfc-fb83-4085-aab2-735e37e7ee1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:26:36 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7fc7bda0-82bf-471c-9f31-bb4d47fcb584 tempest-TestMinimumBasicScenario-827702894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1618bbfc-fb83-4085-aab2-735e37e7ee1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:26:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-821336566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb3b13af-515b-4eda-a1da-df74c7149aa9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='302c28ef3e7145748371f9684a49309c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:26:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:26:37Z,use_quota=True,user_id='58f407b2586d4411a5baf3fe83136232',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:26:36 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7fc7bda0-82bf-471c-9f31-bb4d47fcb584 tempest-TestMinimumBasicScenario-827702894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe29f35c-7f48-43bf-b67f-ec90443f45db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:26:36 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7fc7bda0-82bf-471c-9f31-bb4d47fcb584 tempest-TestMinimumBasicScenario-827702894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe29f35c-7f48-43bf-b67f-ec90443f45db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:26:36 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7fc7bda0-82bf-471c-9f31-bb4d47fcb584 tempest-TestMinimumBasicScenario-827702894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae3d59b8-8a8b-47d3-9180-6f9c2f3f6488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:26:36 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7fc7bda0-82bf-471c-9f31-bb4d47fcb584 tempest-TestMinimumBasicScenario-827702894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae3d59b8-8a8b-47d3-9180-6f9c2f3f6488) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb3b13af-515b-4eda-a1da-df74c7149aa9', 'volume_name': 'volume-cb3b13af-515b-4eda-a1da-df74c7149aa9', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:26:36 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7fc7bda0-82bf-471c-9f31-bb4d47fcb584 tempest-TestMinimumBasicScenario-827702894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45ad17b4-36b8-4c0a-b74e-3ad066b274b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:26:36 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7fc7bda0-82bf-471c-9f31-bb4d47fcb584 tempest-TestMinimumBasicScenario-827702894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45ad17b4-36b8-4c0a-b74e-3ad066b274b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:26:36 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7fc7bda0-82bf-471c-9f31-bb4d47fcb584 tempest-TestMinimumBasicScenario-827702894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2defb164-5c41-40cf-908b-58c31b706ab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:26:36 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-7fc7bda0-82bf-471c-9f31-bb4d47fcb584 tempest-TestMinimumBasicScenario-827702894 None] Volume cb3b13af-515b-4eda-a1da-df74c7149aa9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb3b13af-515b-4eda-a1da-df74c7149aa9', 'volume_size': 1} Sep 15 16:26:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-7fc7bda0-82bf-471c-9f31-bb4d47fcb584 tempest-TestMinimumBasicScenario-827702894 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:26:36 devstack sudo[98753]: pam_unix(sudo:session): session closed for user root Sep 15 16:26:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c886b309-debb-4cc9-9f8b-3c3c172438fd tempest-VolumesSnapshotListTestJSON-187697852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-bba19694-1e59-4fa8-a71e-7d8401ffe5e7.bb61c464-a547-494d-9d2b-0be0330ac667" returned: 0 in 0.766s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:26:36 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-c886b309-debb-4cc9-9f8b-3c3c172438fd tempest-VolumesSnapshotListTestJSON-187697852 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bba19694-1e59-4fa8-a71e-7d8401ffe5e7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 16:26:36 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e03cf8c-5e44-4cc8-ad2f-08e0f9081f95]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:26:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c886b309-debb-4cc9-9f8b-3c3c172438fd tempest-VolumesSnapshotListTestJSON-187697852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-bba19694-1e59-4fa8-a71e-7d8401ffe5e7.2025e9c3-9cd3-4fbe-9924-d0a07cc6322f {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:26:36 devstack sudo[98763]: pam_unix(sudo:session): session closed for user root Sep 15 16:26:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e12f647b-f7ee-4f32-a58b-ff58cc33c33e tempest-GroupSnapshotsTest-280274705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6e4cc28d-6520-4b1d-b5ce-80b6f59c161b.info" returned: 0 in 0.366s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:26:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-e12f647b-f7ee-4f32-a58b-ff58cc33c33e tempest-GroupSnapshotsTest-280274705 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.051s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:26:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-7fc7bda0-82bf-471c-9f31-bb4d47fcb584 tempest-TestMinimumBasicScenario-827702894 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.200s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:26:36 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-7fc7bda0-82bf-471c-9f31-bb4d47fcb584 tempest-TestMinimumBasicScenario-827702894 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:26:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-821336566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb3b13af-515b-4eda-a1da-df74c7149aa9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='302c28ef3e7145748371f9684a49309c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:26:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:26:37Z,use_quota=True,user_id='58f407b2586d4411a5baf3fe83136232',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:26:36 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-7fc7bda0-82bf-471c-9f31-bb4d47fcb584 tempest-TestMinimumBasicScenario-827702894 None] Creating volume cb3b13af-515b-4eda-a1da-df74c7149aa9 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:26:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-7fc7bda0-82bf-471c-9f31-bb4d47fcb584 tempest-TestMinimumBasicScenario-827702894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:26:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-7fc7bda0-82bf-471c-9f31-bb4d47fcb584 tempest-TestMinimumBasicScenario-827702894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:26:36 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-7fc7bda0-82bf-471c-9f31-bb4d47fcb584 tempest-TestMinimumBasicScenario-827702894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:26:37 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-7fc7bda0-82bf-471c-9f31-bb4d47fcb584 tempest-TestMinimumBasicScenario-827702894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:26:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-7fc7bda0-82bf-471c-9f31-bb4d47fcb584 tempest-TestMinimumBasicScenario-827702894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:26:37 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-7fc7bda0-82bf-471c-9f31-bb4d47fcb584 tempest-TestMinimumBasicScenario-827702894 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:26:37 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-7fc7bda0-82bf-471c-9f31-bb4d47fcb584 tempest-TestMinimumBasicScenario-827702894 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:26:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7fc7bda0-82bf-471c-9f31-bb4d47fcb584 tempest-TestMinimumBasicScenario-827702894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-cb3b13af-515b-4eda-a1da-df74c7149aa9 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:26:37 devstack sudo[98768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-bba19694-1e59-4fa8-a71e-7d8401ffe5e7.2025e9c3-9cd3-4fbe-9924-d0a07cc6322f Sep 15 16:26:37 devstack sudo[98768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:26:37 devstack sudo[98770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-cb3b13af-515b-4eda-a1da-df74c7149aa9 1073741824 Sep 15 16:26:37 devstack sudo[98770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:26:37 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-e12f647b-f7ee-4f32-a58b-ff58cc33c33e tempest-GroupSnapshotsTest-280274705 None] group_snapshot 2ce73290-d58a-4f9b-af7b-18d20c088f0c: created successfully Sep 15 16:26:37 devstack sudo[98768]: pam_unix(sudo:session): session closed for user root Sep 15 16:26:37 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-d02300b0-9a21-45e2-a83b-e897c2ef0776 tempest-VolumesTransfersTest-2116109669 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:26:37 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-d02300b0-9a21-45e2-a83b-e897c2ef0776 tempest-VolumesTransfersTest-2116109669 None] Flow 'volume_create_manager' (9637c12d-5f13-4bca-a23f-355bc87e521d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:26:37 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-d02300b0-9a21-45e2-a83b-e897c2ef0776 tempest-VolumesTransfersTest-2116109669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0fcf3ae-ab8a-4eb3-83dd-9cf56c802ef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:26:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c886b309-debb-4cc9-9f8b-3c3c172438fd tempest-VolumesSnapshotListTestJSON-187697852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-bba19694-1e59-4fa8-a71e-7d8401ffe5e7.2025e9c3-9cd3-4fbe-9924-d0a07cc6322f" returned: 0 in 0.658s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:26:37 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-c886b309-debb-4cc9-9f8b-3c3c172438fd tempest-VolumesSnapshotListTestJSON-187697852 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bba19694-1e59-4fa8-a71e-7d8401ffe5e7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 16:26:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c886b309-debb-4cc9-9f8b-3c3c172438fd tempest-VolumesSnapshotListTestJSON-187697852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-bba19694-1e59-4fa8-a71e-7d8401ffe5e7.bb61c464-a547-494d-9d2b-0be0330ac667 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:26:37 devstack sudo[98776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-bba19694-1e59-4fa8-a71e-7d8401ffe5e7.bb61c464-a547-494d-9d2b-0be0330ac667 Sep 15 16:26:37 devstack sudo[98776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:26:37 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-62ed3877-f0be-49bd-bf35-fe2d2575cace tempest-GroupSnapshotsTest-280274705 None] group_snapshot 2ce73290-d58a-4f9b-af7b-18d20c088f0c: deleting Sep 15 16:26:37 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-d02300b0-9a21-45e2-a83b-e897c2ef0776 tempest-VolumesTransfersTest-2116109669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0fcf3ae-ab8a-4eb3-83dd-9cf56c802ef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:26:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-556202757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7e59783-911d-48fd-b0cc-2dd40c7e419a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99ebd68550d6427f91d9fb22e7001351',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:26:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:26:37Z,use_quota=True,user_id='60c5cff5e56247edb2f0056ac686b987',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:26:37 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-d02300b0-9a21-45e2-a83b-e897c2ef0776 tempest-VolumesTransfersTest-2116109669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d6abab8-ea30-40b7-8a9a-4b60d1610411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:26:37 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-d02300b0-9a21-45e2-a83b-e897c2ef0776 tempest-VolumesTransfersTest-2116109669 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d6abab8-ea30-40b7-8a9a-4b60d1610411) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:26:37 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-d02300b0-9a21-45e2-a83b-e897c2ef0776 tempest-VolumesTransfersTest-2116109669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6284a89f-81fd-4f3f-bb04-2130dc932273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:26:37 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-d02300b0-9a21-45e2-a83b-e897c2ef0776 tempest-VolumesTransfersTest-2116109669 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6284a89f-81fd-4f3f-bb04-2130dc932273) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e7e59783-911d-48fd-b0cc-2dd40c7e419a', 'volume_name': 'volume-e7e59783-911d-48fd-b0cc-2dd40c7e419a', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:26:37 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-d02300b0-9a21-45e2-a83b-e897c2ef0776 tempest-VolumesTransfersTest-2116109669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6913a95c-ca6b-4fef-8b0a-7eae024c4252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:26:37 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-d02300b0-9a21-45e2-a83b-e897c2ef0776 tempest-VolumesTransfersTest-2116109669 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6913a95c-ca6b-4fef-8b0a-7eae024c4252) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:26:37 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-d02300b0-9a21-45e2-a83b-e897c2ef0776 tempest-VolumesTransfersTest-2116109669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06363228-732e-4f9a-ab8b-a6c2c0b13597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:26:37 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-d02300b0-9a21-45e2-a83b-e897c2ef0776 tempest-VolumesTransfersTest-2116109669 None] Volume e7e59783-911d-48fd-b0cc-2dd40c7e419a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e7e59783-911d-48fd-b0cc-2dd40c7e419a', 'volume_size': 1} Sep 15 16:26:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-d02300b0-9a21-45e2-a83b-e897c2ef0776 tempest-VolumesTransfersTest-2116109669 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:26:37 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-62ed3877-f0be-49bd-bf35-fe2d2575cace tempest-GroupSnapshotsTest-280274705 None] group_snapshot 2ce73290-d58a-4f9b-af7b-18d20c088f0c: deleting {{(pid=86082) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 15 16:26:37 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-62ed3877-f0be-49bd-bf35-fe2d2575cace tempest-GroupSnapshotsTest-280274705 None] Acquiring lock "cinder-quobyte-6e4cc28d-6520-4b1d-b5ce-80b6f59c161b" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:26:37 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-62ed3877-f0be-49bd-bf35-fe2d2575cace tempest-GroupSnapshotsTest-280274705 None] Lock "cinder-quobyte-6e4cc28d-6520-4b1d-b5ce-80b6f59c161b" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:26:37 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-62ed3877-f0be-49bd-bf35-fe2d2575cace tempest-GroupSnapshotsTest-280274705 None] Acquiring lock "cinder-quobyte-208e8c56-fc87-42ef-b63b-a124ff809713" by "_delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:26:37 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-62ed3877-f0be-49bd-bf35-fe2d2575cace tempest-GroupSnapshotsTest-280274705 None] Lock "cinder-quobyte-208e8c56-fc87-42ef-b63b-a124ff809713" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:26:37 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-62ed3877-f0be-49bd-bf35-fe2d2575cace tempest-GroupSnapshotsTest-280274705 None] Deleting offline snapshot 208e8c56-fc87-42ef-b63b-a124ff809713 of volume 6e4cc28d-6520-4b1d-b5ce-80b6f59c161b {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 15 16:26:37 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-62ed3877-f0be-49bd-bf35-fe2d2575cace tempest-GroupSnapshotsTest-280274705 None] snapshot_file for this snap is: volume-6e4cc28d-6520-4b1d-b5ce-80b6f59c161b.208e8c56-fc87-42ef-b63b-a124ff809713 {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 15 16:26:37 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[75c854da-4a1b-4d04-8a4e-5a92a340a5de]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:26:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-62ed3877-f0be-49bd-bf35-fe2d2575cace tempest-GroupSnapshotsTest-280274705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6e4cc28d-6520-4b1d-b5ce-80b6f59c161b.208e8c56-fc87-42ef-b63b-a124ff809713 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:26:37 devstack sudo[98770]: pam_unix(sudo:session): session closed for user root Sep 15 16:26:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7fc7bda0-82bf-471c-9f31-bb4d47fcb584 tempest-TestMinimumBasicScenario-827702894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-cb3b13af-515b-4eda-a1da-df74c7149aa9 1073741824" returned: 0 in 0.914s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:26:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7fc7bda0-82bf-471c-9f31-bb4d47fcb584 tempest-TestMinimumBasicScenario-827702894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-cb3b13af-515b-4eda-a1da-df74c7149aa9 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:26:37 devstack sudo[98786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-cb3b13af-515b-4eda-a1da-df74c7149aa9 Sep 15 16:26:37 devstack sudo[98786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:26:38 devstack sudo[98785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6e4cc28d-6520-4b1d-b5ce-80b6f59c161b.208e8c56-fc87-42ef-b63b-a124ff809713 Sep 15 16:26:38 devstack sudo[98785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:26:38 devstack sudo[98776]: pam_unix(sudo:session): session closed for user root Sep 15 16:26:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c886b309-debb-4cc9-9f8b-3c3c172438fd tempest-VolumesSnapshotListTestJSON-187697852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-bba19694-1e59-4fa8-a71e-7d8401ffe5e7.bb61c464-a547-494d-9d2b-0be0330ac667" returned: 0 in 0.633s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:26:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c886b309-debb-4cc9-9f8b-3c3c172438fd tempest-VolumesSnapshotListTestJSON-187697852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-bba19694-1e59-4fa8-a71e-7d8401ffe5e7.bb61c464-a547-494d-9d2b-0be0330ac667 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:26:38 devstack sudo[98789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-bba19694-1e59-4fa8-a71e-7d8401ffe5e7.bb61c464-a547-494d-9d2b-0be0330ac667 Sep 15 16:26:38 devstack sudo[98789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:26:38 devstack sudo[98786]: pam_unix(sudo:session): session closed for user root Sep 15 16:26:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7fc7bda0-82bf-471c-9f31-bb4d47fcb584 tempest-TestMinimumBasicScenario-827702894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-cb3b13af-515b-4eda-a1da-df74c7149aa9" returned: 0 in 0.279s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:26:38 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-7fc7bda0-82bf-471c-9f31-bb4d47fcb584 tempest-TestMinimumBasicScenario-827702894 None] <== create_volume: return (1247ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:26:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-7fc7bda0-82bf-471c-9f31-bb4d47fcb584 tempest-TestMinimumBasicScenario-827702894 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.252s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:26:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-d02300b0-9a21-45e2-a83b-e897c2ef0776 tempest-VolumesTransfersTest-2116109669 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.550s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:26:38 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-d02300b0-9a21-45e2-a83b-e897c2ef0776 tempest-VolumesTransfersTest-2116109669 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:26:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-556202757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e7e59783-911d-48fd-b0cc-2dd40c7e419a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99ebd68550d6427f91d9fb22e7001351',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:26:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:26:37Z,use_quota=True,user_id='60c5cff5e56247edb2f0056ac686b987',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:26:38 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-d02300b0-9a21-45e2-a83b-e897c2ef0776 tempest-VolumesTransfersTest-2116109669 None] Creating volume e7e59783-911d-48fd-b0cc-2dd40c7e419a {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:26:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-d02300b0-9a21-45e2-a83b-e897c2ef0776 tempest-VolumesTransfersTest-2116109669 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:26:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-d02300b0-9a21-45e2-a83b-e897c2ef0776 tempest-VolumesTransfersTest-2116109669 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:26:38 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-d02300b0-9a21-45e2-a83b-e897c2ef0776 tempest-VolumesTransfersTest-2116109669 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:26:38 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-d02300b0-9a21-45e2-a83b-e897c2ef0776 tempest-VolumesTransfersTest-2116109669 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:26:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-d02300b0-9a21-45e2-a83b-e897c2ef0776 tempest-VolumesTransfersTest-2116109669 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:26:38 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-d02300b0-9a21-45e2-a83b-e897c2ef0776 tempest-VolumesTransfersTest-2116109669 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:26:38 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-d02300b0-9a21-45e2-a83b-e897c2ef0776 tempest-VolumesTransfersTest-2116109669 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:26:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d02300b0-9a21-45e2-a83b-e897c2ef0776 tempest-VolumesTransfersTest-2116109669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-e7e59783-911d-48fd-b0cc-2dd40c7e419a 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:26:38 devstack sudo[98794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-e7e59783-911d-48fd-b0cc-2dd40c7e419a 1073741824 Sep 15 16:26:38 devstack sudo[98794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:26:38 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7fc7bda0-82bf-471c-9f31-bb4d47fcb584 tempest-TestMinimumBasicScenario-827702894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2defb164-5c41-40cf-908b-58c31b706ab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb3b13af-515b-4eda-a1da-df74c7149aa9', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:26:38 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7fc7bda0-82bf-471c-9f31-bb4d47fcb584 tempest-TestMinimumBasicScenario-827702894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cc27ce6-dc43-4654-98cd-4baeabc92f9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:26:38 devstack sudo[98785]: pam_unix(sudo:session): session closed for user root Sep 15 16:26:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-62ed3877-f0be-49bd-bf35-fe2d2575cace tempest-GroupSnapshotsTest-280274705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6e4cc28d-6520-4b1d-b5ce-80b6f59c161b.208e8c56-fc87-42ef-b63b-a124ff809713" returned: 0 in 0.470s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:26:38 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-62ed3877-f0be-49bd-bf35-fe2d2575cace tempest-GroupSnapshotsTest-280274705 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e4cc28d-6520-4b1d-b5ce-80b6f59c161b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 16:26:38 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-7fc7bda0-82bf-471c-9f31-bb4d47fcb584 tempest-TestMinimumBasicScenario-827702894 None] Volume volume-cb3b13af-515b-4eda-a1da-df74c7149aa9 (cb3b13af-515b-4eda-a1da-df74c7149aa9): created successfully Sep 15 16:26:38 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7fc7bda0-82bf-471c-9f31-bb4d47fcb584 tempest-TestMinimumBasicScenario-827702894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cc27ce6-dc43-4654-98cd-4baeabc92f9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:26:38 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7fc7bda0-82bf-471c-9f31-bb4d47fcb584 tempest-TestMinimumBasicScenario-827702894 None] Flow 'volume_create_manager' (934d52a5-37eb-4868-9d54-a558596c4423) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:26:38 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[07321a23-ea3f-48df-916f-e0b9dfff9def]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:26:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-62ed3877-f0be-49bd-bf35-fe2d2575cace tempest-GroupSnapshotsTest-280274705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6e4cc28d-6520-4b1d-b5ce-80b6f59c161b {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:26:38 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-7fc7bda0-82bf-471c-9f31-bb4d47fcb584 tempest-TestMinimumBasicScenario-827702894 None] Created volume successfully. Sep 15 16:26:38 devstack sudo[98789]: pam_unix(sudo:session): session closed for user root Sep 15 16:26:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c886b309-debb-4cc9-9f8b-3c3c172438fd tempest-VolumesSnapshotListTestJSON-187697852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-bba19694-1e59-4fa8-a71e-7d8401ffe5e7.bb61c464-a547-494d-9d2b-0be0330ac667" returned: 0 in 0.411s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:26:38 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c886b309-debb-4cc9-9f8b-3c3c172438fd tempest-VolumesSnapshotListTestJSON-187697852 None] Lock "cinder-quobyte-bb61c464-a547-494d-9d2b-0be0330ac667" released by "_delete_snapshot" :: held 2.612s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:26:38 devstack sudo[98797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6e4cc28d-6520-4b1d-b5ce-80b6f59c161b Sep 15 16:26:38 devstack sudo[98797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:26:38 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c886b309-debb-4cc9-9f8b-3c3c172438fd tempest-VolumesSnapshotListTestJSON-187697852 None] Lock "cinder-quobyte-bba19694-1e59-4fa8-a71e-7d8401ffe5e7" released by "delete_snapshot" :: held 2.676s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:26:38 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-c886b309-debb-4cc9-9f8b-3c3c172438fd tempest-VolumesSnapshotListTestJSON-187697852 None] Created reservations ['56b829ce-ce46-4ea9-aeea-1afe9a5324cb', '82a9da36-b70d-4e34-a2bf-99babc84671e', 'a804662d-6713-4d92-a6ba-5f5697dd0f9e', 'fd483352-5e43-46be-825f-7970ad0a90c9'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:26:38 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-c886b309-debb-4cc9-9f8b-3c3c172438fd tempest-VolumesSnapshotListTestJSON-187697852 None] Delete snapshot completed successfully. Sep 15 16:26:38 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c886b309-debb-4cc9-9f8b-3c3c172438fd tempest-VolumesSnapshotListTestJSON-187697852 None] Lock "cinder-bb61c464-a547-494d-9d2b-0be0330ac667-delete_snapshot" released by "delete_snapshot" :: held 2.903s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:26:38 devstack sudo[98794]: pam_unix(sudo:session): session closed for user root Sep 15 16:26:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d02300b0-9a21-45e2-a83b-e897c2ef0776 tempest-VolumesTransfersTest-2116109669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-e7e59783-911d-48fd-b0cc-2dd40c7e419a 1073741824" returned: 0 in 0.698s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:26:38 devstack sudo[98797]: pam_unix(sudo:session): session closed for user root Sep 15 16:26:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-62ed3877-f0be-49bd-bf35-fe2d2575cace tempest-GroupSnapshotsTest-280274705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6e4cc28d-6520-4b1d-b5ce-80b6f59c161b" returned: 0 in 0.583s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:26:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-62ed3877-f0be-49bd-bf35-fe2d2575cace tempest-GroupSnapshotsTest-280274705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6e4cc28d-6520-4b1d-b5ce-80b6f59c161b.208e8c56-fc87-42ef-b63b-a124ff809713 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:26:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d02300b0-9a21-45e2-a83b-e897c2ef0776 tempest-VolumesTransfersTest-2116109669 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-e7e59783-911d-48fd-b0cc-2dd40c7e419a {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:26:39 devstack sudo[98808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6e4cc28d-6520-4b1d-b5ce-80b6f59c161b.208e8c56-fc87-42ef-b63b-a124ff809713 Sep 15 16:26:39 devstack sudo[98808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:26:39 devstack sudo[98809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-e7e59783-911d-48fd-b0cc-2dd40c7e419a Sep 15 16:26:39 devstack sudo[98809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:26:39 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-b434f1ec-16c9-418e-a8ee-564562ef3bc0 tempest-VolumesSnapshotListTestJSON-187697852 None] Acquiring lock "cinder-2025e9c3-9cd3-4fbe-9924-d0a07cc6322f-delete_snapshot" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:26:39 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-b434f1ec-16c9-418e-a8ee-564562ef3bc0 tempest-VolumesSnapshotListTestJSON-187697852 None] Lock "cinder-2025e9c3-9cd3-4fbe-9924-d0a07cc6322f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:26:39 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-b434f1ec-16c9-418e-a8ee-564562ef3bc0 tempest-VolumesSnapshotListTestJSON-187697852 None] Acquiring lock "cinder-quobyte-bba19694-1e59-4fa8-a71e-7d8401ffe5e7" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:26:39 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-b434f1ec-16c9-418e-a8ee-564562ef3bc0 tempest-VolumesSnapshotListTestJSON-187697852 None] Lock "cinder-quobyte-bba19694-1e59-4fa8-a71e-7d8401ffe5e7" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:26:39 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-b434f1ec-16c9-418e-a8ee-564562ef3bc0 tempest-VolumesSnapshotListTestJSON-187697852 None] Acquiring lock "cinder-quobyte-2025e9c3-9cd3-4fbe-9924-d0a07cc6322f" by "_delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:26:39 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-b434f1ec-16c9-418e-a8ee-564562ef3bc0 tempest-VolumesSnapshotListTestJSON-187697852 None] Lock "cinder-quobyte-2025e9c3-9cd3-4fbe-9924-d0a07cc6322f" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:26:39 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-b434f1ec-16c9-418e-a8ee-564562ef3bc0 tempest-VolumesSnapshotListTestJSON-187697852 None] Deleting offline snapshot 2025e9c3-9cd3-4fbe-9924-d0a07cc6322f of volume bba19694-1e59-4fa8-a71e-7d8401ffe5e7 {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 15 16:26:39 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-b434f1ec-16c9-418e-a8ee-564562ef3bc0 tempest-VolumesSnapshotListTestJSON-187697852 None] snapshot_file for this snap is: volume-bba19694-1e59-4fa8-a71e-7d8401ffe5e7.2025e9c3-9cd3-4fbe-9924-d0a07cc6322f {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 15 16:26:39 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c0d7b02-a7eb-41cc-8360-2568b1d36ac5]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:26:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b434f1ec-16c9-418e-a8ee-564562ef3bc0 tempest-VolumesSnapshotListTestJSON-187697852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-bba19694-1e59-4fa8-a71e-7d8401ffe5e7.2025e9c3-9cd3-4fbe-9924-d0a07cc6322f {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:26:39 devstack sudo[98809]: pam_unix(sudo:session): session closed for user root Sep 15 16:26:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d02300b0-9a21-45e2-a83b-e897c2ef0776 tempest-VolumesTransfersTest-2116109669 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-e7e59783-911d-48fd-b0cc-2dd40c7e419a" returned: 0 in 0.489s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:26:39 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-d02300b0-9a21-45e2-a83b-e897c2ef0776 tempest-VolumesTransfersTest-2116109669 None] <== create_volume: return (1251ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:26:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-d02300b0-9a21-45e2-a83b-e897c2ef0776 tempest-VolumesTransfersTest-2116109669 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.254s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:26:39 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-d02300b0-9a21-45e2-a83b-e897c2ef0776 tempest-VolumesTransfersTest-2116109669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06363228-732e-4f9a-ab8b-a6c2c0b13597) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e7e59783-911d-48fd-b0cc-2dd40c7e419a', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:26:39 devstack sudo[98815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-bba19694-1e59-4fa8-a71e-7d8401ffe5e7.2025e9c3-9cd3-4fbe-9924-d0a07cc6322f Sep 15 16:26:39 devstack sudo[98815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:26:39 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-d02300b0-9a21-45e2-a83b-e897c2ef0776 tempest-VolumesTransfersTest-2116109669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37a12422-2be4-4f91-aa84-c1d8e150c635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:26:39 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-d02300b0-9a21-45e2-a83b-e897c2ef0776 tempest-VolumesTransfersTest-2116109669 None] Volume volume-e7e59783-911d-48fd-b0cc-2dd40c7e419a (e7e59783-911d-48fd-b0cc-2dd40c7e419a): created successfully Sep 15 16:26:39 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-d02300b0-9a21-45e2-a83b-e897c2ef0776 tempest-VolumesTransfersTest-2116109669 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37a12422-2be4-4f91-aa84-c1d8e150c635) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:26:39 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-d02300b0-9a21-45e2-a83b-e897c2ef0776 tempest-VolumesTransfersTest-2116109669 None] Flow 'volume_create_manager' (9637c12d-5f13-4bca-a23f-355bc87e521d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:26:39 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-d02300b0-9a21-45e2-a83b-e897c2ef0776 tempest-VolumesTransfersTest-2116109669 None] Created volume successfully. Sep 15 16:26:39 devstack sudo[98808]: pam_unix(sudo:session): session closed for user root Sep 15 16:26:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-62ed3877-f0be-49bd-bf35-fe2d2575cace tempest-GroupSnapshotsTest-280274705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6e4cc28d-6520-4b1d-b5ce-80b6f59c161b.208e8c56-fc87-42ef-b63b-a124ff809713" returned: 0 in 0.668s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:26:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-62ed3877-f0be-49bd-bf35-fe2d2575cace tempest-GroupSnapshotsTest-280274705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6e4cc28d-6520-4b1d-b5ce-80b6f59c161b.208e8c56-fc87-42ef-b63b-a124ff809713 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:26:39 devstack sudo[98821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6e4cc28d-6520-4b1d-b5ce-80b6f59c161b.208e8c56-fc87-42ef-b63b-a124ff809713 Sep 15 16:26:39 devstack sudo[98821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:26:39 devstack sudo[98815]: pam_unix(sudo:session): session closed for user root Sep 15 16:26:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b434f1ec-16c9-418e-a8ee-564562ef3bc0 tempest-VolumesSnapshotListTestJSON-187697852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-bba19694-1e59-4fa8-a71e-7d8401ffe5e7.2025e9c3-9cd3-4fbe-9924-d0a07cc6322f" returned: 0 in 0.587s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:26:39 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-b434f1ec-16c9-418e-a8ee-564562ef3bc0 tempest-VolumesSnapshotListTestJSON-187697852 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bba19694-1e59-4fa8-a71e-7d8401ffe5e7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 16:26:39 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[e01bf5f9-5a34-448f-ab0c-af66065ff691]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:26:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b434f1ec-16c9-418e-a8ee-564562ef3bc0 tempest-VolumesSnapshotListTestJSON-187697852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-bba19694-1e59-4fa8-a71e-7d8401ffe5e7.294a89fc-e6a6-437b-8313-b59ae552683f {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:26:40 devstack sudo[98821]: pam_unix(sudo:session): session closed for user root Sep 15 16:26:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-62ed3877-f0be-49bd-bf35-fe2d2575cace tempest-GroupSnapshotsTest-280274705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6e4cc28d-6520-4b1d-b5ce-80b6f59c161b.208e8c56-fc87-42ef-b63b-a124ff809713" returned: 0 in 0.364s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:26:40 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-62ed3877-f0be-49bd-bf35-fe2d2575cace tempest-GroupSnapshotsTest-280274705 None] Lock "cinder-quobyte-208e8c56-fc87-42ef-b63b-a124ff809713" released by "_delete_snapshot" :: held 2.254s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:26:40 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-62ed3877-f0be-49bd-bf35-fe2d2575cace tempest-GroupSnapshotsTest-280274705 None] Lock "cinder-quobyte-6e4cc28d-6520-4b1d-b5ce-80b6f59c161b" released by "delete_snapshot" :: held 2.297s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:26:40 devstack sudo[98835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-bba19694-1e59-4fa8-a71e-7d8401ffe5e7.294a89fc-e6a6-437b-8313-b59ae552683f Sep 15 16:26:40 devstack sudo[98835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:26:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-39bf696d-c0cd-4a5f-942c-b49b2ce016a2 req-e401c5e6-3474-48fd-b185-9ee0a5c84c1d tempest-TestMinimumBasicScenario-827702894 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:26:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-39bf696d-c0cd-4a5f-942c-b49b2ce016a2 req-e401c5e6-3474-48fd-b185-9ee0a5c84c1d tempest-TestMinimumBasicScenario-827702894 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:26:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-39bf696d-c0cd-4a5f-942c-b49b2ce016a2 req-e401c5e6-3474-48fd-b185-9ee0a5c84c1d tempest-TestMinimumBasicScenario-827702894 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:26:40 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-39bf696d-c0cd-4a5f-942c-b49b2ce016a2 req-e401c5e6-3474-48fd-b185-9ee0a5c84c1d tempest-TestMinimumBasicScenario-827702894 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a', 'name': 'volume-cb3b13af-515b-4eda-a1da-df74c7149aa9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '77022391-103f-4a4b-a0e5-77dfdf352fe1', 'enforce_multipath': True} {{(pid=86082) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 15 16:26:40 devstack cinder-volume[86082]: WARNING cinder.quota [None req-62ed3877-f0be-49bd-bf35-fe2d2575cace tempest-GroupSnapshotsTest-280274705 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-861936603 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-861936603, it is now deprecated. Please use the default quota class for default quota. Sep 15 16:26:40 devstack cinder-volume[86082]: WARNING cinder.quota [None req-62ed3877-f0be-49bd-bf35-fe2d2575cace tempest-GroupSnapshotsTest-280274705 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-861936603 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-861936603, it is now deprecated. Please use the default quota class for default quota. Sep 15 16:26:40 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-62ed3877-f0be-49bd-bf35-fe2d2575cace tempest-GroupSnapshotsTest-280274705 None] Created reservations ['92064845-1c0a-4a60-9697-2e7585025dbc', 'd7c3240e-7420-4cff-9b10-2e8610db336f', '47ac1f46-4699-493c-ab43-56d1d1e88c75', '7ca8898b-e229-4a57-a259-fcc348d5ecc9'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:26:40 devstack cinder-volume[86082]: INFO cinder.volume.manager [req-39bf696d-c0cd-4a5f-942c-b49b2ce016a2 req-e401c5e6-3474-48fd-b185-9ee0a5c84c1d tempest-TestMinimumBasicScenario-827702894 None] attachment_update completed successfully. Sep 15 16:26:40 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-62ed3877-f0be-49bd-bf35-fe2d2575cace tempest-GroupSnapshotsTest-280274705 None] group_snapshot 2ce73290-d58a-4f9b-af7b-18d20c088f0c: deleted successfully Sep 15 16:26:40 devstack sudo[98835]: pam_unix(sudo:session): session closed for user root Sep 15 16:26:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b434f1ec-16c9-418e-a8ee-564562ef3bc0 tempest-VolumesSnapshotListTestJSON-187697852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-bba19694-1e59-4fa8-a71e-7d8401ffe5e7.294a89fc-e6a6-437b-8313-b59ae552683f" returned: 0 in 0.466s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:26:40 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-b434f1ec-16c9-418e-a8ee-564562ef3bc0 tempest-VolumesSnapshotListTestJSON-187697852 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bba19694-1e59-4fa8-a71e-7d8401ffe5e7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 16:26:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b434f1ec-16c9-418e-a8ee-564562ef3bc0 tempest-VolumesSnapshotListTestJSON-187697852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-bba19694-1e59-4fa8-a71e-7d8401ffe5e7.2025e9c3-9cd3-4fbe-9924-d0a07cc6322f {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:26:40 devstack sudo[98845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-bba19694-1e59-4fa8-a71e-7d8401ffe5e7.2025e9c3-9cd3-4fbe-9924-d0a07cc6322f Sep 15 16:26:40 devstack sudo[98845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:26:40 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-1612fbf4-8b76-491d-8aef-60eb4cdad060 tempest-VolumesTransfersTest-415430234 None] Acquiring lock "cinder-e7e59783-911d-48fd-b0cc-2dd40c7e419a-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:26:40 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-1612fbf4-8b76-491d-8aef-60eb4cdad060 tempest-VolumesTransfersTest-415430234 None] Lock "cinder-e7e59783-911d-48fd-b0cc-2dd40c7e419a-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:26:41 devstack sudo[98845]: pam_unix(sudo:session): session closed for user root Sep 15 16:26:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b434f1ec-16c9-418e-a8ee-564562ef3bc0 tempest-VolumesSnapshotListTestJSON-187697852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-bba19694-1e59-4fa8-a71e-7d8401ffe5e7.2025e9c3-9cd3-4fbe-9924-d0a07cc6322f" returned: 0 in 0.584s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:26:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b434f1ec-16c9-418e-a8ee-564562ef3bc0 tempest-VolumesSnapshotListTestJSON-187697852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-bba19694-1e59-4fa8-a71e-7d8401ffe5e7.2025e9c3-9cd3-4fbe-9924-d0a07cc6322f {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:26:41 devstack sudo[99258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-bba19694-1e59-4fa8-a71e-7d8401ffe5e7.2025e9c3-9cd3-4fbe-9924-d0a07cc6322f Sep 15 16:26:41 devstack sudo[99258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:26:41 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-1612fbf4-8b76-491d-8aef-60eb4cdad060 tempest-VolumesTransfersTest-415430234 None] Acquiring lock "cinder-quobyte-e7e59783-911d-48fd-b0cc-2dd40c7e419a" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:26:41 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-1612fbf4-8b76-491d-8aef-60eb4cdad060 tempest-VolumesTransfersTest-415430234 None] Lock "cinder-quobyte-e7e59783-911d-48fd-b0cc-2dd40c7e419a" acquired by "delete_volume" :: waited 0.043s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:26:41 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[6796bb0f-5dd8-4418-821d-b5428588e905]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:26:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-1612fbf4-8b76-491d-8aef-60eb4cdad060 tempest-VolumesTransfersTest-415430234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-e7e59783-911d-48fd-b0cc-2dd40c7e419a {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:26:41 devstack sudo[99260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-e7e59783-911d-48fd-b0cc-2dd40c7e419a Sep 15 16:26:41 devstack sudo[99260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:26:41 devstack sudo[99258]: pam_unix(sudo:session): session closed for user root Sep 15 16:26:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b434f1ec-16c9-418e-a8ee-564562ef3bc0 tempest-VolumesSnapshotListTestJSON-187697852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-bba19694-1e59-4fa8-a71e-7d8401ffe5e7.2025e9c3-9cd3-4fbe-9924-d0a07cc6322f" returned: 0 in 0.484s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:26:41 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-b434f1ec-16c9-418e-a8ee-564562ef3bc0 tempest-VolumesSnapshotListTestJSON-187697852 None] Lock "cinder-quobyte-2025e9c3-9cd3-4fbe-9924-d0a07cc6322f" released by "_delete_snapshot" :: held 2.304s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:26:41 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-b434f1ec-16c9-418e-a8ee-564562ef3bc0 tempest-VolumesSnapshotListTestJSON-187697852 None] Lock "cinder-quobyte-bba19694-1e59-4fa8-a71e-7d8401ffe5e7" released by "delete_snapshot" :: held 2.358s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:26:41 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-57fcc737-314c-4984-8bc0-f2449553f4c8 tempest-GroupSnapshotsTest-280274705 None] Acquiring lock "cinder-quobyte-6e4cc28d-6520-4b1d-b5ce-80b6f59c161b" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:26:41 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-57fcc737-314c-4984-8bc0-f2449553f4c8 tempest-GroupSnapshotsTest-280274705 None] Lock "cinder-quobyte-6e4cc28d-6520-4b1d-b5ce-80b6f59c161b" acquired by "delete_volume" :: waited 0.027s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:26:41 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0cba2e8-d384-4360-8a49-f6e3434f93de]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:26:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-57fcc737-314c-4984-8bc0-f2449553f4c8 tempest-GroupSnapshotsTest-280274705 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6e4cc28d-6520-4b1d-b5ce-80b6f59c161b {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:26:41 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-b434f1ec-16c9-418e-a8ee-564562ef3bc0 tempest-VolumesSnapshotListTestJSON-187697852 None] Created reservations ['058c639d-dd17-4b2d-8fa1-80529e7d7615', 'c627bcbe-3cd2-435a-ace4-bde128b32b02', '15492e13-b971-4a4b-bf03-ba335042565b', 'e12783b9-bdbc-4ec7-9bbd-2cc76ed3c750'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:26:41 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:UPDATE=169,cinder:SELECT=155,cinder:INSERT=42,cinder:DELETE=7 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 16:26:41 devstack sudo[99260]: pam_unix(sudo:session): session closed for user root Sep 15 16:26:41 devstack sudo[99263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6e4cc28d-6520-4b1d-b5ce-80b6f59c161b Sep 15 16:26:41 devstack sudo[99263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:26:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-1612fbf4-8b76-491d-8aef-60eb4cdad060 tempest-VolumesTransfersTest-415430234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-e7e59783-911d-48fd-b0cc-2dd40c7e419a" returned: 0 in 0.754s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:26:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-1612fbf4-8b76-491d-8aef-60eb4cdad060 tempest-VolumesTransfersTest-415430234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-e7e59783-911d-48fd-b0cc-2dd40c7e419a {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:26:41 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-b434f1ec-16c9-418e-a8ee-564562ef3bc0 tempest-VolumesSnapshotListTestJSON-187697852 None] Delete snapshot completed successfully. Sep 15 16:26:41 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-b434f1ec-16c9-418e-a8ee-564562ef3bc0 tempest-VolumesSnapshotListTestJSON-187697852 None] Lock "cinder-2025e9c3-9cd3-4fbe-9924-d0a07cc6322f-delete_snapshot" released by "delete_snapshot" :: held 2.811s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:26:41 devstack sudo[99269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-e7e59783-911d-48fd-b0cc-2dd40c7e419a Sep 15 16:26:41 devstack sudo[99269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:26:42 devstack sudo[99269]: pam_unix(sudo:session): session closed for user root Sep 15 16:26:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-1612fbf4-8b76-491d-8aef-60eb4cdad060 tempest-VolumesTransfersTest-415430234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-e7e59783-911d-48fd-b0cc-2dd40c7e419a" returned: 0 in 0.329s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:26:42 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-1612fbf4-8b76-491d-8aef-60eb4cdad060 tempest-VolumesTransfersTest-415430234 None] Lock "cinder-quobyte-e7e59783-911d-48fd-b0cc-2dd40c7e419a" released by "delete_volume" :: held 1.183s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:26:42 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-1612fbf4-8b76-491d-8aef-60eb4cdad060 tempest-VolumesTransfersTest-415430234 None] Created reservations ['0520341f-73ca-4004-8f36-06c01fb82ea8', 'e1c81b77-3c69-4725-aa34-47afbbacd3cd', '7b6c010b-ab33-41da-a254-1725d2e88742', '8dc08af7-a811-4903-a1f1-639e7d3bd849'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:26:42 devstack sudo[99263]: pam_unix(sudo:session): session closed for user root Sep 15 16:26:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-57fcc737-314c-4984-8bc0-f2449553f4c8 tempest-GroupSnapshotsTest-280274705 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6e4cc28d-6520-4b1d-b5ce-80b6f59c161b" returned: 0 in 0.698s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:26:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-57fcc737-314c-4984-8bc0-f2449553f4c8 tempest-GroupSnapshotsTest-280274705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6e4cc28d-6520-4b1d-b5ce-80b6f59c161b {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:26:42 devstack sudo[99282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6e4cc28d-6520-4b1d-b5ce-80b6f59c161b Sep 15 16:26:42 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-0275803c-3cd4-48c2-bf10-96426b91d4c8 tempest-VolumesSnapshotListTestJSON-187697852 None] Acquiring lock "cinder-294a89fc-e6a6-437b-8313-b59ae552683f-delete_snapshot" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:26:42 devstack sudo[99282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:26:42 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-0275803c-3cd4-48c2-bf10-96426b91d4c8 tempest-VolumesSnapshotListTestJSON-187697852 None] Lock "cinder-294a89fc-e6a6-437b-8313-b59ae552683f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.049s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:26:42 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-0275803c-3cd4-48c2-bf10-96426b91d4c8 tempest-VolumesSnapshotListTestJSON-187697852 None] Acquiring lock "cinder-quobyte-bba19694-1e59-4fa8-a71e-7d8401ffe5e7" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:26:42 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-0275803c-3cd4-48c2-bf10-96426b91d4c8 tempest-VolumesSnapshotListTestJSON-187697852 None] Lock "cinder-quobyte-bba19694-1e59-4fa8-a71e-7d8401ffe5e7" acquired by "delete_snapshot" :: waited 0.055s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:26:42 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-0275803c-3cd4-48c2-bf10-96426b91d4c8 tempest-VolumesSnapshotListTestJSON-187697852 None] Acquiring lock "cinder-quobyte-294a89fc-e6a6-437b-8313-b59ae552683f" by "_delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:26:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-1612fbf4-8b76-491d-8aef-60eb4cdad060 tempest-VolumesTransfersTest-415430234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:26:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-1612fbf4-8b76-491d-8aef-60eb4cdad060 tempest-VolumesTransfersTest-415430234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:26:42 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-1612fbf4-8b76-491d-8aef-60eb4cdad060 tempest-VolumesTransfersTest-415430234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:26:42 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-1612fbf4-8b76-491d-8aef-60eb4cdad060 tempest-VolumesTransfersTest-415430234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:26:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-1612fbf4-8b76-491d-8aef-60eb4cdad060 tempest-VolumesTransfersTest-415430234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:26:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-1612fbf4-8b76-491d-8aef-60eb4cdad060 tempest-VolumesTransfersTest-415430234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:26:42 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-0275803c-3cd4-48c2-bf10-96426b91d4c8 tempest-VolumesSnapshotListTestJSON-187697852 None] Lock "cinder-quobyte-294a89fc-e6a6-437b-8313-b59ae552683f" acquired by "_delete_snapshot" :: waited 0.065s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:26:42 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-0275803c-3cd4-48c2-bf10-96426b91d4c8 tempest-VolumesSnapshotListTestJSON-187697852 None] Deleting offline snapshot 294a89fc-e6a6-437b-8313-b59ae552683f of volume bba19694-1e59-4fa8-a71e-7d8401ffe5e7 {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 15 16:26:42 devstack sudo[99288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:26:42 devstack sudo[99288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:26:42 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-0275803c-3cd4-48c2-bf10-96426b91d4c8 tempest-VolumesSnapshotListTestJSON-187697852 None] snapshot_file for this snap is: volume-bba19694-1e59-4fa8-a71e-7d8401ffe5e7.294a89fc-e6a6-437b-8313-b59ae552683f {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 15 16:26:42 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[82326dfc-2c5a-4b8c-9677-a09b0b177479]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:26:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0275803c-3cd4-48c2-bf10-96426b91d4c8 tempest-VolumesSnapshotListTestJSON-187697852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-bba19694-1e59-4fa8-a71e-7d8401ffe5e7.294a89fc-e6a6-437b-8313-b59ae552683f {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:26:42 devstack sudo[99290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-bba19694-1e59-4fa8-a71e-7d8401ffe5e7.294a89fc-e6a6-437b-8313-b59ae552683f Sep 15 16:26:42 devstack sudo[99290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:26:43 devstack sudo[99288]: pam_unix(sudo:session): session closed for user root Sep 15 16:26:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-1612fbf4-8b76-491d-8aef-60eb4cdad060 tempest-VolumesTransfersTest-415430234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.456s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:26:43 devstack sudo[99282]: pam_unix(sudo:session): session closed for user root Sep 15 16:26:43 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-1612fbf4-8b76-491d-8aef-60eb4cdad060 tempest-VolumesTransfersTest-415430234 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:26:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-57fcc737-314c-4984-8bc0-f2449553f4c8 tempest-GroupSnapshotsTest-280274705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6e4cc28d-6520-4b1d-b5ce-80b6f59c161b" returned: 0 in 0.649s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:26:43 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-1612fbf4-8b76-491d-8aef-60eb4cdad060 tempest-VolumesTransfersTest-415430234 None] Deleted volume successfully. Sep 15 16:26:43 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-57fcc737-314c-4984-8bc0-f2449553f4c8 tempest-GroupSnapshotsTest-280274705 None] Lock "cinder-quobyte-6e4cc28d-6520-4b1d-b5ce-80b6f59c161b" released by "delete_volume" :: held 1.449s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:26:43 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-1612fbf4-8b76-491d-8aef-60eb4cdad060 tempest-VolumesTransfersTest-415430234 None] Lock "cinder-e7e59783-911d-48fd-b0cc-2dd40c7e419a-delete_volume" released by "delete_volume" :: held 2.216s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:26:43 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-57fcc737-314c-4984-8bc0-f2449553f4c8 tempest-GroupSnapshotsTest-280274705 None] Created reservations ['e8f21f1c-e92b-46ca-b950-bfc48b4b9185'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:26:43 devstack cinder-volume[86082]: WARNING cinder.quota [None req-57fcc737-314c-4984-8bc0-f2449553f4c8 tempest-GroupSnapshotsTest-280274705 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-861936603 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-861936603, it is now deprecated. Please use the default quota class for default quota. Sep 15 16:26:43 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-57fcc737-314c-4984-8bc0-f2449553f4c8 tempest-GroupSnapshotsTest-280274705 None] Created reservations ['3f06207a-0b7a-48f7-893e-3234d4785685', '6b8f9ed8-3a91-47ed-bd33-0b43b99d4246', '8c163e94-fc70-4979-a760-f1ffc1b2a0b2', '7d186da5-eb8e-4986-abd6-8093a024b95b'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:26:43 devstack sudo[99290]: pam_unix(sudo:session): session closed for user root Sep 15 16:26:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0275803c-3cd4-48c2-bf10-96426b91d4c8 tempest-VolumesSnapshotListTestJSON-187697852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-bba19694-1e59-4fa8-a71e-7d8401ffe5e7.294a89fc-e6a6-437b-8313-b59ae552683f" returned: 0 in 0.736s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:26:43 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-0275803c-3cd4-48c2-bf10-96426b91d4c8 tempest-VolumesSnapshotListTestJSON-187697852 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bba19694-1e59-4fa8-a71e-7d8401ffe5e7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 16:26:43 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c4a12b9-5919-43ec-a96b-da665c87aca8]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:26:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0275803c-3cd4-48c2-bf10-96426b91d4c8 tempest-VolumesSnapshotListTestJSON-187697852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-bba19694-1e59-4fa8-a71e-7d8401ffe5e7 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:26:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-57fcc737-314c-4984-8bc0-f2449553f4c8 tempest-GroupSnapshotsTest-280274705 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:26:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-57fcc737-314c-4984-8bc0-f2449553f4c8 tempest-GroupSnapshotsTest-280274705 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:26:43 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-57fcc737-314c-4984-8bc0-f2449553f4c8 tempest-GroupSnapshotsTest-280274705 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:26:43 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-57fcc737-314c-4984-8bc0-f2449553f4c8 tempest-GroupSnapshotsTest-280274705 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:26:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-57fcc737-314c-4984-8bc0-f2449553f4c8 tempest-GroupSnapshotsTest-280274705 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:26:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-57fcc737-314c-4984-8bc0-f2449553f4c8 tempest-GroupSnapshotsTest-280274705 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:26:43 devstack sudo[99300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:26:43 devstack sudo[99300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:26:43 devstack sudo[99299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-bba19694-1e59-4fa8-a71e-7d8401ffe5e7 Sep 15 16:26:43 devstack sudo[99299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:26:44 devstack sudo[99300]: pam_unix(sudo:session): session closed for user root Sep 15 16:26:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-57fcc737-314c-4984-8bc0-f2449553f4c8 tempest-GroupSnapshotsTest-280274705 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.323s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:26:44 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-57fcc737-314c-4984-8bc0-f2449553f4c8 tempest-GroupSnapshotsTest-280274705 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:26:44 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-57fcc737-314c-4984-8bc0-f2449553f4c8 tempest-GroupSnapshotsTest-280274705 None] Delete group completed successfully. Sep 15 16:26:44 devstack sudo[99299]: pam_unix(sudo:session): session closed for user root Sep 15 16:26:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0275803c-3cd4-48c2-bf10-96426b91d4c8 tempest-VolumesSnapshotListTestJSON-187697852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-bba19694-1e59-4fa8-a71e-7d8401ffe5e7" returned: 0 in 0.624s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:26:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0275803c-3cd4-48c2-bf10-96426b91d4c8 tempest-VolumesSnapshotListTestJSON-187697852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-bba19694-1e59-4fa8-a71e-7d8401ffe5e7.294a89fc-e6a6-437b-8313-b59ae552683f {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:26:44 devstack sudo[99308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-bba19694-1e59-4fa8-a71e-7d8401ffe5e7.294a89fc-e6a6-437b-8313-b59ae552683f Sep 15 16:26:44 devstack sudo[99308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:26:44 devstack sudo[99308]: pam_unix(sudo:session): session closed for user root Sep 15 16:26:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0275803c-3cd4-48c2-bf10-96426b91d4c8 tempest-VolumesSnapshotListTestJSON-187697852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-bba19694-1e59-4fa8-a71e-7d8401ffe5e7.294a89fc-e6a6-437b-8313-b59ae552683f" returned: 0 in 0.625s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:26:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0275803c-3cd4-48c2-bf10-96426b91d4c8 tempest-VolumesSnapshotListTestJSON-187697852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-bba19694-1e59-4fa8-a71e-7d8401ffe5e7.294a89fc-e6a6-437b-8313-b59ae552683f {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:26:44 devstack sudo[99314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-bba19694-1e59-4fa8-a71e-7d8401ffe5e7.294a89fc-e6a6-437b-8313-b59ae552683f Sep 15 16:26:44 devstack sudo[99314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:26:45 devstack sudo[99314]: pam_unix(sudo:session): session closed for user root Sep 15 16:26:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0275803c-3cd4-48c2-bf10-96426b91d4c8 tempest-VolumesSnapshotListTestJSON-187697852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-bba19694-1e59-4fa8-a71e-7d8401ffe5e7.294a89fc-e6a6-437b-8313-b59ae552683f" returned: 0 in 0.374s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:26:45 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:SELECT=185,cinder:UPDATE=179,cinder:INSERT=45,cinder:DELETE=11 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 16:26:45 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-0275803c-3cd4-48c2-bf10-96426b91d4c8 tempest-VolumesSnapshotListTestJSON-187697852 None] Lock "cinder-quobyte-294a89fc-e6a6-437b-8313-b59ae552683f" released by "_delete_snapshot" :: held 2.580s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:26:45 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-0275803c-3cd4-48c2-bf10-96426b91d4c8 tempest-VolumesSnapshotListTestJSON-187697852 None] Lock "cinder-quobyte-bba19694-1e59-4fa8-a71e-7d8401ffe5e7" released by "delete_snapshot" :: held 2.662s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:26:45 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-0275803c-3cd4-48c2-bf10-96426b91d4c8 tempest-VolumesSnapshotListTestJSON-187697852 None] Created reservations ['930e26c4-fb12-4a40-b335-8bd877b8c093', 'dcae8057-a1d4-44eb-9adb-28baa8eaff44', 'ecaa6118-fafa-47a3-be7e-abe620237e61', '4ae37b65-ac7e-4851-b69a-4042cbfd592d'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:26:45 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-0275803c-3cd4-48c2-bf10-96426b91d4c8 tempest-VolumesSnapshotListTestJSON-187697852 None] Delete snapshot completed successfully. Sep 15 16:26:45 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-0275803c-3cd4-48c2-bf10-96426b91d4c8 tempest-VolumesSnapshotListTestJSON-187697852 None] Lock "cinder-294a89fc-e6a6-437b-8313-b59ae552683f-delete_snapshot" released by "delete_snapshot" :: held 2.895s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:26:45 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-29ee5d2a-a8ba-427e-a71a-c35c8008d9d2 tempest-VolumesSnapshotListTestJSON-187697852 None] Acquiring lock "cinder-bba19694-1e59-4fa8-a71e-7d8401ffe5e7-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:26:45 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-29ee5d2a-a8ba-427e-a71a-c35c8008d9d2 tempest-VolumesSnapshotListTestJSON-187697852 None] Lock "cinder-bba19694-1e59-4fa8-a71e-7d8401ffe5e7-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:26:46 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-29ee5d2a-a8ba-427e-a71a-c35c8008d9d2 tempest-VolumesSnapshotListTestJSON-187697852 None] Acquiring lock "cinder-quobyte-bba19694-1e59-4fa8-a71e-7d8401ffe5e7" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:26:46 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-29ee5d2a-a8ba-427e-a71a-c35c8008d9d2 tempest-VolumesSnapshotListTestJSON-187697852 None] Lock "cinder-quobyte-bba19694-1e59-4fa8-a71e-7d8401ffe5e7" acquired by "delete_volume" :: waited 0.034s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:26:46 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bb26bf5-4b04-4d5b-98ce-10725c7fb406]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:26:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-29ee5d2a-a8ba-427e-a71a-c35c8008d9d2 tempest-VolumesSnapshotListTestJSON-187697852 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-bba19694-1e59-4fa8-a71e-7d8401ffe5e7 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:26:46 devstack sudo[99339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-bba19694-1e59-4fa8-a71e-7d8401ffe5e7 Sep 15 16:26:46 devstack sudo[99339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:26:46 devstack sudo[99339]: pam_unix(sudo:session): session closed for user root Sep 15 16:26:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-29ee5d2a-a8ba-427e-a71a-c35c8008d9d2 tempest-VolumesSnapshotListTestJSON-187697852 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-bba19694-1e59-4fa8-a71e-7d8401ffe5e7" returned: 0 in 0.542s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:26:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-29ee5d2a-a8ba-427e-a71a-c35c8008d9d2 tempest-VolumesSnapshotListTestJSON-187697852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-bba19694-1e59-4fa8-a71e-7d8401ffe5e7 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:26:46 devstack sudo[99348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-bba19694-1e59-4fa8-a71e-7d8401ffe5e7 Sep 15 16:26:46 devstack sudo[99348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:26:47 devstack sudo[99348]: pam_unix(sudo:session): session closed for user root Sep 15 16:26:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-29ee5d2a-a8ba-427e-a71a-c35c8008d9d2 tempest-VolumesSnapshotListTestJSON-187697852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-bba19694-1e59-4fa8-a71e-7d8401ffe5e7" returned: 0 in 0.304s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:26:47 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-29ee5d2a-a8ba-427e-a71a-c35c8008d9d2 tempest-VolumesSnapshotListTestJSON-187697852 None] Lock "cinder-quobyte-bba19694-1e59-4fa8-a71e-7d8401ffe5e7" released by "delete_volume" :: held 0.951s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:26:47 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-29ee5d2a-a8ba-427e-a71a-c35c8008d9d2 tempest-VolumesSnapshotListTestJSON-187697852 None] Created reservations ['43398437-fc33-4c99-88a2-8e5f823005c2', 'f6011dfd-eb52-49cb-98fd-e5de9845e141', '0c8ff93b-a6e9-4052-b8a9-33fd04ca6a02', 'c3539fee-e751-4514-ad73-1c15e89763e6'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:26:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-29ee5d2a-a8ba-427e-a71a-c35c8008d9d2 tempest-VolumesSnapshotListTestJSON-187697852 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:26:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-29ee5d2a-a8ba-427e-a71a-c35c8008d9d2 tempest-VolumesSnapshotListTestJSON-187697852 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:26:47 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-29ee5d2a-a8ba-427e-a71a-c35c8008d9d2 tempest-VolumesSnapshotListTestJSON-187697852 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:26:47 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-29ee5d2a-a8ba-427e-a71a-c35c8008d9d2 tempest-VolumesSnapshotListTestJSON-187697852 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:26:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-29ee5d2a-a8ba-427e-a71a-c35c8008d9d2 tempest-VolumesSnapshotListTestJSON-187697852 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:26:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-29ee5d2a-a8ba-427e-a71a-c35c8008d9d2 tempest-VolumesSnapshotListTestJSON-187697852 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:26:47 devstack sudo[99352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:26:47 devstack sudo[99352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:26:47 devstack sudo[99352]: pam_unix(sudo:session): session closed for user root Sep 15 16:26:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-29ee5d2a-a8ba-427e-a71a-c35c8008d9d2 tempest-VolumesSnapshotListTestJSON-187697852 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.348s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:26:47 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-29ee5d2a-a8ba-427e-a71a-c35c8008d9d2 tempest-VolumesSnapshotListTestJSON-187697852 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:26:47 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-29ee5d2a-a8ba-427e-a71a-c35c8008d9d2 tempest-VolumesSnapshotListTestJSON-187697852 None] Deleted volume successfully. Sep 15 16:26:47 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-29ee5d2a-a8ba-427e-a71a-c35c8008d9d2 tempest-VolumesSnapshotListTestJSON-187697852 None] Lock "cinder-bba19694-1e59-4fa8-a71e-7d8401ffe5e7-delete_volume" released by "delete_volume" :: held 1.674s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:26:55 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-e984f8b2-fa30-4c9d-b862-fa1e748e1302 tempest-VolumesCloneTest-909425693 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:26:55 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e984f8b2-fa30-4c9d-b862-fa1e748e1302 tempest-VolumesCloneTest-909425693 None] Flow 'volume_create_manager' (dc5c8ec8-4420-4244-877f-6d136109afc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:26:55 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e984f8b2-fa30-4c9d-b862-fa1e748e1302 tempest-VolumesCloneTest-909425693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36c3a410-7ca1-4862-8be2-8e26c998d593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:26:55 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e984f8b2-fa30-4c9d-b862-fa1e748e1302 tempest-VolumesCloneTest-909425693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36c3a410-7ca1-4862-8be2-8e26c998d593) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:26:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2003002905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b8514ad-1601-45c9-91b8-2f5158ff9422,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60f31f74f55144f4aa840c371609a012',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:26:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:26:55Z,use_quota=True,user_id='78ee6821ead947dd894d29b912f0b075',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:26:55 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e984f8b2-fa30-4c9d-b862-fa1e748e1302 tempest-VolumesCloneTest-909425693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (830b511a-cc1b-4eb3-a8d7-bea4797c9f60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:26:55 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e984f8b2-fa30-4c9d-b862-fa1e748e1302 tempest-VolumesCloneTest-909425693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (830b511a-cc1b-4eb3-a8d7-bea4797c9f60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:26:55 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e984f8b2-fa30-4c9d-b862-fa1e748e1302 tempest-VolumesCloneTest-909425693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c7ea071-5f9d-45cb-a36d-d653b0776f9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:26:55 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e984f8b2-fa30-4c9d-b862-fa1e748e1302 tempest-VolumesCloneTest-909425693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c7ea071-5f9d-45cb-a36d-d653b0776f9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b8514ad-1601-45c9-91b8-2f5158ff9422', 'volume_name': 'volume-1b8514ad-1601-45c9-91b8-2f5158ff9422', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:26:55 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e984f8b2-fa30-4c9d-b862-fa1e748e1302 tempest-VolumesCloneTest-909425693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (285fe855-1a6b-4d2f-a3b1-0b15af6d32f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:26:55 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e984f8b2-fa30-4c9d-b862-fa1e748e1302 tempest-VolumesCloneTest-909425693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (285fe855-1a6b-4d2f-a3b1-0b15af6d32f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:26:55 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e984f8b2-fa30-4c9d-b862-fa1e748e1302 tempest-VolumesCloneTest-909425693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2155a59d-ae27-4794-80b7-2afa7bfcd1c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:26:55 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-e984f8b2-fa30-4c9d-b862-fa1e748e1302 tempest-VolumesCloneTest-909425693 None] Volume 1b8514ad-1601-45c9-91b8-2f5158ff9422: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b8514ad-1601-45c9-91b8-2f5158ff9422', 'volume_size': 1} Sep 15 16:26:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-e984f8b2-fa30-4c9d-b862-fa1e748e1302 tempest-VolumesCloneTest-909425693 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:26:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-e984f8b2-fa30-4c9d-b862-fa1e748e1302 tempest-VolumesCloneTest-909425693 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:26:55 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-e984f8b2-fa30-4c9d-b862-fa1e748e1302 tempest-VolumesCloneTest-909425693 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:26:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-2003002905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b8514ad-1601-45c9-91b8-2f5158ff9422,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60f31f74f55144f4aa840c371609a012',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:26:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:26:55Z,use_quota=True,user_id='78ee6821ead947dd894d29b912f0b075',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:26:55 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-e984f8b2-fa30-4c9d-b862-fa1e748e1302 tempest-VolumesCloneTest-909425693 None] Creating volume 1b8514ad-1601-45c9-91b8-2f5158ff9422 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:26:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-e984f8b2-fa30-4c9d-b862-fa1e748e1302 tempest-VolumesCloneTest-909425693 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:26:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-e984f8b2-fa30-4c9d-b862-fa1e748e1302 tempest-VolumesCloneTest-909425693 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:26:55 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-e984f8b2-fa30-4c9d-b862-fa1e748e1302 tempest-VolumesCloneTest-909425693 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:26:55 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-e984f8b2-fa30-4c9d-b862-fa1e748e1302 tempest-VolumesCloneTest-909425693 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:26:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-e984f8b2-fa30-4c9d-b862-fa1e748e1302 tempest-VolumesCloneTest-909425693 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:26:55 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-e984f8b2-fa30-4c9d-b862-fa1e748e1302 tempest-VolumesCloneTest-909425693 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:26:55 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-e984f8b2-fa30-4c9d-b862-fa1e748e1302 tempest-VolumesCloneTest-909425693 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:26:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e984f8b2-fa30-4c9d-b862-fa1e748e1302 tempest-VolumesCloneTest-909425693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1b8514ad-1601-45c9-91b8-2f5158ff9422 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:26:55 devstack sudo[99356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1b8514ad-1601-45c9-91b8-2f5158ff9422 1073741824 Sep 15 16:26:55 devstack sudo[99356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:26:55 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-ebd47e19-96fd-46d2-96bd-9a38bd026edf tempest-VolumesSnapshotNegativeTestJSON-1774317281 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:26:55 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ebd47e19-96fd-46d2-96bd-9a38bd026edf tempest-VolumesSnapshotNegativeTestJSON-1774317281 None] Flow 'volume_create_manager' (0746a291-fb31-45a3-bc33-a636d78facf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:26:55 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ebd47e19-96fd-46d2-96bd-9a38bd026edf tempest-VolumesSnapshotNegativeTestJSON-1774317281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e9b551c-819b-407e-bcab-f24223883bc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:26:55 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ebd47e19-96fd-46d2-96bd-9a38bd026edf tempest-VolumesSnapshotNegativeTestJSON-1774317281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e9b551c-819b-407e-bcab-f24223883bc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:26:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1328089709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4441b0e0-e4a7-4322-b5da-9d936ee9a028,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b992aa1933b04dc78fef6a6e9da1b2f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:26:55Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:26:55Z,use_quota=True,user_id='19398dc50ea14d89afcb2a9ad1c34256',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:26:55 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ebd47e19-96fd-46d2-96bd-9a38bd026edf tempest-VolumesSnapshotNegativeTestJSON-1774317281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a3b49bb-3048-44fb-af8c-3c1a10e03ddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:26:55 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ebd47e19-96fd-46d2-96bd-9a38bd026edf tempest-VolumesSnapshotNegativeTestJSON-1774317281 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a3b49bb-3048-44fb-af8c-3c1a10e03ddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:26:55 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ebd47e19-96fd-46d2-96bd-9a38bd026edf tempest-VolumesSnapshotNegativeTestJSON-1774317281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff2f75c1-e925-4cbd-8deb-418498ec346e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:26:55 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ebd47e19-96fd-46d2-96bd-9a38bd026edf tempest-VolumesSnapshotNegativeTestJSON-1774317281 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff2f75c1-e925-4cbd-8deb-418498ec346e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4441b0e0-e4a7-4322-b5da-9d936ee9a028', 'volume_name': 'volume-4441b0e0-e4a7-4322-b5da-9d936ee9a028', 'volume_size': 2}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:26:55 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ebd47e19-96fd-46d2-96bd-9a38bd026edf tempest-VolumesSnapshotNegativeTestJSON-1774317281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35cbd4cd-d0ba-41db-be4f-f2eafecf6085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:26:55 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ebd47e19-96fd-46d2-96bd-9a38bd026edf tempest-VolumesSnapshotNegativeTestJSON-1774317281 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (35cbd4cd-d0ba-41db-be4f-f2eafecf6085) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:26:55 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ebd47e19-96fd-46d2-96bd-9a38bd026edf tempest-VolumesSnapshotNegativeTestJSON-1774317281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (107ab69d-b1d4-41bb-8323-552befd9edd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:26:55 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-ebd47e19-96fd-46d2-96bd-9a38bd026edf tempest-VolumesSnapshotNegativeTestJSON-1774317281 None] Volume 4441b0e0-e4a7-4322-b5da-9d936ee9a028: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4441b0e0-e4a7-4322-b5da-9d936ee9a028', 'volume_size': 2} Sep 15 16:26:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-ebd47e19-96fd-46d2-96bd-9a38bd026edf tempest-VolumesSnapshotNegativeTestJSON-1774317281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:26:55 devstack sudo[99356]: pam_unix(sudo:session): session closed for user root Sep 15 16:26:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e984f8b2-fa30-4c9d-b862-fa1e748e1302 tempest-VolumesCloneTest-909425693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1b8514ad-1601-45c9-91b8-2f5158ff9422 1073741824" returned: 0 in 0.575s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:26:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e984f8b2-fa30-4c9d-b862-fa1e748e1302 tempest-VolumesCloneTest-909425693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1b8514ad-1601-45c9-91b8-2f5158ff9422 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:26:55 devstack sudo[99362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1b8514ad-1601-45c9-91b8-2f5158ff9422 Sep 15 16:26:55 devstack sudo[99362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:26:56 devstack sudo[99362]: pam_unix(sudo:session): session closed for user root Sep 15 16:26:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e984f8b2-fa30-4c9d-b862-fa1e748e1302 tempest-VolumesCloneTest-909425693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1b8514ad-1601-45c9-91b8-2f5158ff9422" returned: 0 in 0.321s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:26:56 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-e984f8b2-fa30-4c9d-b862-fa1e748e1302 tempest-VolumesCloneTest-909425693 None] <== create_volume: return (942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:26:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-e984f8b2-fa30-4c9d-b862-fa1e748e1302 tempest-VolumesCloneTest-909425693 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.944s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:26:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-ebd47e19-96fd-46d2-96bd-9a38bd026edf tempest-VolumesSnapshotNegativeTestJSON-1774317281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.767s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:26:56 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-ebd47e19-96fd-46d2-96bd-9a38bd026edf tempest-VolumesSnapshotNegativeTestJSON-1774317281 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:26:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1328089709',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4441b0e0-e4a7-4322-b5da-9d936ee9a028,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b992aa1933b04dc78fef6a6e9da1b2f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:26:55Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:26:55Z,use_quota=True,user_id='19398dc50ea14d89afcb2a9ad1c34256',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:26:56 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-ebd47e19-96fd-46d2-96bd-9a38bd026edf tempest-VolumesSnapshotNegativeTestJSON-1774317281 None] Creating volume 4441b0e0-e4a7-4322-b5da-9d936ee9a028 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:26:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-ebd47e19-96fd-46d2-96bd-9a38bd026edf tempest-VolumesSnapshotNegativeTestJSON-1774317281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:26:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-ebd47e19-96fd-46d2-96bd-9a38bd026edf tempest-VolumesSnapshotNegativeTestJSON-1774317281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:26:56 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-ebd47e19-96fd-46d2-96bd-9a38bd026edf tempest-VolumesSnapshotNegativeTestJSON-1774317281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:26:56 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-ebd47e19-96fd-46d2-96bd-9a38bd026edf tempest-VolumesSnapshotNegativeTestJSON-1774317281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:26:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-ebd47e19-96fd-46d2-96bd-9a38bd026edf tempest-VolumesSnapshotNegativeTestJSON-1774317281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:26:56 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-ebd47e19-96fd-46d2-96bd-9a38bd026edf tempest-VolumesSnapshotNegativeTestJSON-1774317281 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:26:56 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-ebd47e19-96fd-46d2-96bd-9a38bd026edf tempest-VolumesSnapshotNegativeTestJSON-1774317281 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:26:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ebd47e19-96fd-46d2-96bd-9a38bd026edf tempest-VolumesSnapshotNegativeTestJSON-1774317281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-4441b0e0-e4a7-4322-b5da-9d936ee9a028 2147483648 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:26:56 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e984f8b2-fa30-4c9d-b862-fa1e748e1302 tempest-VolumesCloneTest-909425693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2155a59d-ae27-4794-80b7-2afa7bfcd1c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b8514ad-1601-45c9-91b8-2f5158ff9422', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:26:56 devstack sudo[99365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-4441b0e0-e4a7-4322-b5da-9d936ee9a028 2147483648 Sep 15 16:26:56 devstack sudo[99365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:26:56 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e984f8b2-fa30-4c9d-b862-fa1e748e1302 tempest-VolumesCloneTest-909425693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b3cf15f-990e-4404-8b5b-489d2e53157b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:26:56 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-e984f8b2-fa30-4c9d-b862-fa1e748e1302 tempest-VolumesCloneTest-909425693 None] Volume volume-1b8514ad-1601-45c9-91b8-2f5158ff9422 (1b8514ad-1601-45c9-91b8-2f5158ff9422): created successfully Sep 15 16:26:56 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e984f8b2-fa30-4c9d-b862-fa1e748e1302 tempest-VolumesCloneTest-909425693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b3cf15f-990e-4404-8b5b-489d2e53157b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:26:56 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e984f8b2-fa30-4c9d-b862-fa1e748e1302 tempest-VolumesCloneTest-909425693 None] Flow 'volume_create_manager' (dc5c8ec8-4420-4244-877f-6d136109afc6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:26:56 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-e984f8b2-fa30-4c9d-b862-fa1e748e1302 tempest-VolumesCloneTest-909425693 None] Created volume successfully. Sep 15 16:26:56 devstack sudo[99365]: pam_unix(sudo:session): session closed for user root Sep 15 16:26:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ebd47e19-96fd-46d2-96bd-9a38bd026edf tempest-VolumesSnapshotNegativeTestJSON-1774317281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-4441b0e0-e4a7-4322-b5da-9d936ee9a028 2147483648" returned: 0 in 0.651s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:26:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ebd47e19-96fd-46d2-96bd-9a38bd026edf tempest-VolumesSnapshotNegativeTestJSON-1774317281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-4441b0e0-e4a7-4322-b5da-9d936ee9a028 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:26:56 devstack sudo[99374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-4441b0e0-e4a7-4322-b5da-9d936ee9a028 Sep 15 16:26:56 devstack sudo[99374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:26:57 devstack sudo[99374]: pam_unix(sudo:session): session closed for user root Sep 15 16:26:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ebd47e19-96fd-46d2-96bd-9a38bd026edf tempest-VolumesSnapshotNegativeTestJSON-1774317281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-4441b0e0-e4a7-4322-b5da-9d936ee9a028" returned: 0 in 0.335s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:26:57 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-ebd47e19-96fd-46d2-96bd-9a38bd026edf tempest-VolumesSnapshotNegativeTestJSON-1774317281 None] <== create_volume: return (1032ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:26:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-ebd47e19-96fd-46d2-96bd-9a38bd026edf tempest-VolumesSnapshotNegativeTestJSON-1774317281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.034s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:26:57 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ebd47e19-96fd-46d2-96bd-9a38bd026edf tempest-VolumesSnapshotNegativeTestJSON-1774317281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (107ab69d-b1d4-41bb-8323-552befd9edd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4441b0e0-e4a7-4322-b5da-9d936ee9a028', 'volume_size': 2}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:26:57 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ebd47e19-96fd-46d2-96bd-9a38bd026edf tempest-VolumesSnapshotNegativeTestJSON-1774317281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (386ae375-9fc1-42da-90a1-29cc0a788a32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:26:57 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-ebd47e19-96fd-46d2-96bd-9a38bd026edf tempest-VolumesSnapshotNegativeTestJSON-1774317281 None] Volume volume-4441b0e0-e4a7-4322-b5da-9d936ee9a028 (4441b0e0-e4a7-4322-b5da-9d936ee9a028): created successfully Sep 15 16:26:57 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ebd47e19-96fd-46d2-96bd-9a38bd026edf tempest-VolumesSnapshotNegativeTestJSON-1774317281 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (386ae375-9fc1-42da-90a1-29cc0a788a32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:26:57 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ebd47e19-96fd-46d2-96bd-9a38bd026edf tempest-VolumesSnapshotNegativeTestJSON-1774317281 None] Flow 'volume_create_manager' (0746a291-fb31-45a3-bc33-a636d78facf2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:26:57 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-ebd47e19-96fd-46d2-96bd-9a38bd026edf tempest-VolumesSnapshotNegativeTestJSON-1774317281 None] Created volume successfully. Sep 15 16:26:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-5d85508c-dcb8-4841-a9e9-83db04dbc22e tempest-VolumesSnapshotNegativeTestJSON-1774317281 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:26:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-5d85508c-dcb8-4841-a9e9-83db04dbc22e tempest-VolumesSnapshotNegativeTestJSON-1774317281 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:26:57 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-5d85508c-dcb8-4841-a9e9-83db04dbc22e tempest-VolumesSnapshotNegativeTestJSON-1774317281 None] Creating offline snapshot 7442f765-d4cc-4395-8097-336b690c9cde of volume 4441b0e0-e4a7-4322-b5da-9d936ee9a028 {{(pid=86082) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 15 16:26:57 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5c11848-7c8d-451f-9dd8-36899ff8a603 tempest-VolumesCloneTest-909425693 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:26:57 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[e27153cc-59bd-4923-a7d4-bfbdb2351a86]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:26:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5d85508c-dcb8-4841-a9e9-83db04dbc22e tempest-VolumesSnapshotNegativeTestJSON-1774317281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-4441b0e0-e4a7-4322-b5da-9d936ee9a028 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:26:57 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e5c11848-7c8d-451f-9dd8-36899ff8a603 tempest-VolumesCloneTest-909425693 None] Flow 'volume_create_manager' (d7f2ca46-98bb-4cab-bc83-0920f7980747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:26:57 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e5c11848-7c8d-451f-9dd8-36899ff8a603 tempest-VolumesCloneTest-909425693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebfc7467-07d4-4a48-89b5-53e6b3261eb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:26:58 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e5c11848-7c8d-451f-9dd8-36899ff8a603 tempest-VolumesCloneTest-909425693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebfc7467-07d4-4a48-89b5-53e6b3261eb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:26:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1559971461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=437f020a-cd1d-4436-93d4-e84373c6daf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='60f31f74f55144f4aa840c371609a012',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:26:58Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=1b8514ad-1601-45c9-91b8-2f5158ff9422,status='creating',terminated_at=None,updated_at=2026-09-15T14:26:58Z,use_quota=True,user_id='78ee6821ead947dd894d29b912f0b075',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:26:58 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e5c11848-7c8d-451f-9dd8-36899ff8a603 tempest-VolumesCloneTest-909425693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaee0cfd-5e37-4aa0-b9da-27d31a606405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:26:58 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e5c11848-7c8d-451f-9dd8-36899ff8a603 tempest-VolumesCloneTest-909425693 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaee0cfd-5e37-4aa0-b9da-27d31a606405) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:26:58 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e5c11848-7c8d-451f-9dd8-36899ff8a603 tempest-VolumesCloneTest-909425693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33d9ccd7-0450-47e3-9fcd-a114cc259161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:26:58 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e5c11848-7c8d-451f-9dd8-36899ff8a603 tempest-VolumesCloneTest-909425693 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33d9ccd7-0450-47e3-9fcd-a114cc259161) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '437f020a-cd1d-4436-93d4-e84373c6daf1', 'volume_name': 'volume-437f020a-cd1d-4436-93d4-e84373c6daf1', 'volume_size': 2, 'source_volid': '1b8514ad-1601-45c9-91b8-2f5158ff9422', 'source_volstatus': 'available'}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:26:58 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e5c11848-7c8d-451f-9dd8-36899ff8a603 tempest-VolumesCloneTest-909425693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bed87460-dced-4c39-b9ec-fec4abee9190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:26:58 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e5c11848-7c8d-451f-9dd8-36899ff8a603 tempest-VolumesCloneTest-909425693 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bed87460-dced-4c39-b9ec-fec4abee9190) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:26:58 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e5c11848-7c8d-451f-9dd8-36899ff8a603 tempest-VolumesCloneTest-909425693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87c9373c-8358-49d7-86b2-c9ab5c1f6720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:26:58 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-e5c11848-7c8d-451f-9dd8-36899ff8a603 tempest-VolumesCloneTest-909425693 None] Volume 437f020a-cd1d-4436-93d4-e84373c6daf1: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-437f020a-cd1d-4436-93d4-e84373c6daf1', 'volume_size': 2, 'source_volid': '1b8514ad-1601-45c9-91b8-2f5158ff9422', 'source_volstatus': 'available'} Sep 15 16:26:58 devstack sudo[99377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-4441b0e0-e4a7-4322-b5da-9d936ee9a028 Sep 15 16:26:58 devstack sudo[99377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:26:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-e5c11848-7c8d-451f-9dd8-36899ff8a603 tempest-VolumesCloneTest-909425693 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:26:58 devstack sudo[99377]: pam_unix(sudo:session): session closed for user root Sep 15 16:26:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5d85508c-dcb8-4841-a9e9-83db04dbc22e tempest-VolumesSnapshotNegativeTestJSON-1774317281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-4441b0e0-e4a7-4322-b5da-9d936ee9a028" returned: 0 in 0.445s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:26:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5d85508c-dcb8-4841-a9e9-83db04dbc22e tempest-VolumesSnapshotNegativeTestJSON-1774317281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-4441b0e0-e4a7-4322-b5da-9d936ee9a028,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-4441b0e0-e4a7-4322-b5da-9d936ee9a028.7442f765-d4cc-4395-8097-336b690c9cde 2G {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:26:58 devstack sudo[99382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-4441b0e0-e4a7-4322-b5da-9d936ee9a028,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-4441b0e0-e4a7-4322-b5da-9d936ee9a028.7442f765-d4cc-4395-8097-336b690c9cde 2G Sep 15 16:26:58 devstack sudo[99382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:26:58 devstack sudo[99382]: pam_unix(sudo:session): session closed for user root Sep 15 16:26:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5d85508c-dcb8-4841-a9e9-83db04dbc22e tempest-VolumesSnapshotNegativeTestJSON-1774317281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-4441b0e0-e4a7-4322-b5da-9d936ee9a028,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-4441b0e0-e4a7-4322-b5da-9d936ee9a028.7442f765-d4cc-4395-8097-336b690c9cde 2G" returned: 0 in 0.474s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:26:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5d85508c-dcb8-4841-a9e9-83db04dbc22e tempest-VolumesSnapshotNegativeTestJSON-1774317281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4441b0e0-e4a7-4322-b5da-9d936ee9a028 -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-4441b0e0-e4a7-4322-b5da-9d936ee9a028.7442f765-d4cc-4395-8097-336b690c9cde {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:26:58 devstack sudo[99388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4441b0e0-e4a7-4322-b5da-9d936ee9a028 -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-4441b0e0-e4a7-4322-b5da-9d936ee9a028.7442f765-d4cc-4395-8097-336b690c9cde Sep 15 16:26:58 devstack sudo[99388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:26:59 devstack sudo[99388]: pam_unix(sudo:session): session closed for user root Sep 15 16:26:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5d85508c-dcb8-4841-a9e9-83db04dbc22e tempest-VolumesSnapshotNegativeTestJSON-1774317281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4441b0e0-e4a7-4322-b5da-9d936ee9a028 -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-4441b0e0-e4a7-4322-b5da-9d936ee9a028.7442f765-d4cc-4395-8097-336b690c9cde" returned: 0 in 0.302s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:26:59 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-5d85508c-dcb8-4841-a9e9-83db04dbc22e tempest-VolumesSnapshotNegativeTestJSON-1774317281 None] /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-4441b0e0-e4a7-4322-b5da-9d936ee9a028.7442f765-d4cc-4395-8097-336b690c9cde is being set with open permissions: ugo+rw Sep 15 16:26:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5d85508c-dcb8-4841-a9e9-83db04dbc22e tempest-VolumesSnapshotNegativeTestJSON-1774317281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-4441b0e0-e4a7-4322-b5da-9d936ee9a028.7442f765-d4cc-4395-8097-336b690c9cde {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:26:59 devstack sudo[99393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-4441b0e0-e4a7-4322-b5da-9d936ee9a028.7442f765-d4cc-4395-8097-336b690c9cde Sep 15 16:26:59 devstack sudo[99393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:26:59 devstack sudo[99393]: pam_unix(sudo:session): session closed for user root Sep 15 16:26:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5d85508c-dcb8-4841-a9e9-83db04dbc22e tempest-VolumesSnapshotNegativeTestJSON-1774317281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-4441b0e0-e4a7-4322-b5da-9d936ee9a028.7442f765-d4cc-4395-8097-336b690c9cde" returned: 0 in 0.255s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:26:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5d85508c-dcb8-4841-a9e9-83db04dbc22e tempest-VolumesSnapshotNegativeTestJSON-1774317281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-4441b0e0-e4a7-4322-b5da-9d936ee9a028.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:26:59 devstack sudo[99396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-4441b0e0-e4a7-4322-b5da-9d936ee9a028.info Sep 15 16:26:59 devstack sudo[99396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:26:59 devstack sudo[99396]: pam_unix(sudo:session): session closed for user root Sep 15 16:26:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5d85508c-dcb8-4841-a9e9-83db04dbc22e tempest-VolumesSnapshotNegativeTestJSON-1774317281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-4441b0e0-e4a7-4322-b5da-9d936ee9a028.info" returned: 0 in 0.252s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:26:59 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-5d85508c-dcb8-4841-a9e9-83db04dbc22e tempest-VolumesSnapshotNegativeTestJSON-1774317281 None] /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-4441b0e0-e4a7-4322-b5da-9d936ee9a028.info is being set with open permissions: ugo+rw Sep 15 16:26:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5d85508c-dcb8-4841-a9e9-83db04dbc22e tempest-VolumesSnapshotNegativeTestJSON-1774317281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-4441b0e0-e4a7-4322-b5da-9d936ee9a028.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:26:59 devstack sudo[99399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-4441b0e0-e4a7-4322-b5da-9d936ee9a028.info Sep 15 16:26:59 devstack sudo[99399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:26:59 devstack cinder-volume[86082]: DEBUG oslo_service.periodic_task [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86082) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 15 16:26:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:26:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:26:59 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:26:59 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:26:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:26:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:26:59 devstack sudo[99402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:26:59 devstack sudo[99402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:26:59 devstack sudo[99399]: pam_unix(sudo:session): session closed for user root Sep 15 16:26:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5d85508c-dcb8-4841-a9e9-83db04dbc22e tempest-VolumesSnapshotNegativeTestJSON-1774317281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-4441b0e0-e4a7-4322-b5da-9d936ee9a028.info" returned: 0 in 0.280s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-5d85508c-dcb8-4841-a9e9-83db04dbc22e tempest-VolumesSnapshotNegativeTestJSON-1774317281 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.120s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:27:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-e5c11848-7c8d-451f-9dd8-36899ff8a603 tempest-VolumesCloneTest-909425693 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 1.932s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:27:00 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-e5c11848-7c8d-451f-9dd8-36899ff8a603 tempest-VolumesCloneTest-909425693 None] Cloning volume 1b8514ad-1601-45c9-91b8-2f5158ff9422 to volume 437f020a-cd1d-4436-93d4-e84373c6daf1 Sep 15 16:27:00 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-5d85508c-dcb8-4841-a9e9-83db04dbc22e tempest-VolumesSnapshotNegativeTestJSON-1774317281 None] Create snapshot completed successfully Sep 15 16:27:00 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-e5c11848-7c8d-451f-9dd8-36899ff8a603 tempest-VolumesCloneTest-909425693 None] Creating offline snapshot 13f5996d-47fa-4de8-9b3e-1fabd4cb4dbc of volume 1b8514ad-1601-45c9-91b8-2f5158ff9422 {{(pid=86082) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 15 16:27:00 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[86590fd2-2326-4d59-a436-81d25e70ac92]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:27:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e5c11848-7c8d-451f-9dd8-36899ff8a603 tempest-VolumesCloneTest-909425693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1b8514ad-1601-45c9-91b8-2f5158ff9422 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:00 devstack sudo[99402]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.296s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:00 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:27:00 devstack cinder-volume[86082]: DEBUG oslo_service.periodic_task [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Running periodic task VolumeManager._thread_info {{(pid=86082) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 15 16:27:00 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] thread count: 28 {{(pid=86082) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 15 16:27:00 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] thread info: [<_MainThread(MainThread, started 124875935469696)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86082) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 15 16:27:00 devstack sudo[99409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1b8514ad-1601-45c9-91b8-2f5158ff9422 Sep 15 16:27:00 devstack sudo[99409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:00 devstack sudo[99409]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e5c11848-7c8d-451f-9dd8-36899ff8a603 tempest-VolumesCloneTest-909425693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1b8514ad-1601-45c9-91b8-2f5158ff9422" returned: 0 in 0.427s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e5c11848-7c8d-451f-9dd8-36899ff8a603 tempest-VolumesCloneTest-909425693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1b8514ad-1601-45c9-91b8-2f5158ff9422,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1b8514ad-1601-45c9-91b8-2f5158ff9422.13f5996d-47fa-4de8-9b3e-1fabd4cb4dbc 1G {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:00 devstack sudo[99441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1b8514ad-1601-45c9-91b8-2f5158ff9422,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1b8514ad-1601-45c9-91b8-2f5158ff9422.13f5996d-47fa-4de8-9b3e-1fabd4cb4dbc 1G Sep 15 16:27:00 devstack sudo[99441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:01 devstack sudo[99441]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e5c11848-7c8d-451f-9dd8-36899ff8a603 tempest-VolumesCloneTest-909425693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1b8514ad-1601-45c9-91b8-2f5158ff9422,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1b8514ad-1601-45c9-91b8-2f5158ff9422.13f5996d-47fa-4de8-9b3e-1fabd4cb4dbc 1G" returned: 0 in 0.565s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e5c11848-7c8d-451f-9dd8-36899ff8a603 tempest-VolumesCloneTest-909425693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b8514ad-1601-45c9-91b8-2f5158ff9422 -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1b8514ad-1601-45c9-91b8-2f5158ff9422.13f5996d-47fa-4de8-9b3e-1fabd4cb4dbc {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:01 devstack sudo[99460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b8514ad-1601-45c9-91b8-2f5158ff9422 -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1b8514ad-1601-45c9-91b8-2f5158ff9422.13f5996d-47fa-4de8-9b3e-1fabd4cb4dbc Sep 15 16:27:01 devstack sudo[99460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:01 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-a3f89e4b-3730-4bdb-aa5f-0b4a3157e72a tempest-VolumesSnapshotNegativeTestJSON-1774317281 None] Acquiring lock "cinder-7442f765-d4cc-4395-8097-336b690c9cde-delete_snapshot" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:27:01 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-a3f89e4b-3730-4bdb-aa5f-0b4a3157e72a tempest-VolumesSnapshotNegativeTestJSON-1774317281 None] Lock "cinder-7442f765-d4cc-4395-8097-336b690c9cde-delete_snapshot" acquired by "delete_snapshot" :: waited 0.057s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:27:01 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-a3f89e4b-3730-4bdb-aa5f-0b4a3157e72a tempest-VolumesSnapshotNegativeTestJSON-1774317281 None] Acquiring lock "cinder-quobyte-4441b0e0-e4a7-4322-b5da-9d936ee9a028" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:27:01 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-a3f89e4b-3730-4bdb-aa5f-0b4a3157e72a tempest-VolumesSnapshotNegativeTestJSON-1774317281 None] Lock "cinder-quobyte-4441b0e0-e4a7-4322-b5da-9d936ee9a028" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:27:01 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-a3f89e4b-3730-4bdb-aa5f-0b4a3157e72a tempest-VolumesSnapshotNegativeTestJSON-1774317281 None] Acquiring lock "cinder-quobyte-7442f765-d4cc-4395-8097-336b690c9cde" by "_delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:27:01 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba4254d2-2208-493c-9110-4f06725437a3 tempest-SnapshotsActionsTest-82182000 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:27:01 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ba4254d2-2208-493c-9110-4f06725437a3 tempest-SnapshotsActionsTest-82182000 None] Flow 'volume_create_manager' (65a7a4f4-c43e-44a2-9e0d-816ef00c6350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:27:01 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ba4254d2-2208-493c-9110-4f06725437a3 tempest-SnapshotsActionsTest-82182000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cd534ac-9e41-4a70-95fc-6a04237faa42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:27:01 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ba4254d2-2208-493c-9110-4f06725437a3 tempest-SnapshotsActionsTest-82182000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cd534ac-9e41-4a70-95fc-6a04237faa42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:27:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1320519905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=279826cc-e702-4b37-9791-7965cec669f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd40a2169e4c47ce9e0da5111799c47a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:27:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:27:01Z,use_quota=True,user_id='7f40217020b04d16b45c3cd8efa0fff3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:27:01 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ba4254d2-2208-493c-9110-4f06725437a3 tempest-SnapshotsActionsTest-82182000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adb7efe4-cb6b-421c-a937-ab9ae0e58b7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:27:01 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ba4254d2-2208-493c-9110-4f06725437a3 tempest-SnapshotsActionsTest-82182000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adb7efe4-cb6b-421c-a937-ab9ae0e58b7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:27:01 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ba4254d2-2208-493c-9110-4f06725437a3 tempest-SnapshotsActionsTest-82182000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (315e55a8-dad2-43be-809a-2d2696fb572b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:27:01 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ba4254d2-2208-493c-9110-4f06725437a3 tempest-SnapshotsActionsTest-82182000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (315e55a8-dad2-43be-809a-2d2696fb572b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '279826cc-e702-4b37-9791-7965cec669f5', 'volume_name': 'volume-279826cc-e702-4b37-9791-7965cec669f5', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:27:01 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ba4254d2-2208-493c-9110-4f06725437a3 tempest-SnapshotsActionsTest-82182000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71c4f6f5-504b-4db3-8e36-804626ac7d94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:27:01 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ba4254d2-2208-493c-9110-4f06725437a3 tempest-SnapshotsActionsTest-82182000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71c4f6f5-504b-4db3-8e36-804626ac7d94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:27:01 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ba4254d2-2208-493c-9110-4f06725437a3 tempest-SnapshotsActionsTest-82182000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bb62274-441a-4ce7-8f8b-a02c62d1a91e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:27:01 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-ba4254d2-2208-493c-9110-4f06725437a3 tempest-SnapshotsActionsTest-82182000 None] Volume 279826cc-e702-4b37-9791-7965cec669f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-279826cc-e702-4b37-9791-7965cec669f5', 'volume_size': 1} Sep 15 16:27:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-ba4254d2-2208-493c-9110-4f06725437a3 tempest-SnapshotsActionsTest-82182000 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:27:01 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-a3f89e4b-3730-4bdb-aa5f-0b4a3157e72a tempest-VolumesSnapshotNegativeTestJSON-1774317281 None] Lock "cinder-quobyte-7442f765-d4cc-4395-8097-336b690c9cde" acquired by "_delete_snapshot" :: waited 0.110s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:27:01 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-a3f89e4b-3730-4bdb-aa5f-0b4a3157e72a tempest-VolumesSnapshotNegativeTestJSON-1774317281 None] Deleting offline snapshot 7442f765-d4cc-4395-8097-336b690c9cde of volume 4441b0e0-e4a7-4322-b5da-9d936ee9a028 {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 15 16:27:01 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-a3f89e4b-3730-4bdb-aa5f-0b4a3157e72a tempest-VolumesSnapshotNegativeTestJSON-1774317281 None] snapshot_file for this snap is: volume-4441b0e0-e4a7-4322-b5da-9d936ee9a028.7442f765-d4cc-4395-8097-336b690c9cde {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 15 16:27:01 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[132c7906-7ddf-4268-9c57-2dca8275cd62]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:27:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a3f89e4b-3730-4bdb-aa5f-0b4a3157e72a tempest-VolumesSnapshotNegativeTestJSON-1774317281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-4441b0e0-e4a7-4322-b5da-9d936ee9a028.7442f765-d4cc-4395-8097-336b690c9cde {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:01 devstack sudo[99460]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e5c11848-7c8d-451f-9dd8-36899ff8a603 tempest-VolumesCloneTest-909425693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1b8514ad-1601-45c9-91b8-2f5158ff9422 -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1b8514ad-1601-45c9-91b8-2f5158ff9422.13f5996d-47fa-4de8-9b3e-1fabd4cb4dbc" returned: 0 in 0.380s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:01 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-e5c11848-7c8d-451f-9dd8-36899ff8a603 tempest-VolumesCloneTest-909425693 None] /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1b8514ad-1601-45c9-91b8-2f5158ff9422.13f5996d-47fa-4de8-9b3e-1fabd4cb4dbc is being set with open permissions: ugo+rw Sep 15 16:27:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e5c11848-7c8d-451f-9dd8-36899ff8a603 tempest-VolumesCloneTest-909425693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1b8514ad-1601-45c9-91b8-2f5158ff9422.13f5996d-47fa-4de8-9b3e-1fabd4cb4dbc {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:01 devstack sudo[99475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1b8514ad-1601-45c9-91b8-2f5158ff9422.13f5996d-47fa-4de8-9b3e-1fabd4cb4dbc Sep 15 16:27:01 devstack sudo[99475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:01 devstack sudo[99473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-4441b0e0-e4a7-4322-b5da-9d936ee9a028.7442f765-d4cc-4395-8097-336b690c9cde Sep 15 16:27:01 devstack sudo[99473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:01 devstack sudo[99475]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e5c11848-7c8d-451f-9dd8-36899ff8a603 tempest-VolumesCloneTest-909425693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1b8514ad-1601-45c9-91b8-2f5158ff9422.13f5996d-47fa-4de8-9b3e-1fabd4cb4dbc" returned: 0 in 0.272s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e5c11848-7c8d-451f-9dd8-36899ff8a603 tempest-VolumesCloneTest-909425693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1b8514ad-1601-45c9-91b8-2f5158ff9422.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:01 devstack sudo[99482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1b8514ad-1601-45c9-91b8-2f5158ff9422.info Sep 15 16:27:01 devstack sudo[99482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:01 devstack sudo[99473]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a3f89e4b-3730-4bdb-aa5f-0b4a3157e72a tempest-VolumesSnapshotNegativeTestJSON-1774317281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-4441b0e0-e4a7-4322-b5da-9d936ee9a028.7442f765-d4cc-4395-8097-336b690c9cde" returned: 0 in 0.431s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:01 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-a3f89e4b-3730-4bdb-aa5f-0b4a3157e72a tempest-VolumesSnapshotNegativeTestJSON-1774317281 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4441b0e0-e4a7-4322-b5da-9d936ee9a028(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 16:27:01 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[8979f62b-bac7-4245-9a61-7f10b720a6c1]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:27:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a3f89e4b-3730-4bdb-aa5f-0b4a3157e72a tempest-VolumesSnapshotNegativeTestJSON-1774317281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-4441b0e0-e4a7-4322-b5da-9d936ee9a028 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:02 devstack sudo[99484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-4441b0e0-e4a7-4322-b5da-9d936ee9a028 Sep 15 16:27:02 devstack sudo[99484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:02 devstack sudo[99482]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e5c11848-7c8d-451f-9dd8-36899ff8a603 tempest-VolumesCloneTest-909425693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1b8514ad-1601-45c9-91b8-2f5158ff9422.info" returned: 0 in 0.327s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:02 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-e5c11848-7c8d-451f-9dd8-36899ff8a603 tempest-VolumesCloneTest-909425693 None] /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1b8514ad-1601-45c9-91b8-2f5158ff9422.info is being set with open permissions: ugo+rw Sep 15 16:27:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e5c11848-7c8d-451f-9dd8-36899ff8a603 tempest-VolumesCloneTest-909425693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1b8514ad-1601-45c9-91b8-2f5158ff9422.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:02 devstack sudo[99487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1b8514ad-1601-45c9-91b8-2f5158ff9422.info Sep 15 16:27:02 devstack sudo[99487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:02 devstack sudo[99484]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a3f89e4b-3730-4bdb-aa5f-0b4a3157e72a tempest-VolumesSnapshotNegativeTestJSON-1774317281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-4441b0e0-e4a7-4322-b5da-9d936ee9a028" returned: 0 in 0.510s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a3f89e4b-3730-4bdb-aa5f-0b4a3157e72a tempest-VolumesSnapshotNegativeTestJSON-1774317281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-4441b0e0-e4a7-4322-b5da-9d936ee9a028.7442f765-d4cc-4395-8097-336b690c9cde {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:02 devstack sudo[99495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-4441b0e0-e4a7-4322-b5da-9d936ee9a028.7442f765-d4cc-4395-8097-336b690c9cde Sep 15 16:27:02 devstack sudo[99495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:02 devstack sudo[99487]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e5c11848-7c8d-451f-9dd8-36899ff8a603 tempest-VolumesCloneTest-909425693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1b8514ad-1601-45c9-91b8-2f5158ff9422.info" returned: 0 in 0.345s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:02 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-e5c11848-7c8d-451f-9dd8-36899ff8a603 tempest-VolumesCloneTest-909425693 None] Acquiring lock "cinder-quobyte-437f020a-cd1d-4436-93d4-e84373c6daf1" by "_copy_volume_from_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:27:02 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-e5c11848-7c8d-451f-9dd8-36899ff8a603 tempest-VolumesCloneTest-909425693 None] Lock "cinder-quobyte-437f020a-cd1d-4436-93d4-e84373c6daf1" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:27:02 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-e5c11848-7c8d-451f-9dd8-36899ff8a603 tempest-VolumesCloneTest-909425693 None] snapshot: 13f5996d-47fa-4de8-9b3e-1fabd4cb4dbc, volume: 437f020a-cd1d-4436-93d4-e84373c6daf1, {{(pid=86082) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 15 16:27:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-e5c11848-7c8d-451f-9dd8-36899ff8a603 tempest-VolumesCloneTest-909425693 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:27:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-e5c11848-7c8d-451f-9dd8-36899ff8a603 tempest-VolumesCloneTest-909425693 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:27:02 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-e5c11848-7c8d-451f-9dd8-36899ff8a603 tempest-VolumesCloneTest-909425693 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:27:02 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-e5c11848-7c8d-451f-9dd8-36899ff8a603 tempest-VolumesCloneTest-909425693 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:27:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-e5c11848-7c8d-451f-9dd8-36899ff8a603 tempest-VolumesCloneTest-909425693 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:27:02 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[f19f7817-d953-4bd6-b98e-0d836616b89b]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:27:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e5c11848-7c8d-451f-9dd8-36899ff8a603 tempest-VolumesCloneTest-909425693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1b8514ad-1601-45c9-91b8-2f5158ff9422.13f5996d-47fa-4de8-9b3e-1fabd4cb4dbc {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:02 devstack sudo[99497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1b8514ad-1601-45c9-91b8-2f5158ff9422.13f5996d-47fa-4de8-9b3e-1fabd4cb4dbc Sep 15 16:27:02 devstack sudo[99497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:02 devstack sudo[99495]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a3f89e4b-3730-4bdb-aa5f-0b4a3157e72a tempest-VolumesSnapshotNegativeTestJSON-1774317281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-4441b0e0-e4a7-4322-b5da-9d936ee9a028.7442f765-d4cc-4395-8097-336b690c9cde" returned: 0 in 0.394s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a3f89e4b-3730-4bdb-aa5f-0b4a3157e72a tempest-VolumesSnapshotNegativeTestJSON-1774317281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-4441b0e0-e4a7-4322-b5da-9d936ee9a028.7442f765-d4cc-4395-8097-336b690c9cde {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:02 devstack sudo[99502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-4441b0e0-e4a7-4322-b5da-9d936ee9a028.7442f765-d4cc-4395-8097-336b690c9cde Sep 15 16:27:02 devstack sudo[99502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:02 devstack sudo[99497]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e5c11848-7c8d-451f-9dd8-36899ff8a603 tempest-VolumesCloneTest-909425693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1b8514ad-1601-45c9-91b8-2f5158ff9422.13f5996d-47fa-4de8-9b3e-1fabd4cb4dbc" returned: 0 in 0.413s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:02 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-e5c11848-7c8d-451f-9dd8-36899ff8a603 tempest-VolumesCloneTest-909425693 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b8514ad-1601-45c9-91b8-2f5158ff9422(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 16:27:02 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[324e78ab-e6de-4222-b542-97b1b4ab60c0]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:27:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e5c11848-7c8d-451f-9dd8-36899ff8a603 tempest-VolumesCloneTest-909425693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1b8514ad-1601-45c9-91b8-2f5158ff9422 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:03 devstack sudo[99502]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a3f89e4b-3730-4bdb-aa5f-0b4a3157e72a tempest-VolumesSnapshotNegativeTestJSON-1774317281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-4441b0e0-e4a7-4322-b5da-9d936ee9a028.7442f765-d4cc-4395-8097-336b690c9cde" returned: 0 in 0.311s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:03 devstack sudo[99507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1b8514ad-1601-45c9-91b8-2f5158ff9422 Sep 15 16:27:03 devstack sudo[99507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:03 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-a3f89e4b-3730-4bdb-aa5f-0b4a3157e72a tempest-VolumesSnapshotNegativeTestJSON-1774317281 None] Lock "cinder-quobyte-7442f765-d4cc-4395-8097-336b690c9cde" released by "_delete_snapshot" :: held 1.818s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:27:03 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-a3f89e4b-3730-4bdb-aa5f-0b4a3157e72a tempest-VolumesSnapshotNegativeTestJSON-1774317281 None] Lock "cinder-quobyte-4441b0e0-e4a7-4322-b5da-9d936ee9a028" released by "delete_snapshot" :: held 1.943s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:27:03 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-a3f89e4b-3730-4bdb-aa5f-0b4a3157e72a tempest-VolumesSnapshotNegativeTestJSON-1774317281 None] Created reservations ['5ede256c-e6b9-4bd0-940c-ba12e1f23a34', 'e03c9e9e-a95c-46aa-b43a-d93a803ee05b', '089ad4d6-d243-46d2-bcdd-a522e8229433', 'dd5b01c1-72d2-40fc-88e8-8dfeb18a6c99'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:27:03 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-a3f89e4b-3730-4bdb-aa5f-0b4a3157e72a tempest-VolumesSnapshotNegativeTestJSON-1774317281 None] Delete snapshot completed successfully. Sep 15 16:27:03 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-a3f89e4b-3730-4bdb-aa5f-0b4a3157e72a tempest-VolumesSnapshotNegativeTestJSON-1774317281 None] Lock "cinder-7442f765-d4cc-4395-8097-336b690c9cde-delete_snapshot" released by "delete_snapshot" :: held 2.204s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:27:03 devstack sudo[99507]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e5c11848-7c8d-451f-9dd8-36899ff8a603 tempest-VolumesCloneTest-909425693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1b8514ad-1601-45c9-91b8-2f5158ff9422" returned: 0 in 0.497s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:03 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-e5c11848-7c8d-451f-9dd8-36899ff8a603 tempest-VolumesCloneTest-909425693 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1b8514ad-1601-45c9-91b8-2f5158ff9422 {{(pid=86082) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 15 16:27:03 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-e5c11848-7c8d-451f-9dd8-36899ff8a603 tempest-VolumesCloneTest-909425693 None] Creating direct copy from snapshot {{(pid=86082) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 15 16:27:03 devstack cinder-volume[86082]: DEBUG cinder.utils [None req-e5c11848-7c8d-451f-9dd8-36899ff8a603 tempest-VolumesCloneTest-909425693 None] Path /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-437f020a-cd1d-4436-93d4-e84373c6daf1 not found in is_blk_device check {{(pid=86082) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 15 16:27:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e5c11848-7c8d-451f-9dd8-36899ff8a603 tempest-VolumesCloneTest-909425693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1b8514ad-1601-45c9-91b8-2f5158ff9422 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-437f020a-cd1d-4436-93d4-e84373c6daf1 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:03 devstack sudo[99513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1b8514ad-1601-45c9-91b8-2f5158ff9422 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-437f020a-cd1d-4436-93d4-e84373c6daf1 Sep 15 16:27:03 devstack sudo[99513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:04 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-e43254ec-a335-4d71-a9ab-56eaba9ce1f4 tempest-VolumesSnapshotNegativeTestJSON-1774317281 None] Acquiring lock "cinder-4441b0e0-e4a7-4322-b5da-9d936ee9a028-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:27:04 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-e43254ec-a335-4d71-a9ab-56eaba9ce1f4 tempest-VolumesSnapshotNegativeTestJSON-1774317281 None] Lock "cinder-4441b0e0-e4a7-4322-b5da-9d936ee9a028-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:27:04 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-e43254ec-a335-4d71-a9ab-56eaba9ce1f4 tempest-VolumesSnapshotNegativeTestJSON-1774317281 None] Acquiring lock "cinder-quobyte-4441b0e0-e4a7-4322-b5da-9d936ee9a028" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:27:04 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-e43254ec-a335-4d71-a9ab-56eaba9ce1f4 tempest-VolumesSnapshotNegativeTestJSON-1774317281 None] Lock "cinder-quobyte-4441b0e0-e4a7-4322-b5da-9d936ee9a028" acquired by "delete_volume" :: waited 0.050s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:27:04 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b9df56c-c01f-4a8b-871b-21c0b669a4ff]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:27:04 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e43254ec-a335-4d71-a9ab-56eaba9ce1f4 tempest-VolumesSnapshotNegativeTestJSON-1774317281 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-4441b0e0-e4a7-4322-b5da-9d936ee9a028 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:05 devstack sudo[99527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-4441b0e0-e4a7-4322-b5da-9d936ee9a028 Sep 15 16:27:05 devstack sudo[99527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:05 devstack sudo[99527]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e43254ec-a335-4d71-a9ab-56eaba9ce1f4 tempest-VolumesSnapshotNegativeTestJSON-1774317281 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-4441b0e0-e4a7-4322-b5da-9d936ee9a028" returned: 0 in 0.800s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e43254ec-a335-4d71-a9ab-56eaba9ce1f4 tempest-VolumesSnapshotNegativeTestJSON-1774317281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-4441b0e0-e4a7-4322-b5da-9d936ee9a028 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:05 devstack sudo[99533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-4441b0e0-e4a7-4322-b5da-9d936ee9a028 Sep 15 16:27:05 devstack sudo[99533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:06 devstack sudo[99533]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e43254ec-a335-4d71-a9ab-56eaba9ce1f4 tempest-VolumesSnapshotNegativeTestJSON-1774317281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-4441b0e0-e4a7-4322-b5da-9d936ee9a028" returned: 0 in 0.501s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:06 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-e43254ec-a335-4d71-a9ab-56eaba9ce1f4 tempest-VolumesSnapshotNegativeTestJSON-1774317281 None] Lock "cinder-quobyte-4441b0e0-e4a7-4322-b5da-9d936ee9a028" released by "delete_volume" :: held 1.452s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:27:06 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-e43254ec-a335-4d71-a9ab-56eaba9ce1f4 tempest-VolumesSnapshotNegativeTestJSON-1774317281 None] Created reservations ['6ce3f71a-53aa-40d4-98fd-1d3e3155f2fb', '438fa78e-c98e-493c-b69c-99a847d86804', '7436575b-0f0b-4f96-a548-8723f7ec406b', 'd252043f-91de-4f3c-a089-09393063bb59'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:27:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-e43254ec-a335-4d71-a9ab-56eaba9ce1f4 tempest-VolumesSnapshotNegativeTestJSON-1774317281 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:27:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-e43254ec-a335-4d71-a9ab-56eaba9ce1f4 tempest-VolumesSnapshotNegativeTestJSON-1774317281 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:27:06 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-e43254ec-a335-4d71-a9ab-56eaba9ce1f4 tempest-VolumesSnapshotNegativeTestJSON-1774317281 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:27:06 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-e43254ec-a335-4d71-a9ab-56eaba9ce1f4 tempest-VolumesSnapshotNegativeTestJSON-1774317281 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:27:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-e43254ec-a335-4d71-a9ab-56eaba9ce1f4 tempest-VolumesSnapshotNegativeTestJSON-1774317281 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:27:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e43254ec-a335-4d71-a9ab-56eaba9ce1f4 tempest-VolumesSnapshotNegativeTestJSON-1774317281 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:06 devstack sudo[99537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:27:06 devstack sudo[99537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:07 devstack sudo[99537]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e43254ec-a335-4d71-a9ab-56eaba9ce1f4 tempest-VolumesSnapshotNegativeTestJSON-1774317281 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.549s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:07 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-e43254ec-a335-4d71-a9ab-56eaba9ce1f4 tempest-VolumesSnapshotNegativeTestJSON-1774317281 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:27:07 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-e43254ec-a335-4d71-a9ab-56eaba9ce1f4 tempest-VolumesSnapshotNegativeTestJSON-1774317281 None] Deleted volume successfully. Sep 15 16:27:07 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-e43254ec-a335-4d71-a9ab-56eaba9ce1f4 tempest-VolumesSnapshotNegativeTestJSON-1774317281 None] Lock "cinder-4441b0e0-e4a7-4322-b5da-9d936ee9a028-delete_volume" released by "delete_volume" :: held 2.499s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:27:12 devstack sudo[99513]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e5c11848-7c8d-451f-9dd8-36899ff8a603 tempest-VolumesCloneTest-909425693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1b8514ad-1601-45c9-91b8-2f5158ff9422 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-437f020a-cd1d-4436-93d4-e84373c6daf1" returned: 0 in 9.195s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:12 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-e5c11848-7c8d-451f-9dd8-36899ff8a603 tempest-VolumesCloneTest-909425693 None] Image conversion details: src /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1b8514ad-1601-45c9-91b8-2f5158ff9422, size 1024.00 MB, duration 9.20 sec, destination /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-437f020a-cd1d-4436-93d4-e84373c6daf1 {{(pid=86082) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 15 16:27:12 devstack cinder-volume[86082]: INFO cinder.image.image_utils [None req-e5c11848-7c8d-451f-9dd8-36899ff8a603 tempest-VolumesCloneTest-909425693 None] Converted 1024.00 MB image at 111.35 MB/s Sep 15 16:27:12 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-e5c11848-7c8d-451f-9dd8-36899ff8a603 tempest-VolumesCloneTest-909425693 None] /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-437f020a-cd1d-4436-93d4-e84373c6daf1 is being set with open permissions: ugo+rw Sep 15 16:27:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e5c11848-7c8d-451f-9dd8-36899ff8a603 tempest-VolumesCloneTest-909425693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-437f020a-cd1d-4436-93d4-e84373c6daf1 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:12 devstack sudo[99541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-437f020a-cd1d-4436-93d4-e84373c6daf1 Sep 15 16:27:12 devstack sudo[99541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:12 devstack sudo[99541]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e5c11848-7c8d-451f-9dd8-36899ff8a603 tempest-VolumesCloneTest-909425693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-437f020a-cd1d-4436-93d4-e84373c6daf1" returned: 0 in 0.253s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:12 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-e5c11848-7c8d-451f-9dd8-36899ff8a603 tempest-VolumesCloneTest-909425693 None] Lock "cinder-quobyte-437f020a-cd1d-4436-93d4-e84373c6daf1" released by "_copy_volume_from_snapshot" :: held 10.436s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:27:12 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-e5c11848-7c8d-451f-9dd8-36899ff8a603 tempest-VolumesCloneTest-909425693 None] Acquiring lock "cinder-quobyte-13f5996d-47fa-4de8-9b3e-1fabd4cb4dbc" by "_delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:27:12 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-e5c11848-7c8d-451f-9dd8-36899ff8a603 tempest-VolumesCloneTest-909425693 None] Lock "cinder-quobyte-13f5996d-47fa-4de8-9b3e-1fabd4cb4dbc" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:27:12 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-e5c11848-7c8d-451f-9dd8-36899ff8a603 tempest-VolumesCloneTest-909425693 None] Deleting offline snapshot 13f5996d-47fa-4de8-9b3e-1fabd4cb4dbc of volume 1b8514ad-1601-45c9-91b8-2f5158ff9422 {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 15 16:27:13 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-e5c11848-7c8d-451f-9dd8-36899ff8a603 tempest-VolumesCloneTest-909425693 None] snapshot_file for this snap is: volume-1b8514ad-1601-45c9-91b8-2f5158ff9422.13f5996d-47fa-4de8-9b3e-1fabd4cb4dbc {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 15 16:27:13 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[f20f873c-d121-480e-a7d2-6bdb0b7ddb53]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:27:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e5c11848-7c8d-451f-9dd8-36899ff8a603 tempest-VolumesCloneTest-909425693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1b8514ad-1601-45c9-91b8-2f5158ff9422.13f5996d-47fa-4de8-9b3e-1fabd4cb4dbc {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:13 devstack sudo[99544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1b8514ad-1601-45c9-91b8-2f5158ff9422.13f5996d-47fa-4de8-9b3e-1fabd4cb4dbc Sep 15 16:27:13 devstack sudo[99544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:13 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-02fff259-25d0-4760-941d-0835d9a54d71 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:27:13 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-02fff259-25d0-4760-941d-0835d9a54d71 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Flow 'volume_create_manager' (96239cf1-aeaf-4c30-b2ea-7515111bcaec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:27:13 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-02fff259-25d0-4760-941d-0835d9a54d71 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (948dad08-8c19-43b5-a413-18ed4927220d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:27:13 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-02fff259-25d0-4760-941d-0835d9a54d71 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (948dad08-8c19-43b5-a413-18ed4927220d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:27:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1189672109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5de627de-a14b-449d-8de1-1e865ed34ce4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91bd5572404b4e8b8879831a265b8538',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:27:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:27:13Z,use_quota=True,user_id='6ba9eaf8b7224b12976539a1afcbf136',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:27:13 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-02fff259-25d0-4760-941d-0835d9a54d71 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d75e6a28-687f-48af-b339-281d9d1fcddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:27:13 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-02fff259-25d0-4760-941d-0835d9a54d71 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d75e6a28-687f-48af-b339-281d9d1fcddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:27:13 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-02fff259-25d0-4760-941d-0835d9a54d71 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f575b9cb-2db9-4d6d-af8e-6c2c7b9e5f52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:27:13 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-02fff259-25d0-4760-941d-0835d9a54d71 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f575b9cb-2db9-4d6d-af8e-6c2c7b9e5f52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5de627de-a14b-449d-8de1-1e865ed34ce4', 'volume_name': 'volume-5de627de-a14b-449d-8de1-1e865ed34ce4', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:27:13 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-02fff259-25d0-4760-941d-0835d9a54d71 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a13036a0-4d58-48ae-890e-b257e2eeaa16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:27:13 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-02fff259-25d0-4760-941d-0835d9a54d71 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a13036a0-4d58-48ae-890e-b257e2eeaa16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:27:13 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-02fff259-25d0-4760-941d-0835d9a54d71 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00bd5ee5-93b4-4612-8cf1-7a544347fce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:27:13 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-02fff259-25d0-4760-941d-0835d9a54d71 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Volume 5de627de-a14b-449d-8de1-1e865ed34ce4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5de627de-a14b-449d-8de1-1e865ed34ce4', 'volume_size': 1} Sep 15 16:27:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-02fff259-25d0-4760-941d-0835d9a54d71 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:27:13 devstack sudo[99544]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e5c11848-7c8d-451f-9dd8-36899ff8a603 tempest-VolumesCloneTest-909425693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1b8514ad-1601-45c9-91b8-2f5158ff9422.13f5996d-47fa-4de8-9b3e-1fabd4cb4dbc" returned: 0 in 0.434s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:13 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-e5c11848-7c8d-451f-9dd8-36899ff8a603 tempest-VolumesCloneTest-909425693 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1b8514ad-1601-45c9-91b8-2f5158ff9422(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 16:27:13 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceedc7cb-7555-4c08-be72-d0b1f2018017]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:27:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e5c11848-7c8d-451f-9dd8-36899ff8a603 tempest-VolumesCloneTest-909425693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1b8514ad-1601-45c9-91b8-2f5158ff9422 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:13 devstack sudo[99549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1b8514ad-1601-45c9-91b8-2f5158ff9422 Sep 15 16:27:13 devstack sudo[99549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:14 devstack sudo[99549]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e5c11848-7c8d-451f-9dd8-36899ff8a603 tempest-VolumesCloneTest-909425693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1b8514ad-1601-45c9-91b8-2f5158ff9422" returned: 0 in 0.550s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e5c11848-7c8d-451f-9dd8-36899ff8a603 tempest-VolumesCloneTest-909425693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1b8514ad-1601-45c9-91b8-2f5158ff9422.13f5996d-47fa-4de8-9b3e-1fabd4cb4dbc {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:14 devstack sudo[99562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1b8514ad-1601-45c9-91b8-2f5158ff9422.13f5996d-47fa-4de8-9b3e-1fabd4cb4dbc Sep 15 16:27:14 devstack sudo[99562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:14 devstack sudo[99562]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e5c11848-7c8d-451f-9dd8-36899ff8a603 tempest-VolumesCloneTest-909425693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1b8514ad-1601-45c9-91b8-2f5158ff9422.13f5996d-47fa-4de8-9b3e-1fabd4cb4dbc" returned: 0 in 0.384s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e5c11848-7c8d-451f-9dd8-36899ff8a603 tempest-VolumesCloneTest-909425693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1b8514ad-1601-45c9-91b8-2f5158ff9422.13f5996d-47fa-4de8-9b3e-1fabd4cb4dbc {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:14 devstack sudo[99567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1b8514ad-1601-45c9-91b8-2f5158ff9422.13f5996d-47fa-4de8-9b3e-1fabd4cb4dbc Sep 15 16:27:14 devstack sudo[99567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:14 devstack sudo[99567]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e5c11848-7c8d-451f-9dd8-36899ff8a603 tempest-VolumesCloneTest-909425693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1b8514ad-1601-45c9-91b8-2f5158ff9422.13f5996d-47fa-4de8-9b3e-1fabd4cb4dbc" returned: 0 in 0.259s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:14 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-e5c11848-7c8d-451f-9dd8-36899ff8a603 tempest-VolumesCloneTest-909425693 None] Lock "cinder-quobyte-13f5996d-47fa-4de8-9b3e-1fabd4cb4dbc" released by "_delete_snapshot" :: held 1.747s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:27:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-e5c11848-7c8d-451f-9dd8-36899ff8a603 tempest-VolumesCloneTest-909425693 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.747s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:27:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-ba4254d2-2208-493c-9110-4f06725437a3 tempest-SnapshotsActionsTest-82182000 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.417s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:27:14 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-ba4254d2-2208-493c-9110-4f06725437a3 tempest-SnapshotsActionsTest-82182000 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:27:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1320519905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=279826cc-e702-4b37-9791-7965cec669f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd40a2169e4c47ce9e0da5111799c47a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:27:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:27:01Z,use_quota=True,user_id='7f40217020b04d16b45c3cd8efa0fff3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:27:14 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-ba4254d2-2208-493c-9110-4f06725437a3 tempest-SnapshotsActionsTest-82182000 None] Creating volume 279826cc-e702-4b37-9791-7965cec669f5 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:27:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-ba4254d2-2208-493c-9110-4f06725437a3 tempest-SnapshotsActionsTest-82182000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:27:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-ba4254d2-2208-493c-9110-4f06725437a3 tempest-SnapshotsActionsTest-82182000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:27:14 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-ba4254d2-2208-493c-9110-4f06725437a3 tempest-SnapshotsActionsTest-82182000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:27:14 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-ba4254d2-2208-493c-9110-4f06725437a3 tempest-SnapshotsActionsTest-82182000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:27:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-ba4254d2-2208-493c-9110-4f06725437a3 tempest-SnapshotsActionsTest-82182000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:27:14 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-ba4254d2-2208-493c-9110-4f06725437a3 tempest-SnapshotsActionsTest-82182000 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:27:14 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-ba4254d2-2208-493c-9110-4f06725437a3 tempest-SnapshotsActionsTest-82182000 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:27:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ba4254d2-2208-493c-9110-4f06725437a3 tempest-SnapshotsActionsTest-82182000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:14 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e5c11848-7c8d-451f-9dd8-36899ff8a603 tempest-VolumesCloneTest-909425693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87c9373c-8358-49d7-86b2-c9ab5c1f6720) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-437f020a-cd1d-4436-93d4-e84373c6daf1', 'volume_size': 2, 'source_volid': '1b8514ad-1601-45c9-91b8-2f5158ff9422', 'source_volstatus': 'available'}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:27:14 devstack sudo[99604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5 1073741824 Sep 15 16:27:14 devstack sudo[99604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:14 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e5c11848-7c8d-451f-9dd8-36899ff8a603 tempest-VolumesCloneTest-909425693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8aee41b-4843-4e27-9278-8f4d3d48f5c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:27:14 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-e5c11848-7c8d-451f-9dd8-36899ff8a603 tempest-VolumesCloneTest-909425693 None] Volume volume-437f020a-cd1d-4436-93d4-e84373c6daf1 (437f020a-cd1d-4436-93d4-e84373c6daf1): created successfully Sep 15 16:27:14 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e5c11848-7c8d-451f-9dd8-36899ff8a603 tempest-VolumesCloneTest-909425693 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8aee41b-4843-4e27-9278-8f4d3d48f5c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:27:14 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e5c11848-7c8d-451f-9dd8-36899ff8a603 tempest-VolumesCloneTest-909425693 None] Flow 'volume_create_manager' (d7f2ca46-98bb-4cab-bc83-0920f7980747) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:27:14 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-e5c11848-7c8d-451f-9dd8-36899ff8a603 tempest-VolumesCloneTest-909425693 None] Created volume successfully. Sep 15 16:27:15 devstack sudo[99604]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ba4254d2-2208-493c-9110-4f06725437a3 tempest-SnapshotsActionsTest-82182000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5 1073741824" returned: 0 in 0.439s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ba4254d2-2208-493c-9110-4f06725437a3 tempest-SnapshotsActionsTest-82182000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:15 devstack sudo[99611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5 Sep 15 16:27:15 devstack sudo[99611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:15 devstack sudo[99611]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ba4254d2-2208-493c-9110-4f06725437a3 tempest-SnapshotsActionsTest-82182000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5" returned: 0 in 0.253s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:15 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-ba4254d2-2208-493c-9110-4f06725437a3 tempest-SnapshotsActionsTest-82182000 None] <== create_volume: return (731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:27:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-ba4254d2-2208-493c-9110-4f06725437a3 tempest-SnapshotsActionsTest-82182000 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.735s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:27:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-02fff259-25d0-4760-941d-0835d9a54d71 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.067s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:27:15 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-02fff259-25d0-4760-941d-0835d9a54d71 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:27:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1189672109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5de627de-a14b-449d-8de1-1e865ed34ce4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91bd5572404b4e8b8879831a265b8538',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:27:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:27:13Z,use_quota=True,user_id='6ba9eaf8b7224b12976539a1afcbf136',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:27:15 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-02fff259-25d0-4760-941d-0835d9a54d71 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Creating volume 5de627de-a14b-449d-8de1-1e865ed34ce4 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:27:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-02fff259-25d0-4760-941d-0835d9a54d71 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:27:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-02fff259-25d0-4760-941d-0835d9a54d71 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:27:15 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-02fff259-25d0-4760-941d-0835d9a54d71 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:27:15 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-02fff259-25d0-4760-941d-0835d9a54d71 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:27:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-02fff259-25d0-4760-941d-0835d9a54d71 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:27:15 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-02fff259-25d0-4760-941d-0835d9a54d71 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:27:15 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-02fff259-25d0-4760-941d-0835d9a54d71 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:27:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-02fff259-25d0-4760-941d-0835d9a54d71 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-5de627de-a14b-449d-8de1-1e865ed34ce4 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:15 devstack sudo[99614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-5de627de-a14b-449d-8de1-1e865ed34ce4 1073741824 Sep 15 16:27:15 devstack sudo[99614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:15 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ba4254d2-2208-493c-9110-4f06725437a3 tempest-SnapshotsActionsTest-82182000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1bb62274-441a-4ce7-8f8b-a02c62d1a91e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-279826cc-e702-4b37-9791-7965cec669f5', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:27:15 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ba4254d2-2208-493c-9110-4f06725437a3 tempest-SnapshotsActionsTest-82182000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0eecde3e-43ad-4443-b84b-d99a051ab257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:27:15 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-ba4254d2-2208-493c-9110-4f06725437a3 tempest-SnapshotsActionsTest-82182000 None] Volume volume-279826cc-e702-4b37-9791-7965cec669f5 (279826cc-e702-4b37-9791-7965cec669f5): created successfully Sep 15 16:27:15 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ba4254d2-2208-493c-9110-4f06725437a3 tempest-SnapshotsActionsTest-82182000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0eecde3e-43ad-4443-b84b-d99a051ab257) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:27:15 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ba4254d2-2208-493c-9110-4f06725437a3 tempest-SnapshotsActionsTest-82182000 None] Flow 'volume_create_manager' (65a7a4f4-c43e-44a2-9e0d-816ef00c6350) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:27:15 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-ba4254d2-2208-493c-9110-4f06725437a3 tempest-SnapshotsActionsTest-82182000 None] Created volume successfully. Sep 15 16:27:15 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-46a78969-6479-4c41-82b7-011b8e701f02 tempest-VolumesCloneTest-909425693 None] Acquiring lock "cinder-437f020a-cd1d-4436-93d4-e84373c6daf1-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:27:15 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-46a78969-6479-4c41-82b7-011b8e701f02 tempest-VolumesCloneTest-909425693 None] Lock "cinder-437f020a-cd1d-4436-93d4-e84373c6daf1-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:27:15 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-46a78969-6479-4c41-82b7-011b8e701f02 tempest-VolumesCloneTest-909425693 None] Acquiring lock "cinder-quobyte-437f020a-cd1d-4436-93d4-e84373c6daf1" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:27:15 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-46a78969-6479-4c41-82b7-011b8e701f02 tempest-VolumesCloneTest-909425693 None] Lock "cinder-quobyte-437f020a-cd1d-4436-93d4-e84373c6daf1" acquired by "delete_volume" :: waited 0.021s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:27:15 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b02df23-67b9-41e8-b14c-65c358e15c98]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:27:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-46a78969-6479-4c41-82b7-011b8e701f02 tempest-VolumesCloneTest-909425693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-437f020a-cd1d-4436-93d4-e84373c6daf1 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:15 devstack sudo[99619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-437f020a-cd1d-4436-93d4-e84373c6daf1 Sep 15 16:27:15 devstack sudo[99619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:16 devstack sudo[99614]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-02fff259-25d0-4760-941d-0835d9a54d71 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-5de627de-a14b-449d-8de1-1e865ed34ce4 1073741824" returned: 0 in 0.504s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-02fff259-25d0-4760-941d-0835d9a54d71 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-5de627de-a14b-449d-8de1-1e865ed34ce4 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:16 devstack sudo[99622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-5de627de-a14b-449d-8de1-1e865ed34ce4 Sep 15 16:27:16 devstack sudo[99622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-11e6bd67-623b-460c-868a-9e75c901098d tempest-SnapshotsActionsTest-82182000 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:27:16 devstack sudo[99619]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-46a78969-6479-4c41-82b7-011b8e701f02 tempest-VolumesCloneTest-909425693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-437f020a-cd1d-4436-93d4-e84373c6daf1" returned: 0 in 0.420s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-46a78969-6479-4c41-82b7-011b8e701f02 tempest-VolumesCloneTest-909425693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-437f020a-cd1d-4436-93d4-e84373c6daf1 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:16 devstack sudo[99627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-437f020a-cd1d-4436-93d4-e84373c6daf1 Sep 15 16:27:16 devstack sudo[99627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:16 devstack sudo[99622]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-02fff259-25d0-4760-941d-0835d9a54d71 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-5de627de-a14b-449d-8de1-1e865ed34ce4" returned: 0 in 0.280s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:16 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-02fff259-25d0-4760-941d-0835d9a54d71 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] <== create_volume: return (841ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:27:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-02fff259-25d0-4760-941d-0835d9a54d71 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.844s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:27:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-11e6bd67-623b-460c-868a-9e75c901098d tempest-SnapshotsActionsTest-82182000 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.208s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:27:16 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-02fff259-25d0-4760-941d-0835d9a54d71 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00bd5ee5-93b4-4612-8cf1-7a544347fce0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5de627de-a14b-449d-8de1-1e865ed34ce4', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:27:16 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-02fff259-25d0-4760-941d-0835d9a54d71 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc69501d-9740-4293-a62e-753847598fd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:27:16 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-11e6bd67-623b-460c-868a-9e75c901098d tempest-SnapshotsActionsTest-82182000 None] Creating offline snapshot df37eddb-733c-42b7-b8aa-ff40e6de1acf of volume 279826cc-e702-4b37-9791-7965cec669f5 {{(pid=86082) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 15 16:27:16 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-02fff259-25d0-4760-941d-0835d9a54d71 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Volume volume-5de627de-a14b-449d-8de1-1e865ed34ce4 (5de627de-a14b-449d-8de1-1e865ed34ce4): created successfully Sep 15 16:27:16 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-02fff259-25d0-4760-941d-0835d9a54d71 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bc69501d-9740-4293-a62e-753847598fd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:27:16 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-02fff259-25d0-4760-941d-0835d9a54d71 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Flow 'volume_create_manager' (96239cf1-aeaf-4c30-b2ea-7515111bcaec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:27:16 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-02fff259-25d0-4760-941d-0835d9a54d71 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Created volume successfully. Sep 15 16:27:16 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[391378d5-291a-4295-a7af-3bdb2305924f]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:27:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-11e6bd67-623b-460c-868a-9e75c901098d tempest-SnapshotsActionsTest-82182000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:16 devstack sudo[99627]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-46a78969-6479-4c41-82b7-011b8e701f02 tempest-VolumesCloneTest-909425693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-437f020a-cd1d-4436-93d4-e84373c6daf1" returned: 0 in 0.259s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:16 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-46a78969-6479-4c41-82b7-011b8e701f02 tempest-VolumesCloneTest-909425693 None] Lock "cinder-quobyte-437f020a-cd1d-4436-93d4-e84373c6daf1" released by "delete_volume" :: held 0.727s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:27:16 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-46a78969-6479-4c41-82b7-011b8e701f02 tempest-VolumesCloneTest-909425693 None] Created reservations ['9a806cb7-3950-4e25-a8f3-e042d6b721f4', 'ec2b80c0-a851-4684-bd67-cb2278b3cfab', '3782c9eb-5045-4e2a-b1e0-313595479d57', '53754bc1-dfff-40d6-949e-fd2ef721e16f'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:27:16 devstack sudo[99631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5 Sep 15 16:27:16 devstack sudo[99631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-46a78969-6479-4c41-82b7-011b8e701f02 tempest-VolumesCloneTest-909425693 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:27:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-46a78969-6479-4c41-82b7-011b8e701f02 tempest-VolumesCloneTest-909425693 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:27:16 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-46a78969-6479-4c41-82b7-011b8e701f02 tempest-VolumesCloneTest-909425693 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:27:16 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-46a78969-6479-4c41-82b7-011b8e701f02 tempest-VolumesCloneTest-909425693 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:27:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-46a78969-6479-4c41-82b7-011b8e701f02 tempest-VolumesCloneTest-909425693 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:27:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-46a78969-6479-4c41-82b7-011b8e701f02 tempest-VolumesCloneTest-909425693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:16 devstack sudo[99634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:27:16 devstack sudo[99634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:16 devstack sudo[99631]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-11e6bd67-623b-460c-868a-9e75c901098d tempest-SnapshotsActionsTest-82182000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5" returned: 0 in 0.390s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-11e6bd67-623b-460c-868a-9e75c901098d tempest-SnapshotsActionsTest-82182000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.df37eddb-733c-42b7-b8aa-ff40e6de1acf 1G {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:16 devstack sudo[99639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.df37eddb-733c-42b7-b8aa-ff40e6de1acf 1G Sep 15 16:27:16 devstack sudo[99639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:16 devstack sudo[99634]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-46a78969-6479-4c41-82b7-011b8e701f02 tempest-VolumesCloneTest-909425693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.274s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:16 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-46a78969-6479-4c41-82b7-011b8e701f02 tempest-VolumesCloneTest-909425693 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:27:16 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-46a78969-6479-4c41-82b7-011b8e701f02 tempest-VolumesCloneTest-909425693 None] Deleted volume successfully. Sep 15 16:27:16 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-46a78969-6479-4c41-82b7-011b8e701f02 tempest-VolumesCloneTest-909425693 None] Lock "cinder-437f020a-cd1d-4436-93d4-e84373c6daf1-delete_volume" released by "delete_volume" :: held 1.208s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:27:16 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-fb85828a-f14a-4590-be06-d98c696f1610 tempest-VolumesCloneTest-909425693 None] Acquiring lock "cinder-1b8514ad-1601-45c9-91b8-2f5158ff9422-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:27:16 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-fb85828a-f14a-4590-be06-d98c696f1610 tempest-VolumesCloneTest-909425693 None] Lock "cinder-1b8514ad-1601-45c9-91b8-2f5158ff9422-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:27:16 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-fb85828a-f14a-4590-be06-d98c696f1610 tempest-VolumesCloneTest-909425693 None] Acquiring lock "cinder-quobyte-1b8514ad-1601-45c9-91b8-2f5158ff9422" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:27:16 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-fb85828a-f14a-4590-be06-d98c696f1610 tempest-VolumesCloneTest-909425693 None] Lock "cinder-quobyte-1b8514ad-1601-45c9-91b8-2f5158ff9422" acquired by "delete_volume" :: waited 0.015s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:27:17 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ec4bc18-f625-4156-89a7-d7922fc91fbc]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:27:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-fb85828a-f14a-4590-be06-d98c696f1610 tempest-VolumesCloneTest-909425693 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1b8514ad-1601-45c9-91b8-2f5158ff9422 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:17 devstack sudo[99642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1b8514ad-1601-45c9-91b8-2f5158ff9422 Sep 15 16:27:17 devstack sudo[99642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:17 devstack sudo[99639]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-11e6bd67-623b-460c-868a-9e75c901098d tempest-SnapshotsActionsTest-82182000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.df37eddb-733c-42b7-b8aa-ff40e6de1acf 1G" returned: 0 in 0.440s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-11e6bd67-623b-460c-868a-9e75c901098d tempest-SnapshotsActionsTest-82182000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-279826cc-e702-4b37-9791-7965cec669f5 -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.df37eddb-733c-42b7-b8aa-ff40e6de1acf {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:17 devstack sudo[99647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-279826cc-e702-4b37-9791-7965cec669f5 -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.df37eddb-733c-42b7-b8aa-ff40e6de1acf Sep 15 16:27:17 devstack sudo[99647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:17 devstack sudo[99642]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-fb85828a-f14a-4590-be06-d98c696f1610 tempest-VolumesCloneTest-909425693 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1b8514ad-1601-45c9-91b8-2f5158ff9422" returned: 0 in 0.406s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-fb85828a-f14a-4590-be06-d98c696f1610 tempest-VolumesCloneTest-909425693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1b8514ad-1601-45c9-91b8-2f5158ff9422 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:17 devstack sudo[99652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1b8514ad-1601-45c9-91b8-2f5158ff9422 Sep 15 16:27:17 devstack sudo[99652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:17 devstack sudo[99647]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-11e6bd67-623b-460c-868a-9e75c901098d tempest-SnapshotsActionsTest-82182000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-279826cc-e702-4b37-9791-7965cec669f5 -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.df37eddb-733c-42b7-b8aa-ff40e6de1acf" returned: 0 in 0.300s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:17 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-11e6bd67-623b-460c-868a-9e75c901098d tempest-SnapshotsActionsTest-82182000 None] /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.df37eddb-733c-42b7-b8aa-ff40e6de1acf is being set with open permissions: ugo+rw Sep 15 16:27:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-11e6bd67-623b-460c-868a-9e75c901098d tempest-SnapshotsActionsTest-82182000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.df37eddb-733c-42b7-b8aa-ff40e6de1acf {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:17 devstack sudo[99657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.df37eddb-733c-42b7-b8aa-ff40e6de1acf Sep 15 16:27:17 devstack sudo[99657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:17 devstack sudo[99652]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-fb85828a-f14a-4590-be06-d98c696f1610 tempest-VolumesCloneTest-909425693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1b8514ad-1601-45c9-91b8-2f5158ff9422" returned: 0 in 0.269s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:17 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-fb85828a-f14a-4590-be06-d98c696f1610 tempest-VolumesCloneTest-909425693 None] Lock "cinder-quobyte-1b8514ad-1601-45c9-91b8-2f5158ff9422" released by "delete_volume" :: held 0.749s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:27:17 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-fb85828a-f14a-4590-be06-d98c696f1610 tempest-VolumesCloneTest-909425693 None] Created reservations ['6a133ada-f216-47f4-9851-48bd0e0b7761', 'b9da8543-17f6-4c9b-9a70-f8fbebd2d7e0', '442824e2-0546-4d66-bcbb-d081aba78777', 'a58824d2-2c2f-45ee-a2c4-cd26e8fc48cc'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:27:17 devstack sudo[99657]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-11e6bd67-623b-460c-868a-9e75c901098d tempest-SnapshotsActionsTest-82182000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.df37eddb-733c-42b7-b8aa-ff40e6de1acf" returned: 0 in 0.268s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-fb85828a-f14a-4590-be06-d98c696f1610 tempest-VolumesCloneTest-909425693 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:27:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-fb85828a-f14a-4590-be06-d98c696f1610 tempest-VolumesCloneTest-909425693 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:27:17 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-fb85828a-f14a-4590-be06-d98c696f1610 tempest-VolumesCloneTest-909425693 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:27:17 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-fb85828a-f14a-4590-be06-d98c696f1610 tempest-VolumesCloneTest-909425693 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:27:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-fb85828a-f14a-4590-be06-d98c696f1610 tempest-VolumesCloneTest-909425693 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:27:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-fb85828a-f14a-4590-be06-d98c696f1610 tempest-VolumesCloneTest-909425693 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-11e6bd67-623b-460c-868a-9e75c901098d tempest-SnapshotsActionsTest-82182000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:17 devstack sudo[99661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:27:17 devstack sudo[99661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:17 devstack sudo[99662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.info Sep 15 16:27:17 devstack sudo[99662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:18 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-af2eb864-84f7-478d-b3e5-4730a615f743 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:27:18 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-af2eb864-84f7-478d-b3e5-4730a615f743 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Flow 'volume_create_manager' (1daaeb9f-eb96-4c12-8570-2672d5fa0f76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:27:18 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-af2eb864-84f7-478d-b3e5-4730a615f743 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa6a023c-1862-4f91-b848-c0602ead1bcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:27:18 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-af2eb864-84f7-478d-b3e5-4730a615f743 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa6a023c-1862-4f91-b848-c0602ead1bcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:27:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-707527126',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ca395ce-a4c2-4365-a555-6ae6ae248994,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91bd5572404b4e8b8879831a265b8538',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:27:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:27:18Z,use_quota=True,user_id='6ba9eaf8b7224b12976539a1afcbf136',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:27:18 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-af2eb864-84f7-478d-b3e5-4730a615f743 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52cb1ba6-89cc-4327-b0e7-bf1378049305) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:27:18 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-af2eb864-84f7-478d-b3e5-4730a615f743 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52cb1ba6-89cc-4327-b0e7-bf1378049305) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:27:18 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-af2eb864-84f7-478d-b3e5-4730a615f743 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf3d3af6-4f58-4ab2-a3c8-4cc7c2e365b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:27:18 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-af2eb864-84f7-478d-b3e5-4730a615f743 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf3d3af6-4f58-4ab2-a3c8-4cc7c2e365b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ca395ce-a4c2-4365-a555-6ae6ae248994', 'volume_name': 'volume-7ca395ce-a4c2-4365-a555-6ae6ae248994', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:27:18 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-af2eb864-84f7-478d-b3e5-4730a615f743 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85f4cf4d-3190-4a64-816a-717a886b87ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:27:18 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-af2eb864-84f7-478d-b3e5-4730a615f743 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85f4cf4d-3190-4a64-816a-717a886b87ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:27:18 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-af2eb864-84f7-478d-b3e5-4730a615f743 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (723ac3ee-df9e-4bd0-9748-4eaa3c72b4c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:27:18 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-af2eb864-84f7-478d-b3e5-4730a615f743 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Volume 7ca395ce-a4c2-4365-a555-6ae6ae248994: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ca395ce-a4c2-4365-a555-6ae6ae248994', 'volume_size': 1} Sep 15 16:27:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-af2eb864-84f7-478d-b3e5-4730a615f743 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:27:18 devstack sudo[99662]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:18 devstack sudo[99661]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-fb85828a-f14a-4590-be06-d98c696f1610 tempest-VolumesCloneTest-909425693 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.391s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:18 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-fb85828a-f14a-4590-be06-d98c696f1610 tempest-VolumesCloneTest-909425693 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:27:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-11e6bd67-623b-460c-868a-9e75c901098d tempest-SnapshotsActionsTest-82182000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.info" returned: 0 in 0.372s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:18 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-11e6bd67-623b-460c-868a-9e75c901098d tempest-SnapshotsActionsTest-82182000 None] /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.info is being set with open permissions: ugo+rw Sep 15 16:27:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-11e6bd67-623b-460c-868a-9e75c901098d tempest-SnapshotsActionsTest-82182000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:18 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-fb85828a-f14a-4590-be06-d98c696f1610 tempest-VolumesCloneTest-909425693 None] Deleted volume successfully. Sep 15 16:27:18 devstack sudo[99667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.info Sep 15 16:27:18 devstack sudo[99667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:18 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-fb85828a-f14a-4590-be06-d98c696f1610 tempest-VolumesCloneTest-909425693 None] Lock "cinder-1b8514ad-1601-45c9-91b8-2f5158ff9422-delete_volume" released by "delete_volume" :: held 1.402s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:27:18 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d378ff6-c99e-4e40-ad4c-d33357041ea6 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:27:18 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0d378ff6-c99e-4e40-ad4c-d33357041ea6 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Flow 'volume_create_manager' (09ce7a59-b3cd-4e07-81e9-a237a92d27fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:27:18 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0d378ff6-c99e-4e40-ad4c-d33357041ea6 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1457d8ef-d739-4aae-b67c-acfa824d57e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:27:18 devstack sudo[99667]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-11e6bd67-623b-460c-868a-9e75c901098d tempest-SnapshotsActionsTest-82182000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.info" returned: 0 in 0.328s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-11e6bd67-623b-460c-868a-9e75c901098d tempest-SnapshotsActionsTest-82182000 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.302s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:27:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-af2eb864-84f7-478d-b3e5-4730a615f743 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.489s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:27:18 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-af2eb864-84f7-478d-b3e5-4730a615f743 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:27:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-707527126',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ca395ce-a4c2-4365-a555-6ae6ae248994,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91bd5572404b4e8b8879831a265b8538',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:27:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:27:18Z,use_quota=True,user_id='6ba9eaf8b7224b12976539a1afcbf136',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:27:18 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-af2eb864-84f7-478d-b3e5-4730a615f743 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Creating volume 7ca395ce-a4c2-4365-a555-6ae6ae248994 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:27:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-af2eb864-84f7-478d-b3e5-4730a615f743 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:27:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-af2eb864-84f7-478d-b3e5-4730a615f743 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:27:18 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-af2eb864-84f7-478d-b3e5-4730a615f743 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:27:18 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-af2eb864-84f7-478d-b3e5-4730a615f743 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:27:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-af2eb864-84f7-478d-b3e5-4730a615f743 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:27:18 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-af2eb864-84f7-478d-b3e5-4730a615f743 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:27:18 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-af2eb864-84f7-478d-b3e5-4730a615f743 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:27:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-af2eb864-84f7-478d-b3e5-4730a615f743 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-7ca395ce-a4c2-4365-a555-6ae6ae248994 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:18 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0d378ff6-c99e-4e40-ad4c-d33357041ea6 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1457d8ef-d739-4aae-b67c-acfa824d57e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:27:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-497194994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3df80ac-892a-48ee-9096-d8dffd2e6d1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91bd5572404b4e8b8879831a265b8538',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:27:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:27:18Z,use_quota=True,user_id='6ba9eaf8b7224b12976539a1afcbf136',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:27:18 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0d378ff6-c99e-4e40-ad4c-d33357041ea6 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fba0f96-4ddd-4ce9-a872-25fed8f8576c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:27:18 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0d378ff6-c99e-4e40-ad4c-d33357041ea6 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fba0f96-4ddd-4ce9-a872-25fed8f8576c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:27:18 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0d378ff6-c99e-4e40-ad4c-d33357041ea6 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (776063c2-68c2-4a23-aeae-d08d6ff11b24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:27:18 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0d378ff6-c99e-4e40-ad4c-d33357041ea6 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (776063c2-68c2-4a23-aeae-d08d6ff11b24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3df80ac-892a-48ee-9096-d8dffd2e6d1a', 'volume_name': 'volume-e3df80ac-892a-48ee-9096-d8dffd2e6d1a', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:27:18 devstack sudo[99670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-7ca395ce-a4c2-4365-a555-6ae6ae248994 1073741824 Sep 15 16:27:18 devstack sudo[99670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:18 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0d378ff6-c99e-4e40-ad4c-d33357041ea6 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15236e0d-ca5a-4b83-b3c6-c671801477d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:27:18 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0d378ff6-c99e-4e40-ad4c-d33357041ea6 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15236e0d-ca5a-4b83-b3c6-c671801477d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:27:18 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0d378ff6-c99e-4e40-ad4c-d33357041ea6 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f36e5816-9bd4-400d-875a-e44672c56a8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:27:18 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-0d378ff6-c99e-4e40-ad4c-d33357041ea6 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Volume e3df80ac-892a-48ee-9096-d8dffd2e6d1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3df80ac-892a-48ee-9096-d8dffd2e6d1a', 'volume_size': 1} Sep 15 16:27:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-0d378ff6-c99e-4e40-ad4c-d33357041ea6 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:27:18 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-11e6bd67-623b-460c-868a-9e75c901098d tempest-SnapshotsActionsTest-82182000 None] Create snapshot completed successfully Sep 15 16:27:18 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-334fc802-315d-480b-a93b-a1f004fa366b tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:27:18 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-334fc802-315d-480b-a93b-a1f004fa366b tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Flow 'volume_create_manager' (6c98b043-ccb2-4af7-8a8e-6349bff68335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:27:18 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-334fc802-315d-480b-a93b-a1f004fa366b tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1f9f117-ce86-43a5-9bf0-2fd154b1a9cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:27:18 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-334fc802-315d-480b-a93b-a1f004fa366b tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1f9f117-ce86-43a5-9bf0-2fd154b1a9cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:27:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-304524886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=334bf406-c9fb-4808-b1da-d48fc3c72aa3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91bd5572404b4e8b8879831a265b8538',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:27:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:27:19Z,use_quota=True,user_id='6ba9eaf8b7224b12976539a1afcbf136',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:27:18 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-334fc802-315d-480b-a93b-a1f004fa366b tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86cf5822-8fc8-492c-9a25-f8fc88a2b394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:27:18 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-334fc802-315d-480b-a93b-a1f004fa366b tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86cf5822-8fc8-492c-9a25-f8fc88a2b394) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:27:18 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-334fc802-315d-480b-a93b-a1f004fa366b tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5cc2221-0765-4ae3-88a1-780565fda573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:27:18 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-334fc802-315d-480b-a93b-a1f004fa366b tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5cc2221-0765-4ae3-88a1-780565fda573) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '334bf406-c9fb-4808-b1da-d48fc3c72aa3', 'volume_name': 'volume-334bf406-c9fb-4808-b1da-d48fc3c72aa3', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:27:18 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-334fc802-315d-480b-a93b-a1f004fa366b tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f28e21f8-d708-46fd-8c8d-658b9a6e8641) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:27:18 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-334fc802-315d-480b-a93b-a1f004fa366b tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f28e21f8-d708-46fd-8c8d-658b9a6e8641) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:27:19 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-334fc802-315d-480b-a93b-a1f004fa366b tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c902642-4c87-4144-89b4-5ad955675bcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:27:19 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-334fc802-315d-480b-a93b-a1f004fa366b tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Volume 334bf406-c9fb-4808-b1da-d48fc3c72aa3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-334bf406-c9fb-4808-b1da-d48fc3c72aa3', 'volume_size': 1} Sep 15 16:27:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-334fc802-315d-480b-a93b-a1f004fa366b tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:27:19 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d80d768-c166-4ee7-a437-a25b44c9de95 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:27:19 devstack sudo[99670]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:19 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0d80d768-c166-4ee7-a437-a25b44c9de95 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Flow 'volume_create_manager' (1d102de7-7083-4008-ab2e-951f03f2280e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:27:19 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0d80d768-c166-4ee7-a437-a25b44c9de95 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb5ea05c-6bdc-4e79-b57d-03153806cbc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:27:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-af2eb864-84f7-478d-b3e5-4730a615f743 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-7ca395ce-a4c2-4365-a555-6ae6ae248994 1073741824" returned: 0 in 0.714s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:19 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0d80d768-c166-4ee7-a437-a25b44c9de95 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb5ea05c-6bdc-4e79-b57d-03153806cbc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:27:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1412367803',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9e19d2f-334e-4c39-b8f6-429f4dcd948a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91bd5572404b4e8b8879831a265b8538',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:27:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:27:19Z,use_quota=True,user_id='6ba9eaf8b7224b12976539a1afcbf136',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:27:19 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0d80d768-c166-4ee7-a437-a25b44c9de95 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc7bc4ed-596c-4278-ac4a-d69e0357d29b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:27:19 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0d80d768-c166-4ee7-a437-a25b44c9de95 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc7bc4ed-596c-4278-ac4a-d69e0357d29b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:27:19 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0d80d768-c166-4ee7-a437-a25b44c9de95 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d97800b-3bdd-4054-addb-c3368d1047d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:27:19 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0d80d768-c166-4ee7-a437-a25b44c9de95 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d97800b-3bdd-4054-addb-c3368d1047d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9e19d2f-334e-4c39-b8f6-429f4dcd948a', 'volume_name': 'volume-d9e19d2f-334e-4c39-b8f6-429f4dcd948a', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:27:19 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0d80d768-c166-4ee7-a437-a25b44c9de95 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f831292-7125-45f4-9ece-d2ed0fb48125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:27:19 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0d80d768-c166-4ee7-a437-a25b44c9de95 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f831292-7125-45f4-9ece-d2ed0fb48125) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:27:19 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0d80d768-c166-4ee7-a437-a25b44c9de95 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc585cf7-f22f-4c50-8621-919c9bd6e7b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:27:19 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-0d80d768-c166-4ee7-a437-a25b44c9de95 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Volume d9e19d2f-334e-4c39-b8f6-429f4dcd948a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9e19d2f-334e-4c39-b8f6-429f4dcd948a', 'volume_size': 1} Sep 15 16:27:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-0d80d768-c166-4ee7-a437-a25b44c9de95 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:27:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-af2eb864-84f7-478d-b3e5-4730a615f743 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-7ca395ce-a4c2-4365-a555-6ae6ae248994 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:19 devstack sudo[99675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-7ca395ce-a4c2-4365-a555-6ae6ae248994 Sep 15 16:27:19 devstack sudo[99675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:19 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-8580a48f-b9bc-4257-89a2-e695804865e1 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:27:19 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8580a48f-b9bc-4257-89a2-e695804865e1 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Flow 'volume_create_manager' (3ac46b6a-32be-446a-b196-ffb185393d69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:27:19 devstack sudo[99675]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:19 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8580a48f-b9bc-4257-89a2-e695804865e1 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40f6ac00-6abf-43e7-8581-856412a5fdac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:27:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-af2eb864-84f7-478d-b3e5-4730a615f743 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-7ca395ce-a4c2-4365-a555-6ae6ae248994" returned: 0 in 0.445s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:19 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-af2eb864-84f7-478d-b3e5-4730a615f743 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] <== create_volume: return (1295ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:27:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-af2eb864-84f7-478d-b3e5-4730a615f743 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.299s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:27:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-0d378ff6-c99e-4e40-ad4c-d33357041ea6 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.207s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:27:19 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-0d378ff6-c99e-4e40-ad4c-d33357041ea6 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:27:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-497194994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3df80ac-892a-48ee-9096-d8dffd2e6d1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91bd5572404b4e8b8879831a265b8538',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:27:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:27:18Z,use_quota=True,user_id='6ba9eaf8b7224b12976539a1afcbf136',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:27:19 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-0d378ff6-c99e-4e40-ad4c-d33357041ea6 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Creating volume e3df80ac-892a-48ee-9096-d8dffd2e6d1a {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:27:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-0d378ff6-c99e-4e40-ad4c-d33357041ea6 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:27:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-0d378ff6-c99e-4e40-ad4c-d33357041ea6 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:27:19 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-0d378ff6-c99e-4e40-ad4c-d33357041ea6 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:27:19 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-0d378ff6-c99e-4e40-ad4c-d33357041ea6 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:27:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-0d378ff6-c99e-4e40-ad4c-d33357041ea6 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:27:19 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-0d378ff6-c99e-4e40-ad4c-d33357041ea6 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:27:19 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-0d378ff6-c99e-4e40-ad4c-d33357041ea6 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:27:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0d378ff6-c99e-4e40-ad4c-d33357041ea6 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-e3df80ac-892a-48ee-9096-d8dffd2e6d1a 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:20 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-af2eb864-84f7-478d-b3e5-4730a615f743 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (723ac3ee-df9e-4bd0-9748-4eaa3c72b4c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ca395ce-a4c2-4365-a555-6ae6ae248994', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:27:20 devstack sudo[99678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-e3df80ac-892a-48ee-9096-d8dffd2e6d1a 1073741824 Sep 15 16:27:20 devstack sudo[99678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:20 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-af2eb864-84f7-478d-b3e5-4730a615f743 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1518b60-1b28-4d3c-8f97-82c15c82ad6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:27:20 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8580a48f-b9bc-4257-89a2-e695804865e1 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40f6ac00-6abf-43e7-8581-856412a5fdac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:27:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1885586021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19de3ce6-41b5-4901-9116-6fee71d03ab6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91bd5572404b4e8b8879831a265b8538',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:27:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:27:20Z,use_quota=True,user_id='6ba9eaf8b7224b12976539a1afcbf136',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:27:20 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8580a48f-b9bc-4257-89a2-e695804865e1 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec8fe063-b540-4ee5-b057-bdf2e03f37e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:27:20 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8580a48f-b9bc-4257-89a2-e695804865e1 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec8fe063-b540-4ee5-b057-bdf2e03f37e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:27:20 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8580a48f-b9bc-4257-89a2-e695804865e1 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bd676a8-38c6-4dee-9423-d75bbbfafe57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:27:20 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8580a48f-b9bc-4257-89a2-e695804865e1 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bd676a8-38c6-4dee-9423-d75bbbfafe57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19de3ce6-41b5-4901-9116-6fee71d03ab6', 'volume_name': 'volume-19de3ce6-41b5-4901-9116-6fee71d03ab6', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:27:20 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8580a48f-b9bc-4257-89a2-e695804865e1 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79a25d7f-e37e-43eb-bc2a-707e90996f5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:27:20 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8580a48f-b9bc-4257-89a2-e695804865e1 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79a25d7f-e37e-43eb-bc2a-707e90996f5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:27:20 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8580a48f-b9bc-4257-89a2-e695804865e1 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04a454aa-351b-43e3-83f9-dfc7f6656bfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:27:20 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-8580a48f-b9bc-4257-89a2-e695804865e1 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Volume 19de3ce6-41b5-4901-9116-6fee71d03ab6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19de3ce6-41b5-4901-9116-6fee71d03ab6', 'volume_size': 1} Sep 15 16:27:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-8580a48f-b9bc-4257-89a2-e695804865e1 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:27:20 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-af2eb864-84f7-478d-b3e5-4730a615f743 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Volume volume-7ca395ce-a4c2-4365-a555-6ae6ae248994 (7ca395ce-a4c2-4365-a555-6ae6ae248994): created successfully Sep 15 16:27:20 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-af2eb864-84f7-478d-b3e5-4730a615f743 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1518b60-1b28-4d3c-8f97-82c15c82ad6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:27:20 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-af2eb864-84f7-478d-b3e5-4730a615f743 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Flow 'volume_create_manager' (1daaeb9f-eb96-4c12-8570-2672d5fa0f76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:27:20 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-af2eb864-84f7-478d-b3e5-4730a615f743 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Created volume successfully. Sep 15 16:27:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-4bf099c1-63ea-4c1d-a7cc-62bfe34aff99 tempest-SnapshotsActionsTest-82182000 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:27:20 devstack sudo[99678]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0d378ff6-c99e-4e40-ad4c-d33357041ea6 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-e3df80ac-892a-48ee-9096-d8dffd2e6d1a 1073741824" returned: 0 in 0.539s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0d378ff6-c99e-4e40-ad4c-d33357041ea6 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-e3df80ac-892a-48ee-9096-d8dffd2e6d1a {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:20 devstack sudo[99683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-e3df80ac-892a-48ee-9096-d8dffd2e6d1a Sep 15 16:27:20 devstack sudo[99683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:20 devstack sudo[99683]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0d378ff6-c99e-4e40-ad4c-d33357041ea6 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-e3df80ac-892a-48ee-9096-d8dffd2e6d1a" returned: 0 in 0.296s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:20 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-0d378ff6-c99e-4e40-ad4c-d33357041ea6 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] <== create_volume: return (892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:27:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-0d378ff6-c99e-4e40-ad4c-d33357041ea6 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.896s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:27:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-334fc802-315d-480b-a93b-a1f004fa366b tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.864s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:27:20 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-334fc802-315d-480b-a93b-a1f004fa366b tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:27:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-304524886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=334bf406-c9fb-4808-b1da-d48fc3c72aa3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91bd5572404b4e8b8879831a265b8538',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:27:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:27:19Z,use_quota=True,user_id='6ba9eaf8b7224b12976539a1afcbf136',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:27:20 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-334fc802-315d-480b-a93b-a1f004fa366b tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Creating volume 334bf406-c9fb-4808-b1da-d48fc3c72aa3 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:27:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-334fc802-315d-480b-a93b-a1f004fa366b tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:27:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-334fc802-315d-480b-a93b-a1f004fa366b tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:27:20 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-334fc802-315d-480b-a93b-a1f004fa366b tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:27:20 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-334fc802-315d-480b-a93b-a1f004fa366b tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:27:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-334fc802-315d-480b-a93b-a1f004fa366b tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:27:20 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-334fc802-315d-480b-a93b-a1f004fa366b tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:27:20 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-334fc802-315d-480b-a93b-a1f004fa366b tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:27:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-334fc802-315d-480b-a93b-a1f004fa366b tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-334bf406-c9fb-4808-b1da-d48fc3c72aa3 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:20 devstack sudo[99686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-334bf406-c9fb-4808-b1da-d48fc3c72aa3 1073741824 Sep 15 16:27:20 devstack sudo[99686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:20 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0d378ff6-c99e-4e40-ad4c-d33357041ea6 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f36e5816-9bd4-400d-875a-e44672c56a8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3df80ac-892a-48ee-9096-d8dffd2e6d1a', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:27:20 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0d378ff6-c99e-4e40-ad4c-d33357041ea6 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc8af898-d6ef-4540-8986-398b8f933ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:27:20 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-0d378ff6-c99e-4e40-ad4c-d33357041ea6 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Volume volume-e3df80ac-892a-48ee-9096-d8dffd2e6d1a (e3df80ac-892a-48ee-9096-d8dffd2e6d1a): created successfully Sep 15 16:27:20 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0d378ff6-c99e-4e40-ad4c-d33357041ea6 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc8af898-d6ef-4540-8986-398b8f933ba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:27:20 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0d378ff6-c99e-4e40-ad4c-d33357041ea6 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Flow 'volume_create_manager' (09ce7a59-b3cd-4e07-81e9-a237a92d27fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:27:21 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-0d378ff6-c99e-4e40-ad4c-d33357041ea6 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Created volume successfully. Sep 15 16:27:21 devstack sudo[99686]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-334fc802-315d-480b-a93b-a1f004fa366b tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-334bf406-c9fb-4808-b1da-d48fc3c72aa3 1073741824" returned: 0 in 0.511s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-334fc802-315d-480b-a93b-a1f004fa366b tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-334bf406-c9fb-4808-b1da-d48fc3c72aa3 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:21 devstack sudo[99692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-334bf406-c9fb-4808-b1da-d48fc3c72aa3 Sep 15 16:27:21 devstack sudo[99692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:21 devstack sudo[99692]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-334fc802-315d-480b-a93b-a1f004fa366b tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-334bf406-c9fb-4808-b1da-d48fc3c72aa3" returned: 0 in 0.291s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:21 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-334fc802-315d-480b-a93b-a1f004fa366b tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] <== create_volume: return (865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:27:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-334fc802-315d-480b-a93b-a1f004fa366b tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.868s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:27:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-0d80d768-c166-4ee7-a437-a25b44c9de95 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.292s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:27:21 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-0d80d768-c166-4ee7-a437-a25b44c9de95 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:27:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1412367803',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9e19d2f-334e-4c39-b8f6-429f4dcd948a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91bd5572404b4e8b8879831a265b8538',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:27:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:27:19Z,use_quota=True,user_id='6ba9eaf8b7224b12976539a1afcbf136',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:27:21 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-0d80d768-c166-4ee7-a437-a25b44c9de95 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Creating volume d9e19d2f-334e-4c39-b8f6-429f4dcd948a {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:27:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-0d80d768-c166-4ee7-a437-a25b44c9de95 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:27:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-0d80d768-c166-4ee7-a437-a25b44c9de95 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:27:21 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-0d80d768-c166-4ee7-a437-a25b44c9de95 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:27:21 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-0d80d768-c166-4ee7-a437-a25b44c9de95 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:27:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-0d80d768-c166-4ee7-a437-a25b44c9de95 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:27:21 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-0d80d768-c166-4ee7-a437-a25b44c9de95 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:27:21 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-0d80d768-c166-4ee7-a437-a25b44c9de95 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:27:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0d80d768-c166-4ee7-a437-a25b44c9de95 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-d9e19d2f-334e-4c39-b8f6-429f4dcd948a 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:21 devstack sudo[99695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-d9e19d2f-334e-4c39-b8f6-429f4dcd948a 1073741824 Sep 15 16:27:21 devstack sudo[99695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-334fc802-315d-480b-a93b-a1f004fa366b tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c902642-4c87-4144-89b4-5ad955675bcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-334bf406-c9fb-4808-b1da-d48fc3c72aa3', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:27:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-334fc802-315d-480b-a93b-a1f004fa366b tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25245075-04bd-4b84-8ee3-04196f4db110) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:27:21 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-334fc802-315d-480b-a93b-a1f004fa366b tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Volume volume-334bf406-c9fb-4808-b1da-d48fc3c72aa3 (334bf406-c9fb-4808-b1da-d48fc3c72aa3): created successfully Sep 15 16:27:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-334fc802-315d-480b-a93b-a1f004fa366b tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25245075-04bd-4b84-8ee3-04196f4db110) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:27:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-334fc802-315d-480b-a93b-a1f004fa366b tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Flow 'volume_create_manager' (6c98b043-ccb2-4af7-8a8e-6349bff68335) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:27:21 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-334fc802-315d-480b-a93b-a1f004fa366b tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Created volume successfully. Sep 15 16:27:22 devstack sudo[99695]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0d80d768-c166-4ee7-a437-a25b44c9de95 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-d9e19d2f-334e-4c39-b8f6-429f4dcd948a 1073741824" returned: 0 in 0.483s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0d80d768-c166-4ee7-a437-a25b44c9de95 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-d9e19d2f-334e-4c39-b8f6-429f4dcd948a {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:22 devstack sudo[99701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-d9e19d2f-334e-4c39-b8f6-429f4dcd948a Sep 15 16:27:22 devstack sudo[99701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:22 devstack sudo[99701]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0d80d768-c166-4ee7-a437-a25b44c9de95 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-d9e19d2f-334e-4c39-b8f6-429f4dcd948a" returned: 0 in 0.260s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:22 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-0d80d768-c166-4ee7-a437-a25b44c9de95 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] <== create_volume: return (796ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:27:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-0d80d768-c166-4ee7-a437-a25b44c9de95 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.801s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:27:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-8580a48f-b9bc-4257-89a2-e695804865e1 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.474s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:27:22 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-8580a48f-b9bc-4257-89a2-e695804865e1 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:27:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1885586021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19de3ce6-41b5-4901-9116-6fee71d03ab6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91bd5572404b4e8b8879831a265b8538',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:27:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:27:20Z,use_quota=True,user_id='6ba9eaf8b7224b12976539a1afcbf136',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:27:22 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-8580a48f-b9bc-4257-89a2-e695804865e1 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Creating volume 19de3ce6-41b5-4901-9116-6fee71d03ab6 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:27:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-8580a48f-b9bc-4257-89a2-e695804865e1 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:27:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-8580a48f-b9bc-4257-89a2-e695804865e1 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:27:22 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-8580a48f-b9bc-4257-89a2-e695804865e1 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:27:22 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-8580a48f-b9bc-4257-89a2-e695804865e1 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:27:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-8580a48f-b9bc-4257-89a2-e695804865e1 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:27:22 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-8580a48f-b9bc-4257-89a2-e695804865e1 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:27:22 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-8580a48f-b9bc-4257-89a2-e695804865e1 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:27:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8580a48f-b9bc-4257-89a2-e695804865e1 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-19de3ce6-41b5-4901-9116-6fee71d03ab6 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:22 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0d80d768-c166-4ee7-a437-a25b44c9de95 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc585cf7-f22f-4c50-8621-919c9bd6e7b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9e19d2f-334e-4c39-b8f6-429f4dcd948a', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:27:22 devstack sudo[99704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-19de3ce6-41b5-4901-9116-6fee71d03ab6 1073741824 Sep 15 16:27:22 devstack sudo[99704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:22 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0d80d768-c166-4ee7-a437-a25b44c9de95 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec9773de-737c-4209-b9ed-2b715237f1c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:27:22 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-0d80d768-c166-4ee7-a437-a25b44c9de95 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Volume volume-d9e19d2f-334e-4c39-b8f6-429f4dcd948a (d9e19d2f-334e-4c39-b8f6-429f4dcd948a): created successfully Sep 15 16:27:22 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0d80d768-c166-4ee7-a437-a25b44c9de95 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec9773de-737c-4209-b9ed-2b715237f1c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:27:22 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0d80d768-c166-4ee7-a437-a25b44c9de95 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Flow 'volume_create_manager' (1d102de7-7083-4008-ab2e-951f03f2280e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:27:22 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-0d80d768-c166-4ee7-a437-a25b44c9de95 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Created volume successfully. Sep 15 16:27:23 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b8e43ec-220e-4679-b2b6-e7ddb0d85c04 tempest-VolumesListTestJSON-507613894 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:27:23 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1b8e43ec-220e-4679-b2b6-e7ddb0d85c04 tempest-VolumesListTestJSON-507613894 None] Flow 'volume_create_manager' (1a83579c-8b5b-4001-9ae3-fc13263fec97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:27:23 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1b8e43ec-220e-4679-b2b6-e7ddb0d85c04 tempest-VolumesListTestJSON-507613894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffc75a78-b874-4edc-a5a7-d8f79e32316f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:27:23 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1b8e43ec-220e-4679-b2b6-e7ddb0d85c04 tempest-VolumesListTestJSON-507613894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffc75a78-b874-4edc-a5a7-d8f79e32316f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:27:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-259656433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91d81228-c564-4435-8341-e2d7a16ada06,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e4cde12bbd2c4451b91ea8902724d05c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:27:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:27:23Z,use_quota=True,user_id='a0d2bcda4a7d48349d11013b3bb91907',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:27:23 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1b8e43ec-220e-4679-b2b6-e7ddb0d85c04 tempest-VolumesListTestJSON-507613894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7728285-f1ae-4a44-ad97-dc74341aed85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:27:23 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1b8e43ec-220e-4679-b2b6-e7ddb0d85c04 tempest-VolumesListTestJSON-507613894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7728285-f1ae-4a44-ad97-dc74341aed85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:27:23 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1b8e43ec-220e-4679-b2b6-e7ddb0d85c04 tempest-VolumesListTestJSON-507613894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17decb2e-55b4-42f8-8cac-5e6a27bca723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:27:23 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1b8e43ec-220e-4679-b2b6-e7ddb0d85c04 tempest-VolumesListTestJSON-507613894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17decb2e-55b4-42f8-8cac-5e6a27bca723) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91d81228-c564-4435-8341-e2d7a16ada06', 'volume_name': 'volume-91d81228-c564-4435-8341-e2d7a16ada06', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:27:23 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1b8e43ec-220e-4679-b2b6-e7ddb0d85c04 tempest-VolumesListTestJSON-507613894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad26458e-470b-4e76-8d2f-95bf532c00f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:27:23 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1b8e43ec-220e-4679-b2b6-e7ddb0d85c04 tempest-VolumesListTestJSON-507613894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad26458e-470b-4e76-8d2f-95bf532c00f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:27:23 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1b8e43ec-220e-4679-b2b6-e7ddb0d85c04 tempest-VolumesListTestJSON-507613894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8cb1c50-d40e-4213-8e31-f9b6526fd9e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:27:23 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-1b8e43ec-220e-4679-b2b6-e7ddb0d85c04 tempest-VolumesListTestJSON-507613894 None] Volume 91d81228-c564-4435-8341-e2d7a16ada06: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91d81228-c564-4435-8341-e2d7a16ada06', 'volume_size': 1} Sep 15 16:27:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-1b8e43ec-220e-4679-b2b6-e7ddb0d85c04 tempest-VolumesListTestJSON-507613894 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:27:23 devstack sudo[99704]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8580a48f-b9bc-4257-89a2-e695804865e1 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-19de3ce6-41b5-4901-9116-6fee71d03ab6 1073741824" returned: 0 in 0.570s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8580a48f-b9bc-4257-89a2-e695804865e1 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-19de3ce6-41b5-4901-9116-6fee71d03ab6 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:23 devstack sudo[99713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-19de3ce6-41b5-4901-9116-6fee71d03ab6 Sep 15 16:27:23 devstack sudo[99713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:23 devstack sudo[99713]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8580a48f-b9bc-4257-89a2-e695804865e1 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-19de3ce6-41b5-4901-9116-6fee71d03ab6" returned: 0 in 0.277s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:23 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-8580a48f-b9bc-4257-89a2-e695804865e1 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:27:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-8580a48f-b9bc-4257-89a2-e695804865e1 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.894s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:27:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-4bf099c1-63ea-4c1d-a7cc-62bfe34aff99 tempest-SnapshotsActionsTest-82182000 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.233s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:27:23 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8580a48f-b9bc-4257-89a2-e695804865e1 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04a454aa-351b-43e3-83f9-dfc7f6656bfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19de3ce6-41b5-4901-9116-6fee71d03ab6', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:27:23 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8580a48f-b9bc-4257-89a2-e695804865e1 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bb36256-9625-4a5c-b73a-f8c7dc089a16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:27:23 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-4bf099c1-63ea-4c1d-a7cc-62bfe34aff99 tempest-SnapshotsActionsTest-82182000 None] Creating offline snapshot 863742e5-9c33-416c-9b51-107c511fd033 of volume 279826cc-e702-4b37-9791-7965cec669f5 {{(pid=86082) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 15 16:27:23 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-8580a48f-b9bc-4257-89a2-e695804865e1 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Volume volume-19de3ce6-41b5-4901-9116-6fee71d03ab6 (19de3ce6-41b5-4901-9116-6fee71d03ab6): created successfully Sep 15 16:27:23 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8580a48f-b9bc-4257-89a2-e695804865e1 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bb36256-9625-4a5c-b73a-f8c7dc089a16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:27:23 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8580a48f-b9bc-4257-89a2-e695804865e1 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Flow 'volume_create_manager' (3ac46b6a-32be-446a-b196-ffb185393d69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:27:23 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[8960d22b-738d-4542-929a-6a735a43a85d]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:27:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4bf099c1-63ea-4c1d-a7cc-62bfe34aff99 tempest-SnapshotsActionsTest-82182000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.df37eddb-733c-42b7-b8aa-ff40e6de1acf {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:23 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-8580a48f-b9bc-4257-89a2-e695804865e1 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Created volume successfully. Sep 15 16:27:23 devstack sudo[99716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.df37eddb-733c-42b7-b8aa-ff40e6de1acf Sep 15 16:27:23 devstack sudo[99716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:23 devstack sudo[99716]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4bf099c1-63ea-4c1d-a7cc-62bfe34aff99 tempest-SnapshotsActionsTest-82182000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.df37eddb-733c-42b7-b8aa-ff40e6de1acf" returned: 0 in 0.433s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:23 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-4bf099c1-63ea-4c1d-a7cc-62bfe34aff99 tempest-SnapshotsActionsTest-82182000 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-279826cc-e702-4b37-9791-7965cec669f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 16:27:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4bf099c1-63ea-4c1d-a7cc-62bfe34aff99 tempest-SnapshotsActionsTest-82182000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.df37eddb-733c-42b7-b8aa-ff40e6de1acf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.863742e5-9c33-416c-9b51-107c511fd033 1G {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:24 devstack sudo[99722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.df37eddb-733c-42b7-b8aa-ff40e6de1acf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.863742e5-9c33-416c-9b51-107c511fd033 1G Sep 15 16:27:24 devstack sudo[99722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:24 devstack sudo[99722]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:24 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-271f878c-c8a8-4212-857e-60b89a2ddb1c tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Acquiring lock "cinder-19de3ce6-41b5-4901-9116-6fee71d03ab6-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:27:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4bf099c1-63ea-4c1d-a7cc-62bfe34aff99 tempest-SnapshotsActionsTest-82182000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.df37eddb-733c-42b7-b8aa-ff40e6de1acf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.863742e5-9c33-416c-9b51-107c511fd033 1G" returned: 0 in 0.679s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4bf099c1-63ea-4c1d-a7cc-62bfe34aff99 tempest-SnapshotsActionsTest-82182000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-279826cc-e702-4b37-9791-7965cec669f5.df37eddb-733c-42b7-b8aa-ff40e6de1acf -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.863742e5-9c33-416c-9b51-107c511fd033 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:24 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-271f878c-c8a8-4212-857e-60b89a2ddb1c tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Lock "cinder-19de3ce6-41b5-4901-9116-6fee71d03ab6-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:27:24 devstack sudo[99728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-279826cc-e702-4b37-9791-7965cec669f5.df37eddb-733c-42b7-b8aa-ff40e6de1acf -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.863742e5-9c33-416c-9b51-107c511fd033 Sep 15 16:27:24 devstack sudo[99728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:24 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-271f878c-c8a8-4212-857e-60b89a2ddb1c tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Acquiring lock "cinder-quobyte-19de3ce6-41b5-4901-9116-6fee71d03ab6" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:27:24 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-271f878c-c8a8-4212-857e-60b89a2ddb1c tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Lock "cinder-quobyte-19de3ce6-41b5-4901-9116-6fee71d03ab6" acquired by "delete_volume" :: waited 0.025s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:27:24 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[e647e4b3-06ea-436c-89f1-94311e0972a5]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:27:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-271f878c-c8a8-4212-857e-60b89a2ddb1c tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-19de3ce6-41b5-4901-9116-6fee71d03ab6 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:24 devstack sudo[99730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-19de3ce6-41b5-4901-9116-6fee71d03ab6 Sep 15 16:27:24 devstack sudo[99730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:25 devstack sudo[99728]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4bf099c1-63ea-4c1d-a7cc-62bfe34aff99 tempest-SnapshotsActionsTest-82182000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-279826cc-e702-4b37-9791-7965cec669f5.df37eddb-733c-42b7-b8aa-ff40e6de1acf -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.863742e5-9c33-416c-9b51-107c511fd033" returned: 0 in 0.398s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:25 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-4bf099c1-63ea-4c1d-a7cc-62bfe34aff99 tempest-SnapshotsActionsTest-82182000 None] /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.863742e5-9c33-416c-9b51-107c511fd033 is being set with open permissions: ugo+rw Sep 15 16:27:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4bf099c1-63ea-4c1d-a7cc-62bfe34aff99 tempest-SnapshotsActionsTest-82182000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.863742e5-9c33-416c-9b51-107c511fd033 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:25 devstack sudo[99736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.863742e5-9c33-416c-9b51-107c511fd033 Sep 15 16:27:25 devstack sudo[99736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:25 devstack sudo[99730]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-271f878c-c8a8-4212-857e-60b89a2ddb1c tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-19de3ce6-41b5-4901-9116-6fee71d03ab6" returned: 0 in 0.481s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-271f878c-c8a8-4212-857e-60b89a2ddb1c tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-19de3ce6-41b5-4901-9116-6fee71d03ab6 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:25 devstack sudo[99743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-19de3ce6-41b5-4901-9116-6fee71d03ab6 Sep 15 16:27:25 devstack sudo[99743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:25 devstack sudo[99736]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4bf099c1-63ea-4c1d-a7cc-62bfe34aff99 tempest-SnapshotsActionsTest-82182000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.863742e5-9c33-416c-9b51-107c511fd033" returned: 0 in 0.333s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-4bf099c1-63ea-4c1d-a7cc-62bfe34aff99 tempest-SnapshotsActionsTest-82182000 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.996s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:27:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-1b8e43ec-220e-4679-b2b6-e7ddb0d85c04 tempest-VolumesListTestJSON-507613894 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.341s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:27:25 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-1b8e43ec-220e-4679-b2b6-e7ddb0d85c04 tempest-VolumesListTestJSON-507613894 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:27:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-259656433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91d81228-c564-4435-8341-e2d7a16ada06,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e4cde12bbd2c4451b91ea8902724d05c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:27:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:27:23Z,use_quota=True,user_id='a0d2bcda4a7d48349d11013b3bb91907',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:27:25 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-1b8e43ec-220e-4679-b2b6-e7ddb0d85c04 tempest-VolumesListTestJSON-507613894 None] Creating volume 91d81228-c564-4435-8341-e2d7a16ada06 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:27:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-1b8e43ec-220e-4679-b2b6-e7ddb0d85c04 tempest-VolumesListTestJSON-507613894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:27:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-1b8e43ec-220e-4679-b2b6-e7ddb0d85c04 tempest-VolumesListTestJSON-507613894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:27:25 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-1b8e43ec-220e-4679-b2b6-e7ddb0d85c04 tempest-VolumesListTestJSON-507613894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:27:25 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-1b8e43ec-220e-4679-b2b6-e7ddb0d85c04 tempest-VolumesListTestJSON-507613894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:27:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-1b8e43ec-220e-4679-b2b6-e7ddb0d85c04 tempest-VolumesListTestJSON-507613894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:27:25 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-1b8e43ec-220e-4679-b2b6-e7ddb0d85c04 tempest-VolumesListTestJSON-507613894 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:27:25 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-1b8e43ec-220e-4679-b2b6-e7ddb0d85c04 tempest-VolumesListTestJSON-507613894 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:27:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-1b8e43ec-220e-4679-b2b6-e7ddb0d85c04 tempest-VolumesListTestJSON-507613894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-91d81228-c564-4435-8341-e2d7a16ada06 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:25 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-4bf099c1-63ea-4c1d-a7cc-62bfe34aff99 tempest-SnapshotsActionsTest-82182000 None] Create snapshot completed successfully Sep 15 16:27:25 devstack sudo[99746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-91d81228-c564-4435-8341-e2d7a16ada06 1073741824 Sep 15 16:27:25 devstack sudo[99746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:25 devstack sudo[99743]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-271f878c-c8a8-4212-857e-60b89a2ddb1c tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-19de3ce6-41b5-4901-9116-6fee71d03ab6" returned: 0 in 0.357s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:25 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-271f878c-c8a8-4212-857e-60b89a2ddb1c tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Lock "cinder-quobyte-19de3ce6-41b5-4901-9116-6fee71d03ab6" released by "delete_volume" :: held 0.902s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:27:25 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-271f878c-c8a8-4212-857e-60b89a2ddb1c tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Created reservations ['4d8da176-dd9f-45eb-b20c-ad78fbdebb54', '01ec0b5c-42f8-4963-aa1b-e581bc37ee4e', 'a508205b-3594-4f21-94ab-bc57425fbaae', 'abd648e3-3e3b-4052-bf4c-0208251af6a8'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:27:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-271f878c-c8a8-4212-857e-60b89a2ddb1c tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:27:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-271f878c-c8a8-4212-857e-60b89a2ddb1c tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:27:25 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-271f878c-c8a8-4212-857e-60b89a2ddb1c tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:27:25 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-271f878c-c8a8-4212-857e-60b89a2ddb1c tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:27:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-271f878c-c8a8-4212-857e-60b89a2ddb1c tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:27:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-271f878c-c8a8-4212-857e-60b89a2ddb1c tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:25 devstack sudo[99752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:27:25 devstack sudo[99752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:26 devstack cinder-volume[86082]: INFO cinder.volume.manager [req-de3d85fc-2930-428a-884a-7b73608fc83c req-d5d73cc3-4337-49cd-a263-2b2342a67d6d tempest-TestMinimumBasicScenario-827702894 None] Terminate volume connection completed successfully. Sep 15 16:27:26 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-de3d85fc-2930-428a-884a-7b73608fc83c req-d5d73cc3-4337-49cd-a263-2b2342a67d6d tempest-TestMinimumBasicScenario-827702894 None] Deleting attachment 77022391-103f-4a4b-a0e5-77dfdf352fe1. {{(pid=86082) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 15 16:27:26 devstack sudo[99746]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-1b8e43ec-220e-4679-b2b6-e7ddb0d85c04 tempest-VolumesListTestJSON-507613894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-91d81228-c564-4435-8341-e2d7a16ada06 1073741824" returned: 0 in 0.652s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-1b8e43ec-220e-4679-b2b6-e7ddb0d85c04 tempest-VolumesListTestJSON-507613894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-91d81228-c564-4435-8341-e2d7a16ada06 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:26 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-259db793-0fe5-48d5-afe3-c03e23149b79 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Acquiring lock "cinder-d9e19d2f-334e-4c39-b8f6-429f4dcd948a-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:27:26 devstack sudo[99759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-91d81228-c564-4435-8341-e2d7a16ada06 Sep 15 16:27:26 devstack sudo[99759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:26 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-259db793-0fe5-48d5-afe3-c03e23149b79 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Lock "cinder-d9e19d2f-334e-4c39-b8f6-429f4dcd948a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:27:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-271f878c-c8a8-4212-857e-60b89a2ddb1c tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.378s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:26 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-271f878c-c8a8-4212-857e-60b89a2ddb1c tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:27:26 devstack sudo[99752]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:26 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-271f878c-c8a8-4212-857e-60b89a2ddb1c tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Deleted volume successfully. Sep 15 16:27:26 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-259db793-0fe5-48d5-afe3-c03e23149b79 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Acquiring lock "cinder-quobyte-d9e19d2f-334e-4c39-b8f6-429f4dcd948a" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:27:26 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-271f878c-c8a8-4212-857e-60b89a2ddb1c tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Lock "cinder-19de3ce6-41b5-4901-9116-6fee71d03ab6-delete_volume" released by "delete_volume" :: held 1.584s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:27:26 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-259db793-0fe5-48d5-afe3-c03e23149b79 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Lock "cinder-quobyte-d9e19d2f-334e-4c39-b8f6-429f4dcd948a" acquired by "delete_volume" :: waited 0.041s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:27:26 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fa0783a-3d18-48ba-9d3f-babb6691f2e2]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:27:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-259db793-0fe5-48d5-afe3-c03e23149b79 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-d9e19d2f-334e-4c39-b8f6-429f4dcd948a {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:26 devstack sudo[99761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-d9e19d2f-334e-4c39-b8f6-429f4dcd948a Sep 15 16:27:26 devstack sudo[99761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:26 devstack sudo[99759]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-1b8e43ec-220e-4679-b2b6-e7ddb0d85c04 tempest-VolumesListTestJSON-507613894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-91d81228-c564-4435-8341-e2d7a16ada06" returned: 0 in 0.380s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:26 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-1b8e43ec-220e-4679-b2b6-e7ddb0d85c04 tempest-VolumesListTestJSON-507613894 None] <== create_volume: return (1095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:27:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-1b8e43ec-220e-4679-b2b6-e7ddb0d85c04 tempest-VolumesListTestJSON-507613894 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.103s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:27:26 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1b8e43ec-220e-4679-b2b6-e7ddb0d85c04 tempest-VolumesListTestJSON-507613894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8cb1c50-d40e-4213-8e31-f9b6526fd9e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91d81228-c564-4435-8341-e2d7a16ada06', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:27:26 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1b8e43ec-220e-4679-b2b6-e7ddb0d85c04 tempest-VolumesListTestJSON-507613894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28b271c0-a9a9-42a7-b301-f98012355c28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:27:26 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-1b8e43ec-220e-4679-b2b6-e7ddb0d85c04 tempest-VolumesListTestJSON-507613894 None] Volume volume-91d81228-c564-4435-8341-e2d7a16ada06 (91d81228-c564-4435-8341-e2d7a16ada06): created successfully Sep 15 16:27:26 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1b8e43ec-220e-4679-b2b6-e7ddb0d85c04 tempest-VolumesListTestJSON-507613894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28b271c0-a9a9-42a7-b301-f98012355c28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:27:26 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1b8e43ec-220e-4679-b2b6-e7ddb0d85c04 tempest-VolumesListTestJSON-507613894 None] Flow 'volume_create_manager' (1a83579c-8b5b-4001-9ae3-fc13263fec97) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:27:26 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-e9979998-fd17-4045-a165-eee2f7cef5a9 tempest-SnapshotsActionsTest-949396253 None] Acquiring lock "cinder-863742e5-9c33-416c-9b51-107c511fd033-delete_snapshot" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:27:26 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-1b8e43ec-220e-4679-b2b6-e7ddb0d85c04 tempest-VolumesListTestJSON-507613894 None] Created volume successfully. Sep 15 16:27:26 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-e9979998-fd17-4045-a165-eee2f7cef5a9 tempest-SnapshotsActionsTest-949396253 None] Lock "cinder-863742e5-9c33-416c-9b51-107c511fd033-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:27:26 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-e9979998-fd17-4045-a165-eee2f7cef5a9 tempest-SnapshotsActionsTest-949396253 None] Acquiring lock "cinder-quobyte-279826cc-e702-4b37-9791-7965cec669f5" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:27:26 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-e9979998-fd17-4045-a165-eee2f7cef5a9 tempest-SnapshotsActionsTest-949396253 None] Lock "cinder-quobyte-279826cc-e702-4b37-9791-7965cec669f5" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:27:26 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-e9979998-fd17-4045-a165-eee2f7cef5a9 tempest-SnapshotsActionsTest-949396253 None] Acquiring lock "cinder-quobyte-863742e5-9c33-416c-9b51-107c511fd033" by "_delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:27:26 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-e9979998-fd17-4045-a165-eee2f7cef5a9 tempest-SnapshotsActionsTest-949396253 None] Lock "cinder-quobyte-863742e5-9c33-416c-9b51-107c511fd033" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:27:26 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-e9979998-fd17-4045-a165-eee2f7cef5a9 tempest-SnapshotsActionsTest-949396253 None] Deleting offline snapshot 863742e5-9c33-416c-9b51-107c511fd033 of volume 279826cc-e702-4b37-9791-7965cec669f5 {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 15 16:27:26 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-e9979998-fd17-4045-a165-eee2f7cef5a9 tempest-SnapshotsActionsTest-949396253 None] snapshot_file for this snap is: volume-279826cc-e702-4b37-9791-7965cec669f5.863742e5-9c33-416c-9b51-107c511fd033 {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 15 16:27:26 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1d72e3c-d011-4134-a953-eb7ded451ec4]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:27:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e9979998-fd17-4045-a165-eee2f7cef5a9 tempest-SnapshotsActionsTest-949396253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.863742e5-9c33-416c-9b51-107c511fd033 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:26 devstack sudo[99761]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-259db793-0fe5-48d5-afe3-c03e23149b79 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-d9e19d2f-334e-4c39-b8f6-429f4dcd948a" returned: 0 in 0.452s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-259db793-0fe5-48d5-afe3-c03e23149b79 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-d9e19d2f-334e-4c39-b8f6-429f4dcd948a {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:26 devstack sudo[99770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-d9e19d2f-334e-4c39-b8f6-429f4dcd948a Sep 15 16:27:26 devstack sudo[99770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:26 devstack sudo[99767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.863742e5-9c33-416c-9b51-107c511fd033 Sep 15 16:27:26 devstack sudo[99767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:26 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-9c1cb5fa-92f8-40be-b8f7-35992b2b67d3 tempest-TestMinimumBasicScenario-827702894 None] Acquiring lock "cinder-cb3b13af-515b-4eda-a1da-df74c7149aa9-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:27:26 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-9c1cb5fa-92f8-40be-b8f7-35992b2b67d3 tempest-TestMinimumBasicScenario-827702894 None] Lock "cinder-cb3b13af-515b-4eda-a1da-df74c7149aa9-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:27:26 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-9c1cb5fa-92f8-40be-b8f7-35992b2b67d3 tempest-TestMinimumBasicScenario-827702894 None] Acquiring lock "cinder-quobyte-cb3b13af-515b-4eda-a1da-df74c7149aa9" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:27:27 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-9c1cb5fa-92f8-40be-b8f7-35992b2b67d3 tempest-TestMinimumBasicScenario-827702894 None] Lock "cinder-quobyte-cb3b13af-515b-4eda-a1da-df74c7149aa9" acquired by "delete_volume" :: waited 0.018s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:27:27 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[56240a78-f320-4e13-b79a-79f112465c61]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:27:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9c1cb5fa-92f8-40be-b8f7-35992b2b67d3 tempest-TestMinimumBasicScenario-827702894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-cb3b13af-515b-4eda-a1da-df74c7149aa9 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:27 devstack sudo[99770]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-259db793-0fe5-48d5-afe3-c03e23149b79 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-d9e19d2f-334e-4c39-b8f6-429f4dcd948a" returned: 0 in 0.290s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:27 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-259db793-0fe5-48d5-afe3-c03e23149b79 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Lock "cinder-quobyte-d9e19d2f-334e-4c39-b8f6-429f4dcd948a" released by "delete_volume" :: held 0.799s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:27:27 devstack sudo[99767]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e9979998-fd17-4045-a165-eee2f7cef5a9 tempest-SnapshotsActionsTest-949396253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.863742e5-9c33-416c-9b51-107c511fd033" returned: 0 in 0.415s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:27 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-e9979998-fd17-4045-a165-eee2f7cef5a9 tempest-SnapshotsActionsTest-949396253 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-279826cc-e702-4b37-9791-7965cec669f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 16:27:27 devstack sudo[99774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-cb3b13af-515b-4eda-a1da-df74c7149aa9 Sep 15 16:27:27 devstack sudo[99774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:27 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bfa32b6-6dc2-43f8-a84a-69cb0dbfd892]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:27:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e9979998-fd17-4045-a165-eee2f7cef5a9 tempest-SnapshotsActionsTest-949396253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.df37eddb-733c-42b7-b8aa-ff40e6de1acf {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:27 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-259db793-0fe5-48d5-afe3-c03e23149b79 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Created reservations ['682083a4-65e1-4880-a153-49b24e883ee7', 'f7f618f5-f66f-40af-bed1-55a0794c228e', '44551829-4991-4515-a00a-b9551b762ae6', 'b8f36988-5c90-4897-9058-af2d97ed3542'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:27:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-259db793-0fe5-48d5-afe3-c03e23149b79 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:27:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-259db793-0fe5-48d5-afe3-c03e23149b79 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:27:27 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-259db793-0fe5-48d5-afe3-c03e23149b79 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:27:27 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-259db793-0fe5-48d5-afe3-c03e23149b79 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:27:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-259db793-0fe5-48d5-afe3-c03e23149b79 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:27:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-259db793-0fe5-48d5-afe3-c03e23149b79 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:27 devstack sudo[99779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.df37eddb-733c-42b7-b8aa-ff40e6de1acf Sep 15 16:27:27 devstack sudo[99779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:27 devstack sudo[99780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:27:27 devstack sudo[99780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:27 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-1530c032-1c56-4997-8f22-1ea6a43fa40d tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Acquiring lock "cinder-334bf406-c9fb-4808-b1da-d48fc3c72aa3-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:27:27 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-1530c032-1c56-4997-8f22-1ea6a43fa40d tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Lock "cinder-334bf406-c9fb-4808-b1da-d48fc3c72aa3-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:27:27 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-1530c032-1c56-4997-8f22-1ea6a43fa40d tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Acquiring lock "cinder-quobyte-334bf406-c9fb-4808-b1da-d48fc3c72aa3" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:27:27 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-1530c032-1c56-4997-8f22-1ea6a43fa40d tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Lock "cinder-quobyte-334bf406-c9fb-4808-b1da-d48fc3c72aa3" acquired by "delete_volume" :: waited 0.015s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:27:27 devstack sudo[99774]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9c1cb5fa-92f8-40be-b8f7-35992b2b67d3 tempest-TestMinimumBasicScenario-827702894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-cb3b13af-515b-4eda-a1da-df74c7149aa9" returned: 0 in 0.514s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9c1cb5fa-92f8-40be-b8f7-35992b2b67d3 tempest-TestMinimumBasicScenario-827702894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-cb3b13af-515b-4eda-a1da-df74c7149aa9 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:27 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[f85ac786-6ef0-44c6-8365-2bdedc1a0e43]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:27:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-1530c032-1c56-4997-8f22-1ea6a43fa40d tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-334bf406-c9fb-4808-b1da-d48fc3c72aa3 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:27 devstack sudo[99786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-cb3b13af-515b-4eda-a1da-df74c7149aa9 Sep 15 16:27:27 devstack sudo[99786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:27 devstack sudo[99780]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-259db793-0fe5-48d5-afe3-c03e23149b79 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.389s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:27 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-259db793-0fe5-48d5-afe3-c03e23149b79 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:27:27 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-259db793-0fe5-48d5-afe3-c03e23149b79 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Deleted volume successfully. Sep 15 16:27:27 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-259db793-0fe5-48d5-afe3-c03e23149b79 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Lock "cinder-d9e19d2f-334e-4c39-b8f6-429f4dcd948a-delete_volume" released by "delete_volume" :: held 1.510s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:27:27 devstack sudo[99779]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e9979998-fd17-4045-a165-eee2f7cef5a9 tempest-SnapshotsActionsTest-949396253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.df37eddb-733c-42b7-b8aa-ff40e6de1acf" returned: 0 in 0.550s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:27 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-e9979998-fd17-4045-a165-eee2f7cef5a9 tempest-SnapshotsActionsTest-949396253 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-279826cc-e702-4b37-9791-7965cec669f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 16:27:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e9979998-fd17-4045-a165-eee2f7cef5a9 tempest-SnapshotsActionsTest-949396253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.863742e5-9c33-416c-9b51-107c511fd033 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:27 devstack sudo[99787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-334bf406-c9fb-4808-b1da-d48fc3c72aa3 Sep 15 16:27:27 devstack sudo[99787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:27 devstack sudo[99794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.863742e5-9c33-416c-9b51-107c511fd033 Sep 15 16:27:27 devstack sudo[99794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:27 devstack sudo[99786]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9c1cb5fa-92f8-40be-b8f7-35992b2b67d3 tempest-TestMinimumBasicScenario-827702894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-cb3b13af-515b-4eda-a1da-df74c7149aa9" returned: 0 in 0.349s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:27 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-9c1cb5fa-92f8-40be-b8f7-35992b2b67d3 tempest-TestMinimumBasicScenario-827702894 None] Lock "cinder-quobyte-cb3b13af-515b-4eda-a1da-df74c7149aa9" released by "delete_volume" :: held 0.923s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:27:28 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-9c1cb5fa-92f8-40be-b8f7-35992b2b67d3 tempest-TestMinimumBasicScenario-827702894 None] Created reservations ['b1b1982f-76dd-4eae-a2a7-53b14b2b0fb0', '26e157de-7149-4287-9878-60919982b166', 'feecfe6f-8a7a-4977-9a52-2d3af07ace5a', '45edb263-0025-4060-b7fd-1a2842407788'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:27:28 devstack sudo[99787]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-1530c032-1c56-4997-8f22-1ea6a43fa40d tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-334bf406-c9fb-4808-b1da-d48fc3c72aa3" returned: 0 in 0.535s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-1530c032-1c56-4997-8f22-1ea6a43fa40d tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-334bf406-c9fb-4808-b1da-d48fc3c72aa3 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:28 devstack sudo[99805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-334bf406-c9fb-4808-b1da-d48fc3c72aa3 Sep 15 16:27:28 devstack sudo[99805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-9c1cb5fa-92f8-40be-b8f7-35992b2b67d3 tempest-TestMinimumBasicScenario-827702894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:27:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-9c1cb5fa-92f8-40be-b8f7-35992b2b67d3 tempest-TestMinimumBasicScenario-827702894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:27:28 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-9c1cb5fa-92f8-40be-b8f7-35992b2b67d3 tempest-TestMinimumBasicScenario-827702894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:27:28 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-9c1cb5fa-92f8-40be-b8f7-35992b2b67d3 tempest-TestMinimumBasicScenario-827702894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:27:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-9c1cb5fa-92f8-40be-b8f7-35992b2b67d3 tempest-TestMinimumBasicScenario-827702894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:27:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9c1cb5fa-92f8-40be-b8f7-35992b2b67d3 tempest-TestMinimumBasicScenario-827702894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:28 devstack sudo[99807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:27:28 devstack sudo[99807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:28 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-8dc5e99e-c9f0-43b9-885c-fe4deed4dba5 tempest-VolumesListTestJSON-507613894 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:27:28 devstack sudo[99794]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:28 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8dc5e99e-c9f0-43b9-885c-fe4deed4dba5 tempest-VolumesListTestJSON-507613894 None] Flow 'volume_create_manager' (15aadbf9-323d-4d0e-8f14-e7bc9830a35d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:27:28 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8dc5e99e-c9f0-43b9-885c-fe4deed4dba5 tempest-VolumesListTestJSON-507613894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6905dce3-a3f5-4f40-bb69-ade7ad04bb66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:27:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e9979998-fd17-4045-a165-eee2f7cef5a9 tempest-SnapshotsActionsTest-949396253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.863742e5-9c33-416c-9b51-107c511fd033" returned: 0 in 0.561s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e9979998-fd17-4045-a165-eee2f7cef5a9 tempest-SnapshotsActionsTest-949396253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.863742e5-9c33-416c-9b51-107c511fd033 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:28 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8dc5e99e-c9f0-43b9-885c-fe4deed4dba5 tempest-VolumesListTestJSON-507613894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6905dce3-a3f5-4f40-bb69-ade7ad04bb66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:27:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-231795568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1016248c-2b8f-435c-84b7-afb152a7200d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e4cde12bbd2c4451b91ea8902724d05c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:27:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:27:28Z,use_quota=True,user_id='a0d2bcda4a7d48349d11013b3bb91907',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:27:28 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8dc5e99e-c9f0-43b9-885c-fe4deed4dba5 tempest-VolumesListTestJSON-507613894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e101a549-737d-4278-81c7-912c2c985047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:27:28 devstack sudo[99809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.863742e5-9c33-416c-9b51-107c511fd033 Sep 15 16:27:28 devstack sudo[99809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:28 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8dc5e99e-c9f0-43b9-885c-fe4deed4dba5 tempest-VolumesListTestJSON-507613894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e101a549-737d-4278-81c7-912c2c985047) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:27:28 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8dc5e99e-c9f0-43b9-885c-fe4deed4dba5 tempest-VolumesListTestJSON-507613894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2399cb1b-be51-47e7-baed-0755f0d16ddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:27:28 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8dc5e99e-c9f0-43b9-885c-fe4deed4dba5 tempest-VolumesListTestJSON-507613894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2399cb1b-be51-47e7-baed-0755f0d16ddf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1016248c-2b8f-435c-84b7-afb152a7200d', 'volume_name': 'volume-1016248c-2b8f-435c-84b7-afb152a7200d', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:27:28 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8dc5e99e-c9f0-43b9-885c-fe4deed4dba5 tempest-VolumesListTestJSON-507613894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85186d15-b7ac-49bf-a577-8e6d6c8f658e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:27:28 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8dc5e99e-c9f0-43b9-885c-fe4deed4dba5 tempest-VolumesListTestJSON-507613894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85186d15-b7ac-49bf-a577-8e6d6c8f658e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:27:28 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8dc5e99e-c9f0-43b9-885c-fe4deed4dba5 tempest-VolumesListTestJSON-507613894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b828fe7-88fe-4525-b985-25f7767edc3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:27:28 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-8dc5e99e-c9f0-43b9-885c-fe4deed4dba5 tempest-VolumesListTestJSON-507613894 None] Volume 1016248c-2b8f-435c-84b7-afb152a7200d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1016248c-2b8f-435c-84b7-afb152a7200d', 'volume_size': 1} Sep 15 16:27:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-8dc5e99e-c9f0-43b9-885c-fe4deed4dba5 tempest-VolumesListTestJSON-507613894 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:27:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-8dc5e99e-c9f0-43b9-885c-fe4deed4dba5 tempest-VolumesListTestJSON-507613894 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:27:28 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-8dc5e99e-c9f0-43b9-885c-fe4deed4dba5 tempest-VolumesListTestJSON-507613894 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:27:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-231795568',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1016248c-2b8f-435c-84b7-afb152a7200d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e4cde12bbd2c4451b91ea8902724d05c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:27:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:27:28Z,use_quota=True,user_id='a0d2bcda4a7d48349d11013b3bb91907',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:27:28 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-8dc5e99e-c9f0-43b9-885c-fe4deed4dba5 tempest-VolumesListTestJSON-507613894 None] Creating volume 1016248c-2b8f-435c-84b7-afb152a7200d {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:27:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-8dc5e99e-c9f0-43b9-885c-fe4deed4dba5 tempest-VolumesListTestJSON-507613894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:27:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-8dc5e99e-c9f0-43b9-885c-fe4deed4dba5 tempest-VolumesListTestJSON-507613894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:27:28 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-8dc5e99e-c9f0-43b9-885c-fe4deed4dba5 tempest-VolumesListTestJSON-507613894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:27:28 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-8dc5e99e-c9f0-43b9-885c-fe4deed4dba5 tempest-VolumesListTestJSON-507613894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:27:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-8dc5e99e-c9f0-43b9-885c-fe4deed4dba5 tempest-VolumesListTestJSON-507613894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:27:28 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-8dc5e99e-c9f0-43b9-885c-fe4deed4dba5 tempest-VolumesListTestJSON-507613894 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:27:28 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-8dc5e99e-c9f0-43b9-885c-fe4deed4dba5 tempest-VolumesListTestJSON-507613894 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:27:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8dc5e99e-c9f0-43b9-885c-fe4deed4dba5 tempest-VolumesListTestJSON-507613894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1016248c-2b8f-435c-84b7-afb152a7200d 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:28 devstack sudo[99805]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-1530c032-1c56-4997-8f22-1ea6a43fa40d tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-334bf406-c9fb-4808-b1da-d48fc3c72aa3" returned: 0 in 0.289s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:28 devstack sudo[99812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1016248c-2b8f-435c-84b7-afb152a7200d 1073741824 Sep 15 16:27:28 devstack sudo[99812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:28 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-1530c032-1c56-4997-8f22-1ea6a43fa40d tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Lock "cinder-quobyte-334bf406-c9fb-4808-b1da-d48fc3c72aa3" released by "delete_volume" :: held 0.900s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:27:28 devstack sudo[99807]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9c1cb5fa-92f8-40be-b8f7-35992b2b67d3 tempest-TestMinimumBasicScenario-827702894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.306s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:28 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-9c1cb5fa-92f8-40be-b8f7-35992b2b67d3 tempest-TestMinimumBasicScenario-827702894 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:27:28 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-9c1cb5fa-92f8-40be-b8f7-35992b2b67d3 tempest-TestMinimumBasicScenario-827702894 None] Deleted volume successfully. Sep 15 16:27:28 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-9c1cb5fa-92f8-40be-b8f7-35992b2b67d3 tempest-TestMinimumBasicScenario-827702894 None] Lock "cinder-cb3b13af-515b-4eda-a1da-df74c7149aa9-delete_volume" released by "delete_volume" :: held 1.563s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:27:28 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-1530c032-1c56-4997-8f22-1ea6a43fa40d tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Created reservations ['5bf251e7-c66b-41c3-8578-4a6597bed447', '874ddcc2-c9d6-4f13-a866-ae3822a6d82c', 'b62bfc86-c12d-4dbd-a141-71dcc3616887', '6ad148fc-42a7-4174-9391-5a125c3a0a62'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:27:28 devstack sudo[99809]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e9979998-fd17-4045-a165-eee2f7cef5a9 tempest-SnapshotsActionsTest-949396253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.863742e5-9c33-416c-9b51-107c511fd033" returned: 0 in 0.301s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:28 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-e9979998-fd17-4045-a165-eee2f7cef5a9 tempest-SnapshotsActionsTest-949396253 None] Lock "cinder-quobyte-863742e5-9c33-416c-9b51-107c511fd033" released by "_delete_snapshot" :: held 1.953s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:27:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-1530c032-1c56-4997-8f22-1ea6a43fa40d tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:27:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-1530c032-1c56-4997-8f22-1ea6a43fa40d tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:27:28 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-1530c032-1c56-4997-8f22-1ea6a43fa40d tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:27:28 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-1530c032-1c56-4997-8f22-1ea6a43fa40d tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:27:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-1530c032-1c56-4997-8f22-1ea6a43fa40d tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:27:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-1530c032-1c56-4997-8f22-1ea6a43fa40d tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:28 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-e9979998-fd17-4045-a165-eee2f7cef5a9 tempest-SnapshotsActionsTest-949396253 None] Lock "cinder-quobyte-279826cc-e702-4b37-9791-7965cec669f5" released by "delete_snapshot" :: held 2.014s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:27:28 devstack sudo[99819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:27:28 devstack sudo[99819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:28 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-8f0ac89f-8013-4f05-a032-c25a55643270 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Acquiring lock "cinder-e3df80ac-892a-48ee-9096-d8dffd2e6d1a-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:27:28 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-8f0ac89f-8013-4f05-a032-c25a55643270 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Lock "cinder-e3df80ac-892a-48ee-9096-d8dffd2e6d1a-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:27:28 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-8f0ac89f-8013-4f05-a032-c25a55643270 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Acquiring lock "cinder-quobyte-e3df80ac-892a-48ee-9096-d8dffd2e6d1a" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:27:28 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-e9979998-fd17-4045-a165-eee2f7cef5a9 tempest-SnapshotsActionsTest-949396253 None] Created reservations ['ea9ff0d4-e441-4d35-bc8f-305d5e3b2001', 'b137349b-7ed6-4d7b-9050-e6dfc647264b', 'ab279317-84d9-4a35-b177-35218f485a95', '9b7aae56-b372-4c02-938d-363c3bee4747'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:27:28 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-8f0ac89f-8013-4f05-a032-c25a55643270 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Lock "cinder-quobyte-e3df80ac-892a-48ee-9096-d8dffd2e6d1a" acquired by "delete_volume" :: waited 0.023s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:27:28 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb097277-a3b3-4848-acfc-0673f739df33]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:27:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8f0ac89f-8013-4f05-a032-c25a55643270 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-e3df80ac-892a-48ee-9096-d8dffd2e6d1a {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:28 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-e9979998-fd17-4045-a165-eee2f7cef5a9 tempest-SnapshotsActionsTest-949396253 None] Delete snapshot completed successfully. Sep 15 16:27:28 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-e9979998-fd17-4045-a165-eee2f7cef5a9 tempest-SnapshotsActionsTest-949396253 None] Lock "cinder-863742e5-9c33-416c-9b51-107c511fd033-delete_snapshot" released by "delete_snapshot" :: held 2.278s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:27:28 devstack sudo[99812]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8dc5e99e-c9f0-43b9-885c-fe4deed4dba5 tempest-VolumesListTestJSON-507613894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1016248c-2b8f-435c-84b7-afb152a7200d 1073741824" returned: 0 in 0.561s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:28 devstack sudo[99822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-e3df80ac-892a-48ee-9096-d8dffd2e6d1a Sep 15 16:27:28 devstack sudo[99822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8dc5e99e-c9f0-43b9-885c-fe4deed4dba5 tempest-VolumesListTestJSON-507613894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1016248c-2b8f-435c-84b7-afb152a7200d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:29 devstack sudo[99819]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-1530c032-1c56-4997-8f22-1ea6a43fa40d tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.343s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:29 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-1530c032-1c56-4997-8f22-1ea6a43fa40d tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:27:29 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-1530c032-1c56-4997-8f22-1ea6a43fa40d tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Deleted volume successfully. Sep 15 16:27:29 devstack sudo[99825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1016248c-2b8f-435c-84b7-afb152a7200d Sep 15 16:27:29 devstack sudo[99825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:29 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-1530c032-1c56-4997-8f22-1ea6a43fa40d tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Lock "cinder-334bf406-c9fb-4808-b1da-d48fc3c72aa3-delete_volume" released by "delete_volume" :: held 1.583s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:27:29 devstack sudo[99825]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8dc5e99e-c9f0-43b9-885c-fe4deed4dba5 tempest-VolumesListTestJSON-507613894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1016248c-2b8f-435c-84b7-afb152a7200d" returned: 0 in 0.279s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:29 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-8dc5e99e-c9f0-43b9-885c-fe4deed4dba5 tempest-VolumesListTestJSON-507613894 None] <== create_volume: return (893ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:27:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-8dc5e99e-c9f0-43b9-885c-fe4deed4dba5 tempest-VolumesListTestJSON-507613894 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.897s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:27:29 devstack sudo[99822]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8f0ac89f-8013-4f05-a032-c25a55643270 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-e3df80ac-892a-48ee-9096-d8dffd2e6d1a" returned: 0 in 0.428s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8f0ac89f-8013-4f05-a032-c25a55643270 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-e3df80ac-892a-48ee-9096-d8dffd2e6d1a {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:29 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8dc5e99e-c9f0-43b9-885c-fe4deed4dba5 tempest-VolumesListTestJSON-507613894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b828fe7-88fe-4525-b985-25f7767edc3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1016248c-2b8f-435c-84b7-afb152a7200d', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:27:29 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8dc5e99e-c9f0-43b9-885c-fe4deed4dba5 tempest-VolumesListTestJSON-507613894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cd43d9e-2838-4463-b8ec-1c85af790b1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:27:29 devstack sudo[99831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-e3df80ac-892a-48ee-9096-d8dffd2e6d1a Sep 15 16:27:29 devstack sudo[99831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:29 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-8dc5e99e-c9f0-43b9-885c-fe4deed4dba5 tempest-VolumesListTestJSON-507613894 None] Volume volume-1016248c-2b8f-435c-84b7-afb152a7200d (1016248c-2b8f-435c-84b7-afb152a7200d): created successfully Sep 15 16:27:29 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8dc5e99e-c9f0-43b9-885c-fe4deed4dba5 tempest-VolumesListTestJSON-507613894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cd43d9e-2838-4463-b8ec-1c85af790b1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:27:29 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8dc5e99e-c9f0-43b9-885c-fe4deed4dba5 tempest-VolumesListTestJSON-507613894 None] Flow 'volume_create_manager' (15aadbf9-323d-4d0e-8f14-e7bc9830a35d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:27:29 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-8dc5e99e-c9f0-43b9-885c-fe4deed4dba5 tempest-VolumesListTestJSON-507613894 None] Created volume successfully. Sep 15 16:27:29 devstack sudo[99831]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8f0ac89f-8013-4f05-a032-c25a55643270 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-e3df80ac-892a-48ee-9096-d8dffd2e6d1a" returned: 0 in 0.319s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:29 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-8f0ac89f-8013-4f05-a032-c25a55643270 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Lock "cinder-quobyte-e3df80ac-892a-48ee-9096-d8dffd2e6d1a" released by "delete_volume" :: held 0.795s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:27:29 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-8f0ac89f-8013-4f05-a032-c25a55643270 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Created reservations ['52f55ae6-ae5e-4b32-8b4c-e81f724533b5', '17ddd4e2-8a13-43a8-9a70-73446ab1758c', 'eabc8eea-06d6-4a9f-8eb3-0881805e5188', '4c4b5940-8a7f-418a-b9da-0f0a40bee68b'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:27:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-8f0ac89f-8013-4f05-a032-c25a55643270 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:27:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-8f0ac89f-8013-4f05-a032-c25a55643270 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:27:29 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-8f0ac89f-8013-4f05-a032-c25a55643270 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:27:29 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-8f0ac89f-8013-4f05-a032-c25a55643270 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:27:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-8f0ac89f-8013-4f05-a032-c25a55643270 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:27:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8f0ac89f-8013-4f05-a032-c25a55643270 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:29 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-aa8c37fb-0b39-4a50-b8f8-cb4a71b207b6 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Acquiring lock "cinder-7ca395ce-a4c2-4365-a555-6ae6ae248994-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:27:29 devstack sudo[99852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:27:29 devstack sudo[99852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:29 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-aa8c37fb-0b39-4a50-b8f8-cb4a71b207b6 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Lock "cinder-7ca395ce-a4c2-4365-a555-6ae6ae248994-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:27:30 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-aa8c37fb-0b39-4a50-b8f8-cb4a71b207b6 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Acquiring lock "cinder-quobyte-7ca395ce-a4c2-4365-a555-6ae6ae248994" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:27:30 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-aa8c37fb-0b39-4a50-b8f8-cb4a71b207b6 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Lock "cinder-quobyte-7ca395ce-a4c2-4365-a555-6ae6ae248994" acquired by "delete_volume" :: waited 0.018s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:27:30 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[88b841b2-81d8-47ef-a68a-4d0bd69c4cb3]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:27:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-aa8c37fb-0b39-4a50-b8f8-cb4a71b207b6 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-7ca395ce-a4c2-4365-a555-6ae6ae248994 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:30 devstack sudo[99852]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8f0ac89f-8013-4f05-a032-c25a55643270 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.425s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:30 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-8f0ac89f-8013-4f05-a032-c25a55643270 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:27:30 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-8f0ac89f-8013-4f05-a032-c25a55643270 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Deleted volume successfully. Sep 15 16:27:30 devstack sudo[99859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-7ca395ce-a4c2-4365-a555-6ae6ae248994 Sep 15 16:27:30 devstack sudo[99859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:30 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-8f0ac89f-8013-4f05-a032-c25a55643270 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Lock "cinder-e3df80ac-892a-48ee-9096-d8dffd2e6d1a-delete_volume" released by "delete_volume" :: held 1.657s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:27:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-e392e00c-d307-4bb8-bd22-0ee2368ef287 tempest-SnapshotsActionsTest-82182000 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:27:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-e392e00c-d307-4bb8-bd22-0ee2368ef287 tempest-SnapshotsActionsTest-82182000 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:27:30 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-e392e00c-d307-4bb8-bd22-0ee2368ef287 tempest-SnapshotsActionsTest-82182000 None] Creating offline snapshot ea8259c7-5e33-4ec2-8962-b848531ee17b of volume 279826cc-e702-4b37-9791-7965cec669f5 {{(pid=86082) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 15 16:27:30 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[65972c51-d2c0-4cae-9ff4-778380e5049f]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:27:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e392e00c-d307-4bb8-bd22-0ee2368ef287 tempest-SnapshotsActionsTest-82182000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.df37eddb-733c-42b7-b8aa-ff40e6de1acf {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:30 devstack sudo[99862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.df37eddb-733c-42b7-b8aa-ff40e6de1acf Sep 15 16:27:30 devstack sudo[99862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:30 devstack sudo[99859]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-aa8c37fb-0b39-4a50-b8f8-cb4a71b207b6 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-7ca395ce-a4c2-4365-a555-6ae6ae248994" returned: 0 in 0.703s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-aa8c37fb-0b39-4a50-b8f8-cb4a71b207b6 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-7ca395ce-a4c2-4365-a555-6ae6ae248994 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:30 devstack sudo[99869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-7ca395ce-a4c2-4365-a555-6ae6ae248994 Sep 15 16:27:30 devstack sudo[99869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:31 devstack sudo[99862]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e392e00c-d307-4bb8-bd22-0ee2368ef287 tempest-SnapshotsActionsTest-82182000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.df37eddb-733c-42b7-b8aa-ff40e6de1acf" returned: 0 in 0.659s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:31 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-e392e00c-d307-4bb8-bd22-0ee2368ef287 tempest-SnapshotsActionsTest-82182000 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-279826cc-e702-4b37-9791-7965cec669f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 16:27:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e392e00c-d307-4bb8-bd22-0ee2368ef287 tempest-SnapshotsActionsTest-82182000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.df37eddb-733c-42b7-b8aa-ff40e6de1acf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.ea8259c7-5e33-4ec2-8962-b848531ee17b 1G {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:31 devstack sudo[99882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.df37eddb-733c-42b7-b8aa-ff40e6de1acf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.ea8259c7-5e33-4ec2-8962-b848531ee17b 1G Sep 15 16:27:31 devstack sudo[99882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:31 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-27f10b6e-36b8-4c9f-8134-7be2629df598 tempest-VolumesListTestJSON-507613894 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:27:31 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-27f10b6e-36b8-4c9f-8134-7be2629df598 tempest-VolumesListTestJSON-507613894 None] Flow 'volume_create_manager' (1f735c11-1cdd-4ce2-a194-440966e7148e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:27:31 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-27f10b6e-36b8-4c9f-8134-7be2629df598 tempest-VolumesListTestJSON-507613894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c1486fa-867c-4f91-88e6-9c53fcdb4a16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:27:31 devstack sudo[99869]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-aa8c37fb-0b39-4a50-b8f8-cb4a71b207b6 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-7ca395ce-a4c2-4365-a555-6ae6ae248994" returned: 0 in 0.486s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:31 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-27f10b6e-36b8-4c9f-8134-7be2629df598 tempest-VolumesListTestJSON-507613894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c1486fa-867c-4f91-88e6-9c53fcdb4a16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:27:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1652867386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f66eaf19-4941-4911-b26b-dd7fc869d8b2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e4cde12bbd2c4451b91ea8902724d05c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:27:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:27:31Z,use_quota=True,user_id='a0d2bcda4a7d48349d11013b3bb91907',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:27:31 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-27f10b6e-36b8-4c9f-8134-7be2629df598 tempest-VolumesListTestJSON-507613894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1c6b685-654d-4c56-b674-6bbd98d4835a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:27:31 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-27f10b6e-36b8-4c9f-8134-7be2629df598 tempest-VolumesListTestJSON-507613894 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1c6b685-654d-4c56-b674-6bbd98d4835a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:27:31 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-27f10b6e-36b8-4c9f-8134-7be2629df598 tempest-VolumesListTestJSON-507613894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6d8d930-15be-4b0d-beef-a76cb312efc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:27:31 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-27f10b6e-36b8-4c9f-8134-7be2629df598 tempest-VolumesListTestJSON-507613894 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6d8d930-15be-4b0d-beef-a76cb312efc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f66eaf19-4941-4911-b26b-dd7fc869d8b2', 'volume_name': 'volume-f66eaf19-4941-4911-b26b-dd7fc869d8b2', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:27:31 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-27f10b6e-36b8-4c9f-8134-7be2629df598 tempest-VolumesListTestJSON-507613894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90651fa2-7f88-46ab-a2d7-f61c30da4974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:27:31 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-27f10b6e-36b8-4c9f-8134-7be2629df598 tempest-VolumesListTestJSON-507613894 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (90651fa2-7f88-46ab-a2d7-f61c30da4974) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:27:31 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-27f10b6e-36b8-4c9f-8134-7be2629df598 tempest-VolumesListTestJSON-507613894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b1e4e6d-d27b-4c10-b5ec-8f51b80a825e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:27:31 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-27f10b6e-36b8-4c9f-8134-7be2629df598 tempest-VolumesListTestJSON-507613894 None] Volume f66eaf19-4941-4911-b26b-dd7fc869d8b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f66eaf19-4941-4911-b26b-dd7fc869d8b2', 'volume_size': 1} Sep 15 16:27:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-27f10b6e-36b8-4c9f-8134-7be2629df598 tempest-VolumesListTestJSON-507613894 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:27:31 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-aa8c37fb-0b39-4a50-b8f8-cb4a71b207b6 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Lock "cinder-quobyte-7ca395ce-a4c2-4365-a555-6ae6ae248994" released by "delete_volume" :: held 1.306s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:27:31 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-aa8c37fb-0b39-4a50-b8f8-cb4a71b207b6 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Created reservations ['6e17a1fc-9522-4500-a38c-91bd8561bcce', 'a5b0a177-5beb-46b3-9379-64481cd9f0cb', '336b0f75-f58b-43cc-827b-3ac1d0dd8045', '50f8822b-e62a-401c-845b-97b957f9f2f2'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:27:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-aa8c37fb-0b39-4a50-b8f8-cb4a71b207b6 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:27:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-aa8c37fb-0b39-4a50-b8f8-cb4a71b207b6 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:27:31 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-aa8c37fb-0b39-4a50-b8f8-cb4a71b207b6 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:27:31 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-aa8c37fb-0b39-4a50-b8f8-cb4a71b207b6 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:27:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-aa8c37fb-0b39-4a50-b8f8-cb4a71b207b6 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:27:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-aa8c37fb-0b39-4a50-b8f8-cb4a71b207b6 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:31 devstack sudo[99887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:27:31 devstack sudo[99887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:31 devstack sudo[99882]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e392e00c-d307-4bb8-bd22-0ee2368ef287 tempest-SnapshotsActionsTest-82182000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.df37eddb-733c-42b7-b8aa-ff40e6de1acf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.ea8259c7-5e33-4ec2-8962-b848531ee17b 1G" returned: 0 in 0.533s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e392e00c-d307-4bb8-bd22-0ee2368ef287 tempest-SnapshotsActionsTest-82182000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-279826cc-e702-4b37-9791-7965cec669f5.df37eddb-733c-42b7-b8aa-ff40e6de1acf -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.ea8259c7-5e33-4ec2-8962-b848531ee17b {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:31 devstack sudo[99890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-279826cc-e702-4b37-9791-7965cec669f5.df37eddb-733c-42b7-b8aa-ff40e6de1acf -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.ea8259c7-5e33-4ec2-8962-b848531ee17b Sep 15 16:27:31 devstack sudo[99890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:31 devstack sudo[99887]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-aa8c37fb-0b39-4a50-b8f8-cb4a71b207b6 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.258s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:31 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-aa8c37fb-0b39-4a50-b8f8-cb4a71b207b6 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:27:31 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-aa8c37fb-0b39-4a50-b8f8-cb4a71b207b6 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Deleted volume successfully. Sep 15 16:27:31 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-aa8c37fb-0b39-4a50-b8f8-cb4a71b207b6 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Lock "cinder-7ca395ce-a4c2-4365-a555-6ae6ae248994-delete_volume" released by "delete_volume" :: held 1.880s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:27:32 devstack sudo[99890]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e392e00c-d307-4bb8-bd22-0ee2368ef287 tempest-SnapshotsActionsTest-82182000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-279826cc-e702-4b37-9791-7965cec669f5.df37eddb-733c-42b7-b8aa-ff40e6de1acf -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.ea8259c7-5e33-4ec2-8962-b848531ee17b" returned: 0 in 0.289s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:32 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-e392e00c-d307-4bb8-bd22-0ee2368ef287 tempest-SnapshotsActionsTest-82182000 None] /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.ea8259c7-5e33-4ec2-8962-b848531ee17b is being set with open permissions: ugo+rw Sep 15 16:27:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e392e00c-d307-4bb8-bd22-0ee2368ef287 tempest-SnapshotsActionsTest-82182000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.ea8259c7-5e33-4ec2-8962-b848531ee17b {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:32 devstack sudo[99896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.ea8259c7-5e33-4ec2-8962-b848531ee17b Sep 15 16:27:32 devstack sudo[99896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:32 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-adc9ed89-54ac-4033-8336-569437f0ab73 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Acquiring lock "cinder-5de627de-a14b-449d-8de1-1e865ed34ce4-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:27:32 devstack sudo[99896]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e392e00c-d307-4bb8-bd22-0ee2368ef287 tempest-SnapshotsActionsTest-82182000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.ea8259c7-5e33-4ec2-8962-b848531ee17b" returned: 0 in 0.256s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:32 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-adc9ed89-54ac-4033-8336-569437f0ab73 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Lock "cinder-5de627de-a14b-449d-8de1-1e865ed34ce4-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:27:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-e392e00c-d307-4bb8-bd22-0ee2368ef287 tempest-SnapshotsActionsTest-82182000 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.907s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:27:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-27f10b6e-36b8-4c9f-8134-7be2629df598 tempest-VolumesListTestJSON-507613894 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.979s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:27:32 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-27f10b6e-36b8-4c9f-8134-7be2629df598 tempest-VolumesListTestJSON-507613894 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:27:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1652867386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f66eaf19-4941-4911-b26b-dd7fc869d8b2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e4cde12bbd2c4451b91ea8902724d05c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:27:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:27:31Z,use_quota=True,user_id='a0d2bcda4a7d48349d11013b3bb91907',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:27:32 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-27f10b6e-36b8-4c9f-8134-7be2629df598 tempest-VolumesListTestJSON-507613894 None] Creating volume f66eaf19-4941-4911-b26b-dd7fc869d8b2 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:27:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-27f10b6e-36b8-4c9f-8134-7be2629df598 tempest-VolumesListTestJSON-507613894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:27:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-27f10b6e-36b8-4c9f-8134-7be2629df598 tempest-VolumesListTestJSON-507613894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:27:32 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-27f10b6e-36b8-4c9f-8134-7be2629df598 tempest-VolumesListTestJSON-507613894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:27:32 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-27f10b6e-36b8-4c9f-8134-7be2629df598 tempest-VolumesListTestJSON-507613894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:27:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-27f10b6e-36b8-4c9f-8134-7be2629df598 tempest-VolumesListTestJSON-507613894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:27:32 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-27f10b6e-36b8-4c9f-8134-7be2629df598 tempest-VolumesListTestJSON-507613894 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:27:32 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-27f10b6e-36b8-4c9f-8134-7be2629df598 tempest-VolumesListTestJSON-507613894 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:27:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-27f10b6e-36b8-4c9f-8134-7be2629df598 tempest-VolumesListTestJSON-507613894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-f66eaf19-4941-4911-b26b-dd7fc869d8b2 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:32 devstack sudo[99899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-f66eaf19-4941-4911-b26b-dd7fc869d8b2 1073741824 Sep 15 16:27:32 devstack sudo[99899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:32 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-adc9ed89-54ac-4033-8336-569437f0ab73 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Acquiring lock "cinder-quobyte-5de627de-a14b-449d-8de1-1e865ed34ce4" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:27:32 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-e392e00c-d307-4bb8-bd22-0ee2368ef287 tempest-SnapshotsActionsTest-82182000 None] Create snapshot completed successfully Sep 15 16:27:32 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-adc9ed89-54ac-4033-8336-569437f0ab73 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Lock "cinder-quobyte-5de627de-a14b-449d-8de1-1e865ed34ce4" acquired by "delete_volume" :: waited 0.040s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:27:32 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dbb6456-9838-4304-99c9-7fc748c10660]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:27:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-adc9ed89-54ac-4033-8336-569437f0ab73 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-5de627de-a14b-449d-8de1-1e865ed34ce4 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:32 devstack sudo[99901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-5de627de-a14b-449d-8de1-1e865ed34ce4 Sep 15 16:27:32 devstack sudo[99901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:32 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-83256610-34f7-4770-8af6-666716899d50 tempest-SnapshotsActionsTest-949396253 None] Acquiring lock "cinder-ea8259c7-5e33-4ec2-8962-b848531ee17b-delete_snapshot" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:27:32 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-83256610-34f7-4770-8af6-666716899d50 tempest-SnapshotsActionsTest-949396253 None] Lock "cinder-ea8259c7-5e33-4ec2-8962-b848531ee17b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:27:32 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-83256610-34f7-4770-8af6-666716899d50 tempest-SnapshotsActionsTest-949396253 None] Acquiring lock "cinder-quobyte-279826cc-e702-4b37-9791-7965cec669f5" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:27:32 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-83256610-34f7-4770-8af6-666716899d50 tempest-SnapshotsActionsTest-949396253 None] Lock "cinder-quobyte-279826cc-e702-4b37-9791-7965cec669f5" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:27:32 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-83256610-34f7-4770-8af6-666716899d50 tempest-SnapshotsActionsTest-949396253 None] Acquiring lock "cinder-quobyte-ea8259c7-5e33-4ec2-8962-b848531ee17b" by "_delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:27:32 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-83256610-34f7-4770-8af6-666716899d50 tempest-SnapshotsActionsTest-949396253 None] Lock "cinder-quobyte-ea8259c7-5e33-4ec2-8962-b848531ee17b" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:27:32 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-83256610-34f7-4770-8af6-666716899d50 tempest-SnapshotsActionsTest-949396253 None] Deleting offline snapshot ea8259c7-5e33-4ec2-8962-b848531ee17b of volume 279826cc-e702-4b37-9791-7965cec669f5 {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 15 16:27:32 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-83256610-34f7-4770-8af6-666716899d50 tempest-SnapshotsActionsTest-949396253 None] snapshot_file for this snap is: volume-279826cc-e702-4b37-9791-7965cec669f5.ea8259c7-5e33-4ec2-8962-b848531ee17b {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 15 16:27:32 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c5a3e9c-5824-495a-bde0-9582f18b30b2]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:27:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-83256610-34f7-4770-8af6-666716899d50 tempest-SnapshotsActionsTest-949396253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.ea8259c7-5e33-4ec2-8962-b848531ee17b {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:32 devstack sudo[99901]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-adc9ed89-54ac-4033-8336-569437f0ab73 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-5de627de-a14b-449d-8de1-1e865ed34ce4" returned: 0 in 0.481s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-adc9ed89-54ac-4033-8336-569437f0ab73 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-5de627de-a14b-449d-8de1-1e865ed34ce4 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:33 devstack sudo[99899]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-27f10b6e-36b8-4c9f-8134-7be2629df598 tempest-VolumesListTestJSON-507613894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-f66eaf19-4941-4911-b26b-dd7fc869d8b2 1073741824" returned: 0 in 0.621s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:33 devstack sudo[99907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.ea8259c7-5e33-4ec2-8962-b848531ee17b Sep 15 16:27:33 devstack sudo[99907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:33 devstack sudo[99912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-5de627de-a14b-449d-8de1-1e865ed34ce4 Sep 15 16:27:33 devstack sudo[99912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-27f10b6e-36b8-4c9f-8134-7be2629df598 tempest-VolumesListTestJSON-507613894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-f66eaf19-4941-4911-b26b-dd7fc869d8b2 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:33 devstack sudo[99915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-f66eaf19-4941-4911-b26b-dd7fc869d8b2 Sep 15 16:27:33 devstack sudo[99915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:33 devstack sudo[99907]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-83256610-34f7-4770-8af6-666716899d50 tempest-SnapshotsActionsTest-949396253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.ea8259c7-5e33-4ec2-8962-b848531ee17b" returned: 0 in 0.462s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:33 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-83256610-34f7-4770-8af6-666716899d50 tempest-SnapshotsActionsTest-949396253 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-279826cc-e702-4b37-9791-7965cec669f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 16:27:33 devstack sudo[99912]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-adc9ed89-54ac-4033-8336-569437f0ab73 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-5de627de-a14b-449d-8de1-1e865ed34ce4" returned: 0 in 0.375s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:33 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[780a73d0-9fff-4556-b777-21b14a72d653]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:27:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-83256610-34f7-4770-8af6-666716899d50 tempest-SnapshotsActionsTest-949396253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.df37eddb-733c-42b7-b8aa-ff40e6de1acf {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:33 devstack sudo[99915]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-27f10b6e-36b8-4c9f-8134-7be2629df598 tempest-VolumesListTestJSON-507613894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-f66eaf19-4941-4911-b26b-dd7fc869d8b2" returned: 0 in 0.350s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:33 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-27f10b6e-36b8-4c9f-8134-7be2629df598 tempest-VolumesListTestJSON-507613894 None] <== create_volume: return (1030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:27:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-27f10b6e-36b8-4c9f-8134-7be2629df598 tempest-VolumesListTestJSON-507613894 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.034s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:27:33 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-adc9ed89-54ac-4033-8336-569437f0ab73 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Lock "cinder-quobyte-5de627de-a14b-449d-8de1-1e865ed34ce4" released by "delete_volume" :: held 0.944s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:27:33 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-27f10b6e-36b8-4c9f-8134-7be2629df598 tempest-VolumesListTestJSON-507613894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b1e4e6d-d27b-4c10-b5ec-8f51b80a825e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f66eaf19-4941-4911-b26b-dd7fc869d8b2', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:27:33 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-27f10b6e-36b8-4c9f-8134-7be2629df598 tempest-VolumesListTestJSON-507613894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f18a41a-ea7c-4100-bebc-04fa5c7fd6ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:27:33 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-27f10b6e-36b8-4c9f-8134-7be2629df598 tempest-VolumesListTestJSON-507613894 None] Volume volume-f66eaf19-4941-4911-b26b-dd7fc869d8b2 (f66eaf19-4941-4911-b26b-dd7fc869d8b2): created successfully Sep 15 16:27:33 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-27f10b6e-36b8-4c9f-8134-7be2629df598 tempest-VolumesListTestJSON-507613894 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f18a41a-ea7c-4100-bebc-04fa5c7fd6ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:27:33 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-27f10b6e-36b8-4c9f-8134-7be2629df598 tempest-VolumesListTestJSON-507613894 None] Flow 'volume_create_manager' (1f735c11-1cdd-4ce2-a194-440966e7148e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:27:33 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-27f10b6e-36b8-4c9f-8134-7be2629df598 tempest-VolumesListTestJSON-507613894 None] Created volume successfully. Sep 15 16:27:33 devstack sudo[99923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.df37eddb-733c-42b7-b8aa-ff40e6de1acf Sep 15 16:27:33 devstack sudo[99923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:33 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-adc9ed89-54ac-4033-8336-569437f0ab73 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Created reservations ['ff3fa73a-fd5e-424d-ad51-cf6799c9d0a9', 'b6704ea5-55cf-4bbf-8774-d0aa44475587', '54619aa6-80a1-4439-a4d5-cf3ab8e73a5f', '16575e35-21ec-4797-b943-aeb550153164'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:27:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-adc9ed89-54ac-4033-8336-569437f0ab73 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:27:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-adc9ed89-54ac-4033-8336-569437f0ab73 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:27:33 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-adc9ed89-54ac-4033-8336-569437f0ab73 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:27:33 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-adc9ed89-54ac-4033-8336-569437f0ab73 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:27:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-adc9ed89-54ac-4033-8336-569437f0ab73 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:27:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-adc9ed89-54ac-4033-8336-569437f0ab73 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:33 devstack sudo[99926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:27:33 devstack sudo[99926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:33 devstack sudo[99923]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-83256610-34f7-4770-8af6-666716899d50 tempest-SnapshotsActionsTest-949396253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.df37eddb-733c-42b7-b8aa-ff40e6de1acf" returned: 0 in 0.413s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:33 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-83256610-34f7-4770-8af6-666716899d50 tempest-SnapshotsActionsTest-949396253 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-279826cc-e702-4b37-9791-7965cec669f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 16:27:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-83256610-34f7-4770-8af6-666716899d50 tempest-SnapshotsActionsTest-949396253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.ea8259c7-5e33-4ec2-8962-b848531ee17b {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:33 devstack sudo[99931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.ea8259c7-5e33-4ec2-8962-b848531ee17b Sep 15 16:27:33 devstack sudo[99931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:33 devstack sudo[99926]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-adc9ed89-54ac-4033-8336-569437f0ab73 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.276s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:33 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-adc9ed89-54ac-4033-8336-569437f0ab73 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:27:33 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-adc9ed89-54ac-4033-8336-569437f0ab73 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Deleted volume successfully. Sep 15 16:27:33 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-adc9ed89-54ac-4033-8336-569437f0ab73 tempest-CreateVolumesFromSourceVolumeTest-1851925626 None] Lock "cinder-5de627de-a14b-449d-8de1-1e865ed34ce4-delete_volume" released by "delete_volume" :: held 1.606s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:27:34 devstack sudo[99931]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-83256610-34f7-4770-8af6-666716899d50 tempest-SnapshotsActionsTest-949396253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.ea8259c7-5e33-4ec2-8962-b848531ee17b" returned: 0 in 0.431s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-83256610-34f7-4770-8af6-666716899d50 tempest-SnapshotsActionsTest-949396253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.ea8259c7-5e33-4ec2-8962-b848531ee17b {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:34 devstack sudo[99938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.ea8259c7-5e33-4ec2-8962-b848531ee17b Sep 15 16:27:34 devstack sudo[99938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:34 devstack sudo[99938]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-83256610-34f7-4770-8af6-666716899d50 tempest-SnapshotsActionsTest-949396253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.ea8259c7-5e33-4ec2-8962-b848531ee17b" returned: 0 in 0.285s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:34 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-83256610-34f7-4770-8af6-666716899d50 tempest-SnapshotsActionsTest-949396253 None] Lock "cinder-quobyte-ea8259c7-5e33-4ec2-8962-b848531ee17b" released by "_delete_snapshot" :: held 1.746s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:27:34 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-83256610-34f7-4770-8af6-666716899d50 tempest-SnapshotsActionsTest-949396253 None] Lock "cinder-quobyte-279826cc-e702-4b37-9791-7965cec669f5" released by "delete_snapshot" :: held 1.781s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:27:34 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-83256610-34f7-4770-8af6-666716899d50 tempest-SnapshotsActionsTest-949396253 None] Created reservations ['04fb59fb-e9b4-4046-b7d8-427cd5de6361', 'd7ff3524-bc05-4e6a-85d6-b3882658a6f4', 'b917f4d3-1075-43c8-b9c1-5522e2cec5ac', 'f92948ee-87b2-453e-8abb-76c433077011'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:27:34 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-83256610-34f7-4770-8af6-666716899d50 tempest-SnapshotsActionsTest-949396253 None] Delete snapshot completed successfully. Sep 15 16:27:34 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-83256610-34f7-4770-8af6-666716899d50 tempest-SnapshotsActionsTest-949396253 None] Lock "cinder-ea8259c7-5e33-4ec2-8962-b848531ee17b-delete_snapshot" released by "delete_snapshot" :: held 1.966s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:27:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-5ea9f205-7ae3-470f-9395-efba7ef40cc9 tempest-SnapshotsActionsTest-82182000 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:27:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-5ea9f205-7ae3-470f-9395-efba7ef40cc9 tempest-SnapshotsActionsTest-82182000 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:27:35 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-5ea9f205-7ae3-470f-9395-efba7ef40cc9 tempest-SnapshotsActionsTest-82182000 None] Creating offline snapshot 8674e7fe-4871-405a-a846-f527f258754d of volume 279826cc-e702-4b37-9791-7965cec669f5 {{(pid=86082) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 15 16:27:35 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[15ec41f9-9230-4543-88fb-1176c8ca48d3]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:27:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5ea9f205-7ae3-470f-9395-efba7ef40cc9 tempest-SnapshotsActionsTest-82182000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.df37eddb-733c-42b7-b8aa-ff40e6de1acf {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:35 devstack sudo[99941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.df37eddb-733c-42b7-b8aa-ff40e6de1acf Sep 15 16:27:35 devstack sudo[99941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:35 devstack sudo[99941]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5ea9f205-7ae3-470f-9395-efba7ef40cc9 tempest-SnapshotsActionsTest-82182000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.df37eddb-733c-42b7-b8aa-ff40e6de1acf" returned: 0 in 0.444s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:35 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-5ea9f205-7ae3-470f-9395-efba7ef40cc9 tempest-SnapshotsActionsTest-82182000 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-279826cc-e702-4b37-9791-7965cec669f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 16:27:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5ea9f205-7ae3-470f-9395-efba7ef40cc9 tempest-SnapshotsActionsTest-82182000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.df37eddb-733c-42b7-b8aa-ff40e6de1acf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.8674e7fe-4871-405a-a846-f527f258754d 1G {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:35 devstack sudo[99946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.df37eddb-733c-42b7-b8aa-ff40e6de1acf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.8674e7fe-4871-405a-a846-f527f258754d 1G Sep 15 16:27:35 devstack sudo[99946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:36 devstack sudo[99946]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5ea9f205-7ae3-470f-9395-efba7ef40cc9 tempest-SnapshotsActionsTest-82182000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.df37eddb-733c-42b7-b8aa-ff40e6de1acf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.8674e7fe-4871-405a-a846-f527f258754d 1G" returned: 0 in 0.806s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5ea9f205-7ae3-470f-9395-efba7ef40cc9 tempest-SnapshotsActionsTest-82182000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-279826cc-e702-4b37-9791-7965cec669f5.df37eddb-733c-42b7-b8aa-ff40e6de1acf -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.8674e7fe-4871-405a-a846-f527f258754d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:36 devstack sudo[99954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-279826cc-e702-4b37-9791-7965cec669f5.df37eddb-733c-42b7-b8aa-ff40e6de1acf -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.8674e7fe-4871-405a-a846-f527f258754d Sep 15 16:27:36 devstack sudo[99954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:37 devstack sudo[99954]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5ea9f205-7ae3-470f-9395-efba7ef40cc9 tempest-SnapshotsActionsTest-82182000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-279826cc-e702-4b37-9791-7965cec669f5.df37eddb-733c-42b7-b8aa-ff40e6de1acf -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.8674e7fe-4871-405a-a846-f527f258754d" returned: 0 in 0.414s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:37 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-5ea9f205-7ae3-470f-9395-efba7ef40cc9 tempest-SnapshotsActionsTest-82182000 None] /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.8674e7fe-4871-405a-a846-f527f258754d is being set with open permissions: ugo+rw Sep 15 16:27:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5ea9f205-7ae3-470f-9395-efba7ef40cc9 tempest-SnapshotsActionsTest-82182000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.8674e7fe-4871-405a-a846-f527f258754d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:37 devstack sudo[99963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.8674e7fe-4871-405a-a846-f527f258754d Sep 15 16:27:37 devstack sudo[99963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:37 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-9dc3f158-46e6-4925-926c-ffab0ec209bc tempest-VolumesListTestJSON-507613894 None] Acquiring lock "cinder-f66eaf19-4941-4911-b26b-dd7fc869d8b2-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:27:37 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-9dc3f158-46e6-4925-926c-ffab0ec209bc tempest-VolumesListTestJSON-507613894 None] Lock "cinder-f66eaf19-4941-4911-b26b-dd7fc869d8b2-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:27:37 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-9dc3f158-46e6-4925-926c-ffab0ec209bc tempest-VolumesListTestJSON-507613894 None] Acquiring lock "cinder-quobyte-f66eaf19-4941-4911-b26b-dd7fc869d8b2" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:27:37 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-9dc3f158-46e6-4925-926c-ffab0ec209bc tempest-VolumesListTestJSON-507613894 None] Lock "cinder-quobyte-f66eaf19-4941-4911-b26b-dd7fc869d8b2" acquired by "delete_volume" :: waited 0.024s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:27:37 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[63ef083e-619d-4682-bacb-7d3d7687a7f2]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:27:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9dc3f158-46e6-4925-926c-ffab0ec209bc tempest-VolumesListTestJSON-507613894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-f66eaf19-4941-4911-b26b-dd7fc869d8b2 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:37 devstack sudo[99965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-f66eaf19-4941-4911-b26b-dd7fc869d8b2 Sep 15 16:27:37 devstack sudo[99965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:37 devstack sudo[99963]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5ea9f205-7ae3-470f-9395-efba7ef40cc9 tempest-SnapshotsActionsTest-82182000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.8674e7fe-4871-405a-a846-f527f258754d" returned: 0 in 0.472s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-5ea9f205-7ae3-470f-9395-efba7ef40cc9 tempest-SnapshotsActionsTest-82182000 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.290s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:27:37 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-5ea9f205-7ae3-470f-9395-efba7ef40cc9 tempest-SnapshotsActionsTest-82182000 None] Create snapshot completed successfully Sep 15 16:27:37 devstack sudo[99965]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9dc3f158-46e6-4925-926c-ffab0ec209bc tempest-VolumesListTestJSON-507613894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-f66eaf19-4941-4911-b26b-dd7fc869d8b2" returned: 0 in 0.493s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9dc3f158-46e6-4925-926c-ffab0ec209bc tempest-VolumesListTestJSON-507613894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-f66eaf19-4941-4911-b26b-dd7fc869d8b2 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:37 devstack sudo[99972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-f66eaf19-4941-4911-b26b-dd7fc869d8b2 Sep 15 16:27:37 devstack sudo[99972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:38 devstack sudo[99972]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9dc3f158-46e6-4925-926c-ffab0ec209bc tempest-VolumesListTestJSON-507613894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-f66eaf19-4941-4911-b26b-dd7fc869d8b2" returned: 0 in 0.282s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:38 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-9dc3f158-46e6-4925-926c-ffab0ec209bc tempest-VolumesListTestJSON-507613894 None] Lock "cinder-quobyte-f66eaf19-4941-4911-b26b-dd7fc869d8b2" released by "delete_volume" :: held 0.846s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:27:38 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-9dc3f158-46e6-4925-926c-ffab0ec209bc tempest-VolumesListTestJSON-507613894 None] Created reservations ['4e59bfad-cbb7-4058-81a8-3b4c4664c83b', '605fcb6e-4f51-4ecc-a721-05b0a616bcfc', '32d80c05-7905-4fa1-9638-a767096b1ae3', '4e60fafa-0e7a-4b38-b1d4-44938e68a782'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:27:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-9dc3f158-46e6-4925-926c-ffab0ec209bc tempest-VolumesListTestJSON-507613894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:27:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-9dc3f158-46e6-4925-926c-ffab0ec209bc tempest-VolumesListTestJSON-507613894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:27:38 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-9dc3f158-46e6-4925-926c-ffab0ec209bc tempest-VolumesListTestJSON-507613894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:27:38 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-9dc3f158-46e6-4925-926c-ffab0ec209bc tempest-VolumesListTestJSON-507613894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:27:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-9dc3f158-46e6-4925-926c-ffab0ec209bc tempest-VolumesListTestJSON-507613894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:27:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9dc3f158-46e6-4925-926c-ffab0ec209bc tempest-VolumesListTestJSON-507613894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:38 devstack sudo[99975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:27:38 devstack sudo[99975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:38 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-018b6cf5-f24b-428d-9275-7ad320a35df7 tempest-VolumesListTestJSON-507613894 None] Acquiring lock "cinder-1016248c-2b8f-435c-84b7-afb152a7200d-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:27:38 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-018b6cf5-f24b-428d-9275-7ad320a35df7 tempest-VolumesListTestJSON-507613894 None] Lock "cinder-1016248c-2b8f-435c-84b7-afb152a7200d-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:27:38 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-018b6cf5-f24b-428d-9275-7ad320a35df7 tempest-VolumesListTestJSON-507613894 None] Acquiring lock "cinder-quobyte-1016248c-2b8f-435c-84b7-afb152a7200d" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:27:38 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-018b6cf5-f24b-428d-9275-7ad320a35df7 tempest-VolumesListTestJSON-507613894 None] Lock "cinder-quobyte-1016248c-2b8f-435c-84b7-afb152a7200d" acquired by "delete_volume" :: waited 0.021s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:27:38 devstack sudo[99975]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9dc3f158-46e6-4925-926c-ffab0ec209bc tempest-VolumesListTestJSON-507613894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.376s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:38 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-9dc3f158-46e6-4925-926c-ffab0ec209bc tempest-VolumesListTestJSON-507613894 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:27:38 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-9dc3f158-46e6-4925-926c-ffab0ec209bc tempest-VolumesListTestJSON-507613894 None] Deleted volume successfully. Sep 15 16:27:38 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c6cc4b8-9a78-4aae-8229-a396a44f9e9d]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:27:38 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-9dc3f158-46e6-4925-926c-ffab0ec209bc tempest-VolumesListTestJSON-507613894 None] Lock "cinder-f66eaf19-4941-4911-b26b-dd7fc869d8b2-delete_volume" released by "delete_volume" :: held 1.484s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:27:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-018b6cf5-f24b-428d-9275-7ad320a35df7 tempest-VolumesListTestJSON-507613894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1016248c-2b8f-435c-84b7-afb152a7200d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:38 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-a13a6dbd-94e2-4c3e-a25a-5adc3a18a8f1 tempest-SnapshotsActionsTest-949396253 None] Acquiring lock "cinder-8674e7fe-4871-405a-a846-f527f258754d-delete_snapshot" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:27:38 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-a13a6dbd-94e2-4c3e-a25a-5adc3a18a8f1 tempest-SnapshotsActionsTest-949396253 None] Lock "cinder-8674e7fe-4871-405a-a846-f527f258754d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:27:38 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-a13a6dbd-94e2-4c3e-a25a-5adc3a18a8f1 tempest-SnapshotsActionsTest-949396253 None] Acquiring lock "cinder-quobyte-279826cc-e702-4b37-9791-7965cec669f5" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:27:38 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-a13a6dbd-94e2-4c3e-a25a-5adc3a18a8f1 tempest-SnapshotsActionsTest-949396253 None] Lock "cinder-quobyte-279826cc-e702-4b37-9791-7965cec669f5" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:27:38 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-a13a6dbd-94e2-4c3e-a25a-5adc3a18a8f1 tempest-SnapshotsActionsTest-949396253 None] Acquiring lock "cinder-quobyte-8674e7fe-4871-405a-a846-f527f258754d" by "_delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:27:38 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-a13a6dbd-94e2-4c3e-a25a-5adc3a18a8f1 tempest-SnapshotsActionsTest-949396253 None] Lock "cinder-quobyte-8674e7fe-4871-405a-a846-f527f258754d" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:27:38 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-a13a6dbd-94e2-4c3e-a25a-5adc3a18a8f1 tempest-SnapshotsActionsTest-949396253 None] Deleting offline snapshot 8674e7fe-4871-405a-a846-f527f258754d of volume 279826cc-e702-4b37-9791-7965cec669f5 {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 15 16:27:38 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-a13a6dbd-94e2-4c3e-a25a-5adc3a18a8f1 tempest-SnapshotsActionsTest-949396253 None] snapshot_file for this snap is: volume-279826cc-e702-4b37-9791-7965cec669f5.8674e7fe-4871-405a-a846-f527f258754d {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 15 16:27:38 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaa97eb2-48f6-4e08-8a0e-6858fbda63d8]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:27:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a13a6dbd-94e2-4c3e-a25a-5adc3a18a8f1 tempest-SnapshotsActionsTest-949396253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.8674e7fe-4871-405a-a846-f527f258754d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:38 devstack sudo[99978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1016248c-2b8f-435c-84b7-afb152a7200d Sep 15 16:27:38 devstack sudo[99978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:38 devstack sudo[99979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.8674e7fe-4871-405a-a846-f527f258754d Sep 15 16:27:38 devstack sudo[99979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:39 devstack sudo[99978]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-018b6cf5-f24b-428d-9275-7ad320a35df7 tempest-VolumesListTestJSON-507613894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1016248c-2b8f-435c-84b7-afb152a7200d" returned: 0 in 0.454s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-018b6cf5-f24b-428d-9275-7ad320a35df7 tempest-VolumesListTestJSON-507613894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1016248c-2b8f-435c-84b7-afb152a7200d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:39 devstack sudo[99985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1016248c-2b8f-435c-84b7-afb152a7200d Sep 15 16:27:39 devstack sudo[99985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:39 devstack sudo[99979]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a13a6dbd-94e2-4c3e-a25a-5adc3a18a8f1 tempest-SnapshotsActionsTest-949396253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.8674e7fe-4871-405a-a846-f527f258754d" returned: 0 in 0.460s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:39 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-a13a6dbd-94e2-4c3e-a25a-5adc3a18a8f1 tempest-SnapshotsActionsTest-949396253 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-279826cc-e702-4b37-9791-7965cec669f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 16:27:39 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[83bb75af-f1f0-4e88-8b64-a9ca687049b2]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:27:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a13a6dbd-94e2-4c3e-a25a-5adc3a18a8f1 tempest-SnapshotsActionsTest-949396253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.df37eddb-733c-42b7-b8aa-ff40e6de1acf {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:39 devstack sudo[99991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.df37eddb-733c-42b7-b8aa-ff40e6de1acf Sep 15 16:27:39 devstack sudo[99991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:39 devstack sudo[99985]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-018b6cf5-f24b-428d-9275-7ad320a35df7 tempest-VolumesListTestJSON-507613894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1016248c-2b8f-435c-84b7-afb152a7200d" returned: 0 in 0.383s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:39 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-018b6cf5-f24b-428d-9275-7ad320a35df7 tempest-VolumesListTestJSON-507613894 None] Lock "cinder-quobyte-1016248c-2b8f-435c-84b7-afb152a7200d" released by "delete_volume" :: held 0.930s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:27:39 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-018b6cf5-f24b-428d-9275-7ad320a35df7 tempest-VolumesListTestJSON-507613894 None] Created reservations ['9385aa13-4d6c-4e94-b005-6f1adcfdb7f5', '3793abaa-9454-48bd-8cc9-7377b7d7b202', '48dcb687-8665-4dea-80ad-3d9810ce696e', '290c38c6-b1b0-4fad-a631-0aa3e28e758a'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:27:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-018b6cf5-f24b-428d-9275-7ad320a35df7 tempest-VolumesListTestJSON-507613894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:27:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-018b6cf5-f24b-428d-9275-7ad320a35df7 tempest-VolumesListTestJSON-507613894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:27:39 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-018b6cf5-f24b-428d-9275-7ad320a35df7 tempest-VolumesListTestJSON-507613894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:27:39 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-018b6cf5-f24b-428d-9275-7ad320a35df7 tempest-VolumesListTestJSON-507613894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:27:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-018b6cf5-f24b-428d-9275-7ad320a35df7 tempest-VolumesListTestJSON-507613894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:27:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-018b6cf5-f24b-428d-9275-7ad320a35df7 tempest-VolumesListTestJSON-507613894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:39 devstack sudo[99994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:27:39 devstack sudo[99994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:39 devstack sudo[99991]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a13a6dbd-94e2-4c3e-a25a-5adc3a18a8f1 tempest-SnapshotsActionsTest-949396253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.df37eddb-733c-42b7-b8aa-ff40e6de1acf" returned: 0 in 0.550s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:39 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-a13a6dbd-94e2-4c3e-a25a-5adc3a18a8f1 tempest-SnapshotsActionsTest-949396253 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-279826cc-e702-4b37-9791-7965cec669f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 16:27:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a13a6dbd-94e2-4c3e-a25a-5adc3a18a8f1 tempest-SnapshotsActionsTest-949396253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.8674e7fe-4871-405a-a846-f527f258754d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:39 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-31107c86-1a26-4bd9-b802-332fe4d87c3e tempest-VolumesListTestJSON-507613894 None] Acquiring lock "cinder-91d81228-c564-4435-8341-e2d7a16ada06-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:27:39 devstack sudo[99999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.8674e7fe-4871-405a-a846-f527f258754d Sep 15 16:27:39 devstack sudo[99999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:39 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-31107c86-1a26-4bd9-b802-332fe4d87c3e tempest-VolumesListTestJSON-507613894 None] Lock "cinder-91d81228-c564-4435-8341-e2d7a16ada06-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:27:40 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-31107c86-1a26-4bd9-b802-332fe4d87c3e tempest-VolumesListTestJSON-507613894 None] Acquiring lock "cinder-quobyte-91d81228-c564-4435-8341-e2d7a16ada06" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:27:40 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-31107c86-1a26-4bd9-b802-332fe4d87c3e tempest-VolumesListTestJSON-507613894 None] Lock "cinder-quobyte-91d81228-c564-4435-8341-e2d7a16ada06" acquired by "delete_volume" :: waited 0.025s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:27:40 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bfe0e12-40ff-46ec-80fa-c3628b8ceea3]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:27:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-31107c86-1a26-4bd9-b802-332fe4d87c3e tempest-VolumesListTestJSON-507613894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-91d81228-c564-4435-8341-e2d7a16ada06 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:40 devstack sudo[99994]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-018b6cf5-f24b-428d-9275-7ad320a35df7 tempest-VolumesListTestJSON-507613894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.396s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:40 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-018b6cf5-f24b-428d-9275-7ad320a35df7 tempest-VolumesListTestJSON-507613894 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:27:40 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-018b6cf5-f24b-428d-9275-7ad320a35df7 tempest-VolumesListTestJSON-507613894 None] Deleted volume successfully. Sep 15 16:27:40 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-018b6cf5-f24b-428d-9275-7ad320a35df7 tempest-VolumesListTestJSON-507613894 None] Lock "cinder-1016248c-2b8f-435c-84b7-afb152a7200d-delete_volume" released by "delete_volume" :: held 1.616s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:27:40 devstack sudo[100002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-91d81228-c564-4435-8341-e2d7a16ada06 Sep 15 16:27:40 devstack sudo[100002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:40 devstack sudo[99999]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a13a6dbd-94e2-4c3e-a25a-5adc3a18a8f1 tempest-SnapshotsActionsTest-949396253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.8674e7fe-4871-405a-a846-f527f258754d" returned: 0 in 0.623s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a13a6dbd-94e2-4c3e-a25a-5adc3a18a8f1 tempest-SnapshotsActionsTest-949396253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.8674e7fe-4871-405a-a846-f527f258754d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:40 devstack sudo[100008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.8674e7fe-4871-405a-a846-f527f258754d Sep 15 16:27:40 devstack sudo[100008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:40 devstack sudo[100002]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-31107c86-1a26-4bd9-b802-332fe4d87c3e tempest-VolumesListTestJSON-507613894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-91d81228-c564-4435-8341-e2d7a16ada06" returned: 0 in 0.564s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-31107c86-1a26-4bd9-b802-332fe4d87c3e tempest-VolumesListTestJSON-507613894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-91d81228-c564-4435-8341-e2d7a16ada06 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:40 devstack sudo[100013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-91d81228-c564-4435-8341-e2d7a16ada06 Sep 15 16:27:40 devstack sudo[100013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:40 devstack sudo[100008]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a13a6dbd-94e2-4c3e-a25a-5adc3a18a8f1 tempest-SnapshotsActionsTest-949396253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.8674e7fe-4871-405a-a846-f527f258754d" returned: 0 in 0.312s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:40 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-a13a6dbd-94e2-4c3e-a25a-5adc3a18a8f1 tempest-SnapshotsActionsTest-949396253 None] Lock "cinder-quobyte-8674e7fe-4871-405a-a846-f527f258754d" released by "_delete_snapshot" :: held 2.111s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:27:40 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-a13a6dbd-94e2-4c3e-a25a-5adc3a18a8f1 tempest-SnapshotsActionsTest-949396253 None] Lock "cinder-quobyte-279826cc-e702-4b37-9791-7965cec669f5" released by "delete_snapshot" :: held 2.137s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:27:41 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-a13a6dbd-94e2-4c3e-a25a-5adc3a18a8f1 tempest-SnapshotsActionsTest-949396253 None] Created reservations ['2754b871-8c8e-4a36-8328-61f4ce526349', 'a8d6757d-a64b-4a7c-8582-728052f09e59', '8f68a7f4-601f-4660-a90d-6d47d3a825c5', 'dfcc62ef-b5fa-475c-95fa-b84c3bb2623c'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:27:41 devstack sudo[100013]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-31107c86-1a26-4bd9-b802-332fe4d87c3e tempest-VolumesListTestJSON-507613894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-91d81228-c564-4435-8341-e2d7a16ada06" returned: 0 in 0.411s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:41 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-31107c86-1a26-4bd9-b802-332fe4d87c3e tempest-VolumesListTestJSON-507613894 None] Lock "cinder-quobyte-91d81228-c564-4435-8341-e2d7a16ada06" released by "delete_volume" :: held 1.049s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:27:41 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-a13a6dbd-94e2-4c3e-a25a-5adc3a18a8f1 tempest-SnapshotsActionsTest-949396253 None] Delete snapshot completed successfully. Sep 15 16:27:41 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-a13a6dbd-94e2-4c3e-a25a-5adc3a18a8f1 tempest-SnapshotsActionsTest-949396253 None] Lock "cinder-8674e7fe-4871-405a-a846-f527f258754d-delete_snapshot" released by "delete_snapshot" :: held 2.394s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:27:41 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-31107c86-1a26-4bd9-b802-332fe4d87c3e tempest-VolumesListTestJSON-507613894 None] Created reservations ['6dfd38df-1fd9-418a-9c50-52ed6edbf68c', '3385d77f-4f3c-436c-8f26-6c8a2718f045', '7e308805-52dc-4f21-9cb9-7c8e4932e958', '07f7984b-33ec-4da2-a2ec-d22b6b1954f5'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:27:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-31107c86-1a26-4bd9-b802-332fe4d87c3e tempest-VolumesListTestJSON-507613894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:27:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-31107c86-1a26-4bd9-b802-332fe4d87c3e tempest-VolumesListTestJSON-507613894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:27:41 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-31107c86-1a26-4bd9-b802-332fe4d87c3e tempest-VolumesListTestJSON-507613894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:27:41 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-31107c86-1a26-4bd9-b802-332fe4d87c3e tempest-VolumesListTestJSON-507613894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:27:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-31107c86-1a26-4bd9-b802-332fe4d87c3e tempest-VolumesListTestJSON-507613894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:27:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-31107c86-1a26-4bd9-b802-332fe4d87c3e tempest-VolumesListTestJSON-507613894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:41 devstack sudo[100017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:27:41 devstack sudo[100017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:41 devstack sudo[100017]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-31107c86-1a26-4bd9-b802-332fe4d87c3e tempest-VolumesListTestJSON-507613894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.266s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:41 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-31107c86-1a26-4bd9-b802-332fe4d87c3e tempest-VolumesListTestJSON-507613894 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:27:41 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-31107c86-1a26-4bd9-b802-332fe4d87c3e tempest-VolumesListTestJSON-507613894 None] Deleted volume successfully. Sep 15 16:27:41 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-31107c86-1a26-4bd9-b802-332fe4d87c3e tempest-VolumesListTestJSON-507613894 None] Lock "cinder-91d81228-c564-4435-8341-e2d7a16ada06-delete_volume" released by "delete_volume" :: held 1.563s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:27:42 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:UPDATE=213,cinder:SELECT=141,cinder:INSERT=56,cinder:DELETE=14 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 16:27:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-767547f5-884a-4a24-8730-4901612b10c8 tempest-SnapshotsActionsTest-82182000 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:27:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-767547f5-884a-4a24-8730-4901612b10c8 tempest-SnapshotsActionsTest-82182000 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:27:42 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-767547f5-884a-4a24-8730-4901612b10c8 tempest-SnapshotsActionsTest-82182000 None] Creating offline snapshot d8038f83-241d-4446-a56f-22e75b54b8b8 of volume 279826cc-e702-4b37-9791-7965cec669f5 {{(pid=86082) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 15 16:27:42 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d3468ae-dd2d-4f6f-95c3-0051b8862ad5]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:27:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-767547f5-884a-4a24-8730-4901612b10c8 tempest-SnapshotsActionsTest-82182000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.df37eddb-733c-42b7-b8aa-ff40e6de1acf {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:42 devstack sudo[100022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.df37eddb-733c-42b7-b8aa-ff40e6de1acf Sep 15 16:27:42 devstack sudo[100022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:43 devstack sudo[100022]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-767547f5-884a-4a24-8730-4901612b10c8 tempest-SnapshotsActionsTest-82182000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.df37eddb-733c-42b7-b8aa-ff40e6de1acf" returned: 0 in 0.494s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:43 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-767547f5-884a-4a24-8730-4901612b10c8 tempest-SnapshotsActionsTest-82182000 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-279826cc-e702-4b37-9791-7965cec669f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 16:27:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-767547f5-884a-4a24-8730-4901612b10c8 tempest-SnapshotsActionsTest-82182000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.df37eddb-733c-42b7-b8aa-ff40e6de1acf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.d8038f83-241d-4446-a56f-22e75b54b8b8 1G {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:43 devstack sudo[100027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.df37eddb-733c-42b7-b8aa-ff40e6de1acf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.d8038f83-241d-4446-a56f-22e75b54b8b8 1G Sep 15 16:27:43 devstack sudo[100027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:43 devstack sudo[100027]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-767547f5-884a-4a24-8730-4901612b10c8 tempest-SnapshotsActionsTest-82182000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.df37eddb-733c-42b7-b8aa-ff40e6de1acf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.d8038f83-241d-4446-a56f-22e75b54b8b8 1G" returned: 0 in 0.678s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-767547f5-884a-4a24-8730-4901612b10c8 tempest-SnapshotsActionsTest-82182000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-279826cc-e702-4b37-9791-7965cec669f5.df37eddb-733c-42b7-b8aa-ff40e6de1acf -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.d8038f83-241d-4446-a56f-22e75b54b8b8 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:43 devstack sudo[100034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-279826cc-e702-4b37-9791-7965cec669f5.df37eddb-733c-42b7-b8aa-ff40e6de1acf -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.d8038f83-241d-4446-a56f-22e75b54b8b8 Sep 15 16:27:43 devstack sudo[100034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:44 devstack sudo[100034]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-767547f5-884a-4a24-8730-4901612b10c8 tempest-SnapshotsActionsTest-82182000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-279826cc-e702-4b37-9791-7965cec669f5.df37eddb-733c-42b7-b8aa-ff40e6de1acf -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.d8038f83-241d-4446-a56f-22e75b54b8b8" returned: 0 in 0.394s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:44 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-767547f5-884a-4a24-8730-4901612b10c8 tempest-SnapshotsActionsTest-82182000 None] /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.d8038f83-241d-4446-a56f-22e75b54b8b8 is being set with open permissions: ugo+rw Sep 15 16:27:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-767547f5-884a-4a24-8730-4901612b10c8 tempest-SnapshotsActionsTest-82182000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.d8038f83-241d-4446-a56f-22e75b54b8b8 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:44 devstack sudo[100039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.d8038f83-241d-4446-a56f-22e75b54b8b8 Sep 15 16:27:44 devstack sudo[100039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:44 devstack sudo[100039]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-767547f5-884a-4a24-8730-4901612b10c8 tempest-SnapshotsActionsTest-82182000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.d8038f83-241d-4446-a56f-22e75b54b8b8" returned: 0 in 0.346s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-767547f5-884a-4a24-8730-4901612b10c8 tempest-SnapshotsActionsTest-82182000 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.110s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:27:44 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-767547f5-884a-4a24-8730-4901612b10c8 tempest-SnapshotsActionsTest-82182000 None] Create snapshot completed successfully Sep 15 16:27:45 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f05fb84a-f765-42c6-8dc9-6e2b802c664c tempest-SnapshotsActionsTest-949396253 None] Acquiring lock "cinder-d8038f83-241d-4446-a56f-22e75b54b8b8-delete_snapshot" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:27:45 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f05fb84a-f765-42c6-8dc9-6e2b802c664c tempest-SnapshotsActionsTest-949396253 None] Lock "cinder-d8038f83-241d-4446-a56f-22e75b54b8b8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:27:45 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f05fb84a-f765-42c6-8dc9-6e2b802c664c tempest-SnapshotsActionsTest-949396253 None] Acquiring lock "cinder-quobyte-279826cc-e702-4b37-9791-7965cec669f5" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:27:45 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f05fb84a-f765-42c6-8dc9-6e2b802c664c tempest-SnapshotsActionsTest-949396253 None] Lock "cinder-quobyte-279826cc-e702-4b37-9791-7965cec669f5" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:27:45 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f05fb84a-f765-42c6-8dc9-6e2b802c664c tempest-SnapshotsActionsTest-949396253 None] Acquiring lock "cinder-quobyte-d8038f83-241d-4446-a56f-22e75b54b8b8" by "_delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:27:45 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f05fb84a-f765-42c6-8dc9-6e2b802c664c tempest-SnapshotsActionsTest-949396253 None] Lock "cinder-quobyte-d8038f83-241d-4446-a56f-22e75b54b8b8" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:27:45 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-f05fb84a-f765-42c6-8dc9-6e2b802c664c tempest-SnapshotsActionsTest-949396253 None] Deleting offline snapshot d8038f83-241d-4446-a56f-22e75b54b8b8 of volume 279826cc-e702-4b37-9791-7965cec669f5 {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 15 16:27:45 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-f05fb84a-f765-42c6-8dc9-6e2b802c664c tempest-SnapshotsActionsTest-949396253 None] snapshot_file for this snap is: volume-279826cc-e702-4b37-9791-7965cec669f5.d8038f83-241d-4446-a56f-22e75b54b8b8 {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 15 16:27:45 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce77866e-190c-48a7-8322-193bf5899081]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:27:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f05fb84a-f765-42c6-8dc9-6e2b802c664c tempest-SnapshotsActionsTest-949396253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.d8038f83-241d-4446-a56f-22e75b54b8b8 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:46 devstack sudo[100042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.d8038f83-241d-4446-a56f-22e75b54b8b8 Sep 15 16:27:46 devstack sudo[100042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:46 devstack sudo[100042]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f05fb84a-f765-42c6-8dc9-6e2b802c664c tempest-SnapshotsActionsTest-949396253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.d8038f83-241d-4446-a56f-22e75b54b8b8" returned: 0 in 0.541s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:46 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-f05fb84a-f765-42c6-8dc9-6e2b802c664c tempest-SnapshotsActionsTest-949396253 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-279826cc-e702-4b37-9791-7965cec669f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 16:27:46 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[8143c2dd-1f74-49ba-b1d1-30dcb5e930e4]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:27:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f05fb84a-f765-42c6-8dc9-6e2b802c664c tempest-SnapshotsActionsTest-949396253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.df37eddb-733c-42b7-b8aa-ff40e6de1acf {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:46 devstack sudo[100048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.df37eddb-733c-42b7-b8aa-ff40e6de1acf Sep 15 16:27:46 devstack sudo[100048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:47 devstack sudo[100048]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f05fb84a-f765-42c6-8dc9-6e2b802c664c tempest-SnapshotsActionsTest-949396253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.df37eddb-733c-42b7-b8aa-ff40e6de1acf" returned: 0 in 0.533s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:47 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-f05fb84a-f765-42c6-8dc9-6e2b802c664c tempest-SnapshotsActionsTest-949396253 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-279826cc-e702-4b37-9791-7965cec669f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 16:27:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f05fb84a-f765-42c6-8dc9-6e2b802c664c tempest-SnapshotsActionsTest-949396253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.d8038f83-241d-4446-a56f-22e75b54b8b8 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:47 devstack sudo[100054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.d8038f83-241d-4446-a56f-22e75b54b8b8 Sep 15 16:27:47 devstack sudo[100054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:47 devstack sudo[100054]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f05fb84a-f765-42c6-8dc9-6e2b802c664c tempest-SnapshotsActionsTest-949396253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.d8038f83-241d-4446-a56f-22e75b54b8b8" returned: 0 in 0.479s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f05fb84a-f765-42c6-8dc9-6e2b802c664c tempest-SnapshotsActionsTest-949396253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.d8038f83-241d-4446-a56f-22e75b54b8b8 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:47 devstack sudo[100060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.d8038f83-241d-4446-a56f-22e75b54b8b8 Sep 15 16:27:47 devstack sudo[100060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:47 devstack sudo[100060]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f05fb84a-f765-42c6-8dc9-6e2b802c664c tempest-SnapshotsActionsTest-949396253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.d8038f83-241d-4446-a56f-22e75b54b8b8" returned: 0 in 0.329s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:47 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f05fb84a-f765-42c6-8dc9-6e2b802c664c tempest-SnapshotsActionsTest-949396253 None] Lock "cinder-quobyte-d8038f83-241d-4446-a56f-22e75b54b8b8" released by "_delete_snapshot" :: held 2.082s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:27:47 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f05fb84a-f765-42c6-8dc9-6e2b802c664c tempest-SnapshotsActionsTest-949396253 None] Lock "cinder-quobyte-279826cc-e702-4b37-9791-7965cec669f5" released by "delete_snapshot" :: held 2.104s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:27:47 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:SELECT=149,cinder:INSERT=41,cinder:UPDATE=186,cinder:DELETE=19 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 16:27:48 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-f05fb84a-f765-42c6-8dc9-6e2b802c664c tempest-SnapshotsActionsTest-949396253 None] Created reservations ['d2be50c6-bac5-4993-9f66-a5a06e10b468', '6d960e69-f450-4187-ad7d-e17be80dec6a', 'b4d67cec-308d-4c04-b5a0-409745ef52f9', '9118b7c3-eae7-4566-90f3-3c548d48d5a9'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:27:48 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-f05fb84a-f765-42c6-8dc9-6e2b802c664c tempest-SnapshotsActionsTest-949396253 None] Delete snapshot completed successfully. Sep 15 16:27:48 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f05fb84a-f765-42c6-8dc9-6e2b802c664c tempest-SnapshotsActionsTest-949396253 None] Lock "cinder-d8038f83-241d-4446-a56f-22e75b54b8b8-delete_snapshot" released by "delete_snapshot" :: held 2.346s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:27:49 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-43186fd9-6dd6-45d5-aac1-3a02be17ebca tempest-SnapshotsActionsTest-82182000 None] Acquiring lock "cinder-df37eddb-733c-42b7-b8aa-ff40e6de1acf-delete_snapshot" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:27:49 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-43186fd9-6dd6-45d5-aac1-3a02be17ebca tempest-SnapshotsActionsTest-82182000 None] Lock "cinder-df37eddb-733c-42b7-b8aa-ff40e6de1acf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:27:49 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-43186fd9-6dd6-45d5-aac1-3a02be17ebca tempest-SnapshotsActionsTest-82182000 None] Acquiring lock "cinder-quobyte-279826cc-e702-4b37-9791-7965cec669f5" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:27:49 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-43186fd9-6dd6-45d5-aac1-3a02be17ebca tempest-SnapshotsActionsTest-82182000 None] Lock "cinder-quobyte-279826cc-e702-4b37-9791-7965cec669f5" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:27:49 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-43186fd9-6dd6-45d5-aac1-3a02be17ebca tempest-SnapshotsActionsTest-82182000 None] Acquiring lock "cinder-quobyte-df37eddb-733c-42b7-b8aa-ff40e6de1acf" by "_delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:27:49 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-43186fd9-6dd6-45d5-aac1-3a02be17ebca tempest-SnapshotsActionsTest-82182000 None] Lock "cinder-quobyte-df37eddb-733c-42b7-b8aa-ff40e6de1acf" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:27:49 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-43186fd9-6dd6-45d5-aac1-3a02be17ebca tempest-SnapshotsActionsTest-82182000 None] Deleting offline snapshot df37eddb-733c-42b7-b8aa-ff40e6de1acf of volume 279826cc-e702-4b37-9791-7965cec669f5 {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 15 16:27:49 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-43186fd9-6dd6-45d5-aac1-3a02be17ebca tempest-SnapshotsActionsTest-82182000 None] snapshot_file for this snap is: volume-279826cc-e702-4b37-9791-7965cec669f5.df37eddb-733c-42b7-b8aa-ff40e6de1acf {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 15 16:27:49 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a40f967-b8d6-41f5-b422-7130962af388]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:27:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-43186fd9-6dd6-45d5-aac1-3a02be17ebca tempest-SnapshotsActionsTest-82182000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.df37eddb-733c-42b7-b8aa-ff40e6de1acf {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:49 devstack sudo[100063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.df37eddb-733c-42b7-b8aa-ff40e6de1acf Sep 15 16:27:49 devstack sudo[100063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:50 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-93b1d423-b1e4-4a5a-8006-7c69e5f2a34c tempest-VolumeImageDependencyTests-1934296222 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:27:50 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-93b1d423-b1e4-4a5a-8006-7c69e5f2a34c tempest-VolumeImageDependencyTests-1934296222 None] Flow 'volume_create_manager' (da7383db-1ec4-4148-a22d-1e691e60c2fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:27:50 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-93b1d423-b1e4-4a5a-8006-7c69e5f2a34c tempest-VolumeImageDependencyTests-1934296222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88406af5-9061-4c4c-bf82-251bb35cddb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:27:50 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-93b1d423-b1e4-4a5a-8006-7c69e5f2a34c tempest-VolumeImageDependencyTests-1934296222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88406af5-9061-4c4c-bf82-251bb35cddb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:27:49Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=995f2cc3-74d7-4389-8ccc-bff9577fc47b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17b91b1f14244e1989275dc4561c9244',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:27:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:27:50Z,use_quota=True,user_id='7b9c3f60b44349d19a0dbe4eb051e1f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:27:50 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-93b1d423-b1e4-4a5a-8006-7c69e5f2a34c tempest-VolumeImageDependencyTests-1934296222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50cc7bf7-1a4b-4e29-90c4-7390839e97d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:27:50 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-93b1d423-b1e4-4a5a-8006-7c69e5f2a34c tempest-VolumeImageDependencyTests-1934296222 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50cc7bf7-1a4b-4e29-90c4-7390839e97d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:27:50 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-93b1d423-b1e4-4a5a-8006-7c69e5f2a34c tempest-VolumeImageDependencyTests-1934296222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ef3fd8d-946f-4437-a642-3ee4b8afaf00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:27:50 devstack cinder-volume[86082]: DEBUG cinder.image.glance [None req-93b1d423-b1e4-4a5a-8006-7c69e5f2a34c tempest-VolumeImageDependencyTests-1934296222 None] Creating Keystone auth plugin from conf {{(pid=86082) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 15 16:27:50 devstack sudo[100063]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-43186fd9-6dd6-45d5-aac1-3a02be17ebca tempest-SnapshotsActionsTest-82182000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.df37eddb-733c-42b7-b8aa-ff40e6de1acf" returned: 0 in 0.505s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:50 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-43186fd9-6dd6-45d5-aac1-3a02be17ebca tempest-SnapshotsActionsTest-82182000 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-279826cc-e702-4b37-9791-7965cec669f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 16:27:50 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf0826ec-ccec-42fb-83f2-46a90459c696]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:27:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-43186fd9-6dd6-45d5-aac1-3a02be17ebca tempest-SnapshotsActionsTest-82182000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:50 devstack sudo[100068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5 Sep 15 16:27:50 devstack sudo[100068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:50 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-93b1d423-b1e4-4a5a-8006-7c69e5f2a34c tempest-VolumeImageDependencyTests-1934296222 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ef3fd8d-946f-4437-a642-3ee4b8afaf00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '995f2cc3-74d7-4389-8ccc-bff9577fc47b', 'volume_name': 'volume-995f2cc3-74d7-4389-8ccc-bff9577fc47b', 'volume_size': 1, 'image_id': 'b3feed53-2c8a-4a65-9c9f-2877b5409e60', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b3feed53-2c8a-4a65-9c9f-2877b5409e60', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '20b48b9b7fd15da4ccba660a6535eb41', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '17b91b1f14244e1989275dc4561c9244', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '59386dfcfdc2be7f8144a32848b8824583cdd432fcb5d0467154a5e4285f9af5f6b7cca9fc7872a66568c3aa11dd777bee6d626b6afde2489253720b6401befd', 'id': 'b3feed53-2c8a-4a65-9c9f-2877b5409e60', 'created_at': datetime.datetime(2026, 9, 15, 14, 27, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 15, 14, 27, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b3feed53-2c8a-4a65-9c9f-2877b5409e60/file', 'properties': {}}, 'image_service': }' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:27:50 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-93b1d423-b1e4-4a5a-8006-7c69e5f2a34c tempest-VolumeImageDependencyTests-1934296222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (023a5e86-bd2a-4a07-bbbb-51a3cb6028f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:27:50 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-93b1d423-b1e4-4a5a-8006-7c69e5f2a34c tempest-VolumeImageDependencyTests-1934296222 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (023a5e86-bd2a-4a07-bbbb-51a3cb6028f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:27:50 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-93b1d423-b1e4-4a5a-8006-7c69e5f2a34c tempest-VolumeImageDependencyTests-1934296222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db5afcaf-7ba1-474c-9a2b-fa5b5200ec4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:27:50 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-93b1d423-b1e4-4a5a-8006-7c69e5f2a34c tempest-VolumeImageDependencyTests-1934296222 None] Volume 995f2cc3-74d7-4389-8ccc-bff9577fc47b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-995f2cc3-74d7-4389-8ccc-bff9577fc47b', 'volume_size': 1, 'image_id': 'b3feed53-2c8a-4a65-9c9f-2877b5409e60', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b3feed53-2c8a-4a65-9c9f-2877b5409e60', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '20b48b9b7fd15da4ccba660a6535eb41', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '17b91b1f14244e1989275dc4561c9244', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '59386dfcfdc2be7f8144a32848b8824583cdd432fcb5d0467154a5e4285f9af5f6b7cca9fc7872a66568c3aa11dd777bee6d626b6afde2489253720b6401befd', 'id': 'b3feed53-2c8a-4a65-9c9f-2877b5409e60', 'created_at': datetime.datetime(2026, 9, 15, 14, 27, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 15, 14, 27, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b3feed53-2c8a-4a65-9c9f-2877b5409e60/file', 'properties': {}}, 'image_service': } Sep 15 16:27:50 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-93b1d423-b1e4-4a5a-8006-7c69e5f2a34c tempest-VolumeImageDependencyTests-1934296222 None] Trying to clone 995f2cc3-74d7-4389-8ccc-bff9577fc47b from image b3feed53-2c8a-4a65-9c9f-2877b5409e60 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b3feed53-2c8a-4a65-9c9f-2877b5409e60', 'metadata': {}}]). {{(pid=86082) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 15 16:27:50 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-93b1d423-b1e4-4a5a-8006-7c69e5f2a34c tempest-VolumeImageDependencyTests-1934296222 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b3feed53-2c8a-4a65-9c9f-2877b5409e60_lsmgukzndevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86082) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 15 16:27:50 devstack cinder-volume[86082]: INFO cinder.image.image_utils [None req-93b1d423-b1e4-4a5a-8006-7c69e5f2a34c tempest-VolumeImageDependencyTests-1934296222 None] Image download 0.00 MB at 0.00 MB/s Sep 15 16:27:50 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[f71725b1-093e-4492-b9bb-eb63df0a18fa]: (4, 'raw') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:27:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-93b1d423-b1e4-4a5a-8006-7c69e5f2a34c tempest-VolumeImageDependencyTests-1934296222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b3feed53-2c8a-4a65-9c9f-2877b5409e60_lsmgukzndevstack@QuobyteHD {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:50 devstack sudo[100068]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-43186fd9-6dd6-45d5-aac1-3a02be17ebca tempest-SnapshotsActionsTest-82182000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5" returned: 0 in 0.555s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-43186fd9-6dd6-45d5-aac1-3a02be17ebca tempest-SnapshotsActionsTest-82182000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.df37eddb-733c-42b7-b8aa-ff40e6de1acf {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:50 devstack sudo[100074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.df37eddb-733c-42b7-b8aa-ff40e6de1acf Sep 15 16:27:50 devstack sudo[100074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:51 devstack sudo[100073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b3feed53-2c8a-4a65-9c9f-2877b5409e60_lsmgukzndevstack@QuobyteHD Sep 15 16:27:51 devstack sudo[100073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:51 devstack sudo[100073]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-93b1d423-b1e4-4a5a-8006-7c69e5f2a34c tempest-VolumeImageDependencyTests-1934296222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b3feed53-2c8a-4a65-9c9f-2877b5409e60_lsmgukzndevstack@QuobyteHD" returned: 0 in 0.491s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-93b1d423-b1e4-4a5a-8006-7c69e5f2a34c tempest-VolumeImageDependencyTests-1934296222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b3feed53-2c8a-4a65-9c9f-2877b5409e60_lsmgukzndevstack@QuobyteHD {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:51 devstack sudo[100074]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-43186fd9-6dd6-45d5-aac1-3a02be17ebca tempest-SnapshotsActionsTest-82182000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.df37eddb-733c-42b7-b8aa-ff40e6de1acf" returned: 0 in 0.581s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-43186fd9-6dd6-45d5-aac1-3a02be17ebca tempest-SnapshotsActionsTest-82182000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.df37eddb-733c-42b7-b8aa-ff40e6de1acf {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:51 devstack sudo[100082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b3feed53-2c8a-4a65-9c9f-2877b5409e60_lsmgukzndevstack@QuobyteHD Sep 15 16:27:51 devstack sudo[100082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:51 devstack sudo[100083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.df37eddb-733c-42b7-b8aa-ff40e6de1acf Sep 15 16:27:51 devstack sudo[100083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:51 devstack sudo[100082]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-93b1d423-b1e4-4a5a-8006-7c69e5f2a34c tempest-VolumeImageDependencyTests-1934296222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b3feed53-2c8a-4a65-9c9f-2877b5409e60_lsmgukzndevstack@QuobyteHD" returned: 1 in 0.443s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-93b1d423-b1e4-4a5a-8006-7c69e5f2a34c tempest-VolumeImageDependencyTests-1934296222 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b3feed53-2c8a-4a65-9c9f-2877b5409e60_lsmgukzndevstack@QuobyteHD' failed. Not Retrying. {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 15 16:27:51 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-93b1d423-b1e4-4a5a-8006-7c69e5f2a34c tempest-VolumeImageDependencyTests-1934296222 None] Temporary image b3feed53-2c8a-4a65-9c9f-2877b5409e60 is fetched for user 7b9c3f60b44349d19a0dbe4eb051e1f7. {{(pid=86082) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 15 16:27:51 devstack sudo[100083]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-43186fd9-6dd6-45d5-aac1-3a02be17ebca tempest-SnapshotsActionsTest-82182000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5.df37eddb-733c-42b7-b8aa-ff40e6de1acf" returned: 0 in 0.339s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:51 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-43186fd9-6dd6-45d5-aac1-3a02be17ebca tempest-SnapshotsActionsTest-82182000 None] Lock "cinder-quobyte-df37eddb-733c-42b7-b8aa-ff40e6de1acf" released by "_delete_snapshot" :: held 2.178s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:27:51 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-43186fd9-6dd6-45d5-aac1-3a02be17ebca tempest-SnapshotsActionsTest-82182000 None] Lock "cinder-quobyte-279826cc-e702-4b37-9791-7965cec669f5" released by "delete_snapshot" :: held 2.208s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:27:51 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3956e70-70be-4942-b1aa-ce507998a49a]: (4, 'raw') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:27:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-93b1d423-b1e4-4a5a-8006-7c69e5f2a34c tempest-VolumeImageDependencyTests-1934296222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b3feed53-2c8a-4a65-9c9f-2877b5409e60_lsmgukzndevstack@QuobyteHD {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:51 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-43186fd9-6dd6-45d5-aac1-3a02be17ebca tempest-SnapshotsActionsTest-82182000 None] Created reservations ['b33f54e9-50d6-4780-9b9f-851bae2739c3', '6cdc0da2-0104-43ef-834b-55eb3ec56aca', '6dd8c0b4-8aa9-4bbf-b724-3487bd317eac', '2b768e6b-1881-4735-8270-a4de10130680'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:27:52 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-43186fd9-6dd6-45d5-aac1-3a02be17ebca tempest-SnapshotsActionsTest-82182000 None] Delete snapshot completed successfully. Sep 15 16:27:52 devstack sudo[100090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b3feed53-2c8a-4a65-9c9f-2877b5409e60_lsmgukzndevstack@QuobyteHD Sep 15 16:27:52 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-43186fd9-6dd6-45d5-aac1-3a02be17ebca tempest-SnapshotsActionsTest-82182000 None] Lock "cinder-df37eddb-733c-42b7-b8aa-ff40e6de1acf-delete_snapshot" released by "delete_snapshot" :: held 2.468s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:27:52 devstack sudo[100090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:52 devstack sudo[100090]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-93b1d423-b1e4-4a5a-8006-7c69e5f2a34c tempest-VolumeImageDependencyTests-1934296222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b3feed53-2c8a-4a65-9c9f-2877b5409e60_lsmgukzndevstack@QuobyteHD" returned: 0 in 0.453s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-93b1d423-b1e4-4a5a-8006-7c69e5f2a34c tempest-VolumeImageDependencyTests-1934296222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b3feed53-2c8a-4a65-9c9f-2877b5409e60_lsmgukzndevstack@QuobyteHD {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:52 devstack sudo[100094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b3feed53-2c8a-4a65-9c9f-2877b5409e60_lsmgukzndevstack@QuobyteHD Sep 15 16:27:52 devstack sudo[100094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:52 devstack sudo[100094]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-93b1d423-b1e4-4a5a-8006-7c69e5f2a34c tempest-VolumeImageDependencyTests-1934296222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b3feed53-2c8a-4a65-9c9f-2877b5409e60_lsmgukzndevstack@QuobyteHD" returned: 1 in 0.380s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-93b1d423-b1e4-4a5a-8006-7c69e5f2a34c tempest-VolumeImageDependencyTests-1934296222 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b3feed53-2c8a-4a65-9c9f-2877b5409e60_lsmgukzndevstack@QuobyteHD' failed. Not Retrying. {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 15 16:27:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-93b1d423-b1e4-4a5a-8006-7c69e5f2a34c tempest-VolumeImageDependencyTests-1934296222 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:27:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-93b1d423-b1e4-4a5a-8006-7c69e5f2a34c tempest-VolumeImageDependencyTests-1934296222 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:27:52 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-93b1d423-b1e4-4a5a-8006-7c69e5f2a34c tempest-VolumeImageDependencyTests-1934296222 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:27:49Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=995f2cc3-74d7-4389-8ccc-bff9577fc47b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='17b91b1f14244e1989275dc4561c9244',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:27:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:27:50Z,use_quota=True,user_id='7b9c3f60b44349d19a0dbe4eb051e1f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:27:52 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-93b1d423-b1e4-4a5a-8006-7c69e5f2a34c tempest-VolumeImageDependencyTests-1934296222 None] Creating volume 995f2cc3-74d7-4389-8ccc-bff9577fc47b {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:27:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-93b1d423-b1e4-4a5a-8006-7c69e5f2a34c tempest-VolumeImageDependencyTests-1934296222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:27:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-93b1d423-b1e4-4a5a-8006-7c69e5f2a34c tempest-VolumeImageDependencyTests-1934296222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:27:52 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-93b1d423-b1e4-4a5a-8006-7c69e5f2a34c tempest-VolumeImageDependencyTests-1934296222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:27:52 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-93b1d423-b1e4-4a5a-8006-7c69e5f2a34c tempest-VolumeImageDependencyTests-1934296222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:27:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-93b1d423-b1e4-4a5a-8006-7c69e5f2a34c tempest-VolumeImageDependencyTests-1934296222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:27:52 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-93b1d423-b1e4-4a5a-8006-7c69e5f2a34c tempest-VolumeImageDependencyTests-1934296222 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:27:52 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-93b1d423-b1e4-4a5a-8006-7c69e5f2a34c tempest-VolumeImageDependencyTests-1934296222 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:27:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-93b1d423-b1e4-4a5a-8006-7c69e5f2a34c tempest-VolumeImageDependencyTests-1934296222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-995f2cc3-74d7-4389-8ccc-bff9577fc47b 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:52 devstack sudo[100099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-995f2cc3-74d7-4389-8ccc-bff9577fc47b 1073741824 Sep 15 16:27:52 devstack sudo[100099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:52 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-0b407e7f-dd10-491e-a66e-3080c208abe6 tempest-SnapshotsActionsTest-82182000 None] Acquiring lock "cinder-279826cc-e702-4b37-9791-7965cec669f5-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:27:52 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-0b407e7f-dd10-491e-a66e-3080c208abe6 tempest-SnapshotsActionsTest-82182000 None] Lock "cinder-279826cc-e702-4b37-9791-7965cec669f5-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:27:53 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-0b407e7f-dd10-491e-a66e-3080c208abe6 tempest-SnapshotsActionsTest-82182000 None] Acquiring lock "cinder-quobyte-279826cc-e702-4b37-9791-7965cec669f5" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:27:53 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-0b407e7f-dd10-491e-a66e-3080c208abe6 tempest-SnapshotsActionsTest-82182000 None] Lock "cinder-quobyte-279826cc-e702-4b37-9791-7965cec669f5" acquired by "delete_volume" :: waited 0.030s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:27:53 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[55797e62-0dfa-4b1c-a951-d8d011ea776e]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:27:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0b407e7f-dd10-491e-a66e-3080c208abe6 tempest-SnapshotsActionsTest-82182000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:53 devstack sudo[100104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5 Sep 15 16:27:53 devstack sudo[100104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:53 devstack sudo[100099]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-93b1d423-b1e4-4a5a-8006-7c69e5f2a34c tempest-VolumeImageDependencyTests-1934296222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-995f2cc3-74d7-4389-8ccc-bff9577fc47b 1073741824" returned: 0 in 0.554s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-93b1d423-b1e4-4a5a-8006-7c69e5f2a34c tempest-VolumeImageDependencyTests-1934296222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-995f2cc3-74d7-4389-8ccc-bff9577fc47b {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:53 devstack sudo[100107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-995f2cc3-74d7-4389-8ccc-bff9577fc47b Sep 15 16:27:53 devstack sudo[100107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:53 devstack sudo[100104]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0b407e7f-dd10-491e-a66e-3080c208abe6 tempest-SnapshotsActionsTest-82182000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5" returned: 0 in 0.441s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0b407e7f-dd10-491e-a66e-3080c208abe6 tempest-SnapshotsActionsTest-82182000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:53 devstack sudo[100113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5 Sep 15 16:27:53 devstack sudo[100113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:53 devstack sudo[100107]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-93b1d423-b1e4-4a5a-8006-7c69e5f2a34c tempest-VolumeImageDependencyTests-1934296222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-995f2cc3-74d7-4389-8ccc-bff9577fc47b" returned: 0 in 0.347s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:53 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-93b1d423-b1e4-4a5a-8006-7c69e5f2a34c tempest-VolumeImageDependencyTests-1934296222 None] <== create_volume: return (955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:27:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-93b1d423-b1e4-4a5a-8006-7c69e5f2a34c tempest-VolumeImageDependencyTests-1934296222 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.959s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:27:53 devstack cinder-volume[86082]: DEBUG cinder.volume.volume_utils [None req-93b1d423-b1e4-4a5a-8006-7c69e5f2a34c tempest-VolumeImageDependencyTests-1934296222 None] Attempting download of b3feed53-2c8a-4a65-9c9f-2877b5409e60 ((None, [{'url': 'file:///opt/stack/data/glance/images/b3feed53-2c8a-4a65-9c9f-2877b5409e60', 'metadata': {}}])) to volume 995f2cc3-74d7-4389-8ccc-bff9577fc47b. {{(pid=86082) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 15 16:27:53 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[04a7e009-ec4c-4022-99f8-e416fac7c498]: (4, 'raw') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:27:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-93b1d423-b1e4-4a5a-8006-7c69e5f2a34c tempest-VolumeImageDependencyTests-1934296222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b3feed53-2c8a-4a65-9c9f-2877b5409e60_ofyzjw4c {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:53 devstack sudo[100113]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0b407e7f-dd10-491e-a66e-3080c208abe6 tempest-SnapshotsActionsTest-82182000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-279826cc-e702-4b37-9791-7965cec669f5" returned: 0 in 0.347s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:53 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-0b407e7f-dd10-491e-a66e-3080c208abe6 tempest-SnapshotsActionsTest-82182000 None] Lock "cinder-quobyte-279826cc-e702-4b37-9791-7965cec669f5" released by "delete_volume" :: held 0.872s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:27:53 devstack sudo[100116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b3feed53-2c8a-4a65-9c9f-2877b5409e60_ofyzjw4c Sep 15 16:27:53 devstack sudo[100116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:54 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-0b407e7f-dd10-491e-a66e-3080c208abe6 tempest-SnapshotsActionsTest-82182000 None] Created reservations ['66322e17-b911-454c-8a9d-31d7db3e7538', 'a06bc782-bac6-4e12-8c2c-2684f9d41b06', '71576b53-4bcc-47a2-bcc4-221509a8fe58', 'c7d05376-eeeb-4219-a56a-49448a1997a5'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:27:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-0b407e7f-dd10-491e-a66e-3080c208abe6 tempest-SnapshotsActionsTest-82182000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:27:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-0b407e7f-dd10-491e-a66e-3080c208abe6 tempest-SnapshotsActionsTest-82182000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:27:54 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-0b407e7f-dd10-491e-a66e-3080c208abe6 tempest-SnapshotsActionsTest-82182000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:27:54 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-0b407e7f-dd10-491e-a66e-3080c208abe6 tempest-SnapshotsActionsTest-82182000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:27:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-0b407e7f-dd10-491e-a66e-3080c208abe6 tempest-SnapshotsActionsTest-82182000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:27:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0b407e7f-dd10-491e-a66e-3080c208abe6 tempest-SnapshotsActionsTest-82182000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:54 devstack sudo[100119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:27:54 devstack sudo[100119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:54 devstack sudo[100116]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-93b1d423-b1e4-4a5a-8006-7c69e5f2a34c tempest-VolumeImageDependencyTests-1934296222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b3feed53-2c8a-4a65-9c9f-2877b5409e60_ofyzjw4c" returned: 0 in 0.494s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-93b1d423-b1e4-4a5a-8006-7c69e5f2a34c tempest-VolumeImageDependencyTests-1934296222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b3feed53-2c8a-4a65-9c9f-2877b5409e60_ofyzjw4c {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:54 devstack sudo[100123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b3feed53-2c8a-4a65-9c9f-2877b5409e60_ofyzjw4c Sep 15 16:27:54 devstack sudo[100123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:54 devstack sudo[100119]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0b407e7f-dd10-491e-a66e-3080c208abe6 tempest-SnapshotsActionsTest-82182000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.339s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:54 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-0b407e7f-dd10-491e-a66e-3080c208abe6 tempest-SnapshotsActionsTest-82182000 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:27:54 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-0b407e7f-dd10-491e-a66e-3080c208abe6 tempest-SnapshotsActionsTest-82182000 None] Deleted volume successfully. Sep 15 16:27:54 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-0b407e7f-dd10-491e-a66e-3080c208abe6 tempest-SnapshotsActionsTest-82182000 None] Lock "cinder-279826cc-e702-4b37-9791-7965cec669f5-delete_volume" released by "delete_volume" :: held 1.606s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:27:54 devstack sudo[100123]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-93b1d423-b1e4-4a5a-8006-7c69e5f2a34c tempest-VolumeImageDependencyTests-1934296222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b3feed53-2c8a-4a65-9c9f-2877b5409e60_ofyzjw4c" returned: 1 in 0.491s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-93b1d423-b1e4-4a5a-8006-7c69e5f2a34c tempest-VolumeImageDependencyTests-1934296222 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b3feed53-2c8a-4a65-9c9f-2877b5409e60_ofyzjw4c' failed. Not Retrying. {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 15 16:27:54 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[18759b48-99a6-4554-b8d0-8eddffb46618]: (4, 'raw') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:27:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-93b1d423-b1e4-4a5a-8006-7c69e5f2a34c tempest-VolumeImageDependencyTests-1934296222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b3feed53-2c8a-4a65-9c9f-2877b5409e60_lsmgukzndevstack@QuobyteHD {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:54 devstack sudo[100128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b3feed53-2c8a-4a65-9c9f-2877b5409e60_lsmgukzndevstack@QuobyteHD Sep 15 16:27:54 devstack sudo[100128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:55 devstack sudo[100128]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-93b1d423-b1e4-4a5a-8006-7c69e5f2a34c tempest-VolumeImageDependencyTests-1934296222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b3feed53-2c8a-4a65-9c9f-2877b5409e60_lsmgukzndevstack@QuobyteHD" returned: 0 in 0.441s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-93b1d423-b1e4-4a5a-8006-7c69e5f2a34c tempest-VolumeImageDependencyTests-1934296222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b3feed53-2c8a-4a65-9c9f-2877b5409e60_lsmgukzndevstack@QuobyteHD {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:55 devstack sudo[100132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b3feed53-2c8a-4a65-9c9f-2877b5409e60_lsmgukzndevstack@QuobyteHD Sep 15 16:27:55 devstack sudo[100132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:55 devstack sudo[100132]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-93b1d423-b1e4-4a5a-8006-7c69e5f2a34c tempest-VolumeImageDependencyTests-1934296222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b3feed53-2c8a-4a65-9c9f-2877b5409e60_lsmgukzndevstack@QuobyteHD" returned: 1 in 0.441s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-93b1d423-b1e4-4a5a-8006-7c69e5f2a34c tempest-VolumeImageDependencyTests-1934296222 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b3feed53-2c8a-4a65-9c9f-2877b5409e60_lsmgukzndevstack@QuobyteHD' failed. Not Retrying. {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 15 16:27:55 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-93b1d423-b1e4-4a5a-8006-7c69e5f2a34c tempest-VolumeImageDependencyTests-1934296222 None] b3feed53-2c8a-4a65-9c9f-2877b5409e60 was raw, converting to qcow2 {{(pid=86082) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 15 16:27:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-93b1d423-b1e4-4a5a-8006-7c69e5f2a34c tempest-VolumeImageDependencyTests-1934296222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b3feed53-2c8a-4a65-9c9f-2877b5409e60_lsmgukzndevstack@QuobyteHD /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-995f2cc3-74d7-4389-8ccc-bff9577fc47b {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:55 devstack sudo[100137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b3feed53-2c8a-4a65-9c9f-2877b5409e60_lsmgukzndevstack@QuobyteHD /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-995f2cc3-74d7-4389-8ccc-bff9577fc47b Sep 15 16:27:55 devstack sudo[100137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:56 devstack sudo[100137]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-93b1d423-b1e4-4a5a-8006-7c69e5f2a34c tempest-VolumeImageDependencyTests-1934296222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b3feed53-2c8a-4a65-9c9f-2877b5409e60_lsmgukzndevstack@QuobyteHD /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-995f2cc3-74d7-4389-8ccc-bff9577fc47b" returned: 0 in 0.710s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:56 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-93b1d423-b1e4-4a5a-8006-7c69e5f2a34c tempest-VolumeImageDependencyTests-1934296222 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b3feed53-2c8a-4a65-9c9f-2877b5409e60_lsmgukzndevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-995f2cc3-74d7-4389-8ccc-bff9577fc47b {{(pid=86082) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 15 16:27:56 devstack cinder-volume[86082]: INFO cinder.image.image_utils [None req-93b1d423-b1e4-4a5a-8006-7c69e5f2a34c tempest-VolumeImageDependencyTests-1934296222 None] Converted 0.00 MB image at 0.00 MB/s Sep 15 16:27:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-93b1d423-b1e4-4a5a-8006-7c69e5f2a34c tempest-VolumeImageDependencyTests-1934296222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-995f2cc3-74d7-4389-8ccc-bff9577fc47b 1G {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:56 devstack sudo[100143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-995f2cc3-74d7-4389-8ccc-bff9577fc47b 1G Sep 15 16:27:56 devstack sudo[100143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:56 devstack sudo[100143]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-93b1d423-b1e4-4a5a-8006-7c69e5f2a34c tempest-VolumeImageDependencyTests-1934296222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-995f2cc3-74d7-4389-8ccc-bff9577fc47b 1G" returned: 0 in 0.425s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:56 devstack cinder-volume[86082]: DEBUG cinder.volume.volume_utils [None req-93b1d423-b1e4-4a5a-8006-7c69e5f2a34c tempest-VolumeImageDependencyTests-1934296222 None] Downloaded image b3feed53-2c8a-4a65-9c9f-2877b5409e60 ((None, [{'url': 'file:///opt/stack/data/glance/images/b3feed53-2c8a-4a65-9c9f-2877b5409e60', 'metadata': {}}])) to volume 995f2cc3-74d7-4389-8ccc-bff9577fc47b successfully. {{(pid=86082) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 15 16:27:56 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-93b1d423-b1e4-4a5a-8006-7c69e5f2a34c tempest-VolumeImageDependencyTests-1934296222 None] Temporary image b3feed53-2c8a-4a65-9c9f-2877b5409e60 for user 7b9c3f60b44349d19a0dbe4eb051e1f7 is deleted. {{(pid=86082) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 15 16:27:56 devstack cinder-volume[86082]: DEBUG cinder.volume.volume_utils [None req-93b1d423-b1e4-4a5a-8006-7c69e5f2a34c tempest-VolumeImageDependencyTests-1934296222 None] Marking volume 995f2cc3-74d7-4389-8ccc-bff9577fc47b as bootable. {{(pid=86082) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 15 16:27:56 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-93b1d423-b1e4-4a5a-8006-7c69e5f2a34c tempest-VolumeImageDependencyTests-1934296222 None] Copying metadata from image b3feed53-2c8a-4a65-9c9f-2877b5409e60 to 995f2cc3-74d7-4389-8ccc-bff9577fc47b. {{(pid=86082) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 15 16:27:56 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-93b1d423-b1e4-4a5a-8006-7c69e5f2a34c tempest-VolumeImageDependencyTests-1934296222 None] Creating volume glance metadata for volume 995f2cc3-74d7-4389-8ccc-bff9577fc47b backed by image b3feed53-2c8a-4a65-9c9f-2877b5409e60 with: {'image_id': 'b3feed53-2c8a-4a65-9c9f-2877b5409e60', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '20b48b9b7fd15da4ccba660a6535eb41', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86082) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 15 16:27:56 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-93b1d423-b1e4-4a5a-8006-7c69e5f2a34c tempest-VolumeImageDependencyTests-1934296222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db5afcaf-7ba1-474c-9a2b-fa5b5200ec4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-995f2cc3-74d7-4389-8ccc-bff9577fc47b', 'volume_size': 1, 'image_id': 'b3feed53-2c8a-4a65-9c9f-2877b5409e60', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b3feed53-2c8a-4a65-9c9f-2877b5409e60', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '20b48b9b7fd15da4ccba660a6535eb41', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '17b91b1f14244e1989275dc4561c9244', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '59386dfcfdc2be7f8144a32848b8824583cdd432fcb5d0467154a5e4285f9af5f6b7cca9fc7872a66568c3aa11dd777bee6d626b6afde2489253720b6401befd', 'id': 'b3feed53-2c8a-4a65-9c9f-2877b5409e60', 'created_at': datetime.datetime(2026, 9, 15, 14, 27, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 15, 14, 27, 49, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b3feed53-2c8a-4a65-9c9f-2877b5409e60/file', 'properties': {}}, 'image_service': }' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:27:56 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-93b1d423-b1e4-4a5a-8006-7c69e5f2a34c tempest-VolumeImageDependencyTests-1934296222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e41f7d04-7dc8-4ad9-9024-ff4e5aa96605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:27:56 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-93b1d423-b1e4-4a5a-8006-7c69e5f2a34c tempest-VolumeImageDependencyTests-1934296222 None] Volume volume-995f2cc3-74d7-4389-8ccc-bff9577fc47b (995f2cc3-74d7-4389-8ccc-bff9577fc47b): created successfully Sep 15 16:27:56 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-93b1d423-b1e4-4a5a-8006-7c69e5f2a34c tempest-VolumeImageDependencyTests-1934296222 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e41f7d04-7dc8-4ad9-9024-ff4e5aa96605) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:27:56 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-93b1d423-b1e4-4a5a-8006-7c69e5f2a34c tempest-VolumeImageDependencyTests-1934296222 None] Flow 'volume_create_manager' (da7383db-1ec4-4148-a22d-1e691e60c2fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:27:56 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-93b1d423-b1e4-4a5a-8006-7c69e5f2a34c tempest-VolumeImageDependencyTests-1934296222 None] Created volume successfully. Sep 15 16:27:57 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c259f5fe-84a0-46f9-846d-1df0b125bfe1 tempest-VolumeImageDependencyTests-1934296222 None] Acquiring lock "cinder-995f2cc3-74d7-4389-8ccc-bff9577fc47b-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:27:57 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c259f5fe-84a0-46f9-846d-1df0b125bfe1 tempest-VolumeImageDependencyTests-1934296222 None] Lock "cinder-995f2cc3-74d7-4389-8ccc-bff9577fc47b-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:27:57 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c259f5fe-84a0-46f9-846d-1df0b125bfe1 tempest-VolumeImageDependencyTests-1934296222 None] Acquiring lock "cinder-quobyte-995f2cc3-74d7-4389-8ccc-bff9577fc47b" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:27:57 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c259f5fe-84a0-46f9-846d-1df0b125bfe1 tempest-VolumeImageDependencyTests-1934296222 None] Lock "cinder-quobyte-995f2cc3-74d7-4389-8ccc-bff9577fc47b" acquired by "delete_volume" :: waited 0.019s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:27:57 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[030f83e2-df1e-442f-b862-7770dd6e2384]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:27:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c259f5fe-84a0-46f9-846d-1df0b125bfe1 tempest-VolumeImageDependencyTests-1934296222 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-995f2cc3-74d7-4389-8ccc-bff9577fc47b {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:58 devstack sudo[100149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-995f2cc3-74d7-4389-8ccc-bff9577fc47b Sep 15 16:27:58 devstack sudo[100149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:58 devstack sudo[100149]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c259f5fe-84a0-46f9-846d-1df0b125bfe1 tempest-VolumeImageDependencyTests-1934296222 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-995f2cc3-74d7-4389-8ccc-bff9577fc47b" returned: 0 in 0.424s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c259f5fe-84a0-46f9-846d-1df0b125bfe1 tempest-VolumeImageDependencyTests-1934296222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-995f2cc3-74d7-4389-8ccc-bff9577fc47b {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:58 devstack sudo[100156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-995f2cc3-74d7-4389-8ccc-bff9577fc47b Sep 15 16:27:58 devstack sudo[100156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:58 devstack sudo[100156]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c259f5fe-84a0-46f9-846d-1df0b125bfe1 tempest-VolumeImageDependencyTests-1934296222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-995f2cc3-74d7-4389-8ccc-bff9577fc47b" returned: 0 in 0.323s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:58 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c259f5fe-84a0-46f9-846d-1df0b125bfe1 tempest-VolumeImageDependencyTests-1934296222 None] Lock "cinder-quobyte-995f2cc3-74d7-4389-8ccc-bff9577fc47b" released by "delete_volume" :: held 0.822s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:27:58 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-c259f5fe-84a0-46f9-846d-1df0b125bfe1 tempest-VolumeImageDependencyTests-1934296222 None] Created reservations ['f4e21f1d-de69-4c45-893d-229143e0403d', 'a4011dc0-cf55-4f36-a841-4dc2dea21f97', 'ba84aaa4-9a1d-40a2-b61d-59c2e531d95e', '1fb18621-33dc-4fb2-8179-9e31004e5034'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:27:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c259f5fe-84a0-46f9-846d-1df0b125bfe1 tempest-VolumeImageDependencyTests-1934296222 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:27:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c259f5fe-84a0-46f9-846d-1df0b125bfe1 tempest-VolumeImageDependencyTests-1934296222 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:27:59 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c259f5fe-84a0-46f9-846d-1df0b125bfe1 tempest-VolumeImageDependencyTests-1934296222 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:27:59 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c259f5fe-84a0-46f9-846d-1df0b125bfe1 tempest-VolumeImageDependencyTests-1934296222 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:27:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c259f5fe-84a0-46f9-846d-1df0b125bfe1 tempest-VolumeImageDependencyTests-1934296222 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:27:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c259f5fe-84a0-46f9-846d-1df0b125bfe1 tempest-VolumeImageDependencyTests-1934296222 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:59 devstack sudo[100159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:27:59 devstack sudo[100159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:27:59 devstack sudo[100159]: pam_unix(sudo:session): session closed for user root Sep 15 16:27:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c259f5fe-84a0-46f9-846d-1df0b125bfe1 tempest-VolumeImageDependencyTests-1934296222 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.367s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:27:59 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-c259f5fe-84a0-46f9-846d-1df0b125bfe1 tempest-VolumeImageDependencyTests-1934296222 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:27:59 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-c259f5fe-84a0-46f9-846d-1df0b125bfe1 tempest-VolumeImageDependencyTests-1934296222 None] Deleted volume successfully. Sep 15 16:27:59 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c259f5fe-84a0-46f9-846d-1df0b125bfe1 tempest-VolumeImageDependencyTests-1934296222 None] Lock "cinder-995f2cc3-74d7-4389-8ccc-bff9577fc47b-delete_volume" released by "delete_volume" :: held 1.667s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:27:59 devstack cinder-volume[86082]: DEBUG oslo_service.periodic_task [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86082) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 15 16:27:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:27:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:27:59 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:27:59 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:27:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:27:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:27:59 devstack sudo[100162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:27:59 devstack sudo[100162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:28:00 devstack sudo[100162]: pam_unix(sudo:session): session closed for user root Sep 15 16:28:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.276s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:28:00 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:28:00 devstack cinder-volume[86082]: DEBUG oslo_service.periodic_task [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Running periodic task VolumeManager._thread_info {{(pid=86082) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 15 16:28:00 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] thread count: 28 {{(pid=86082) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 15 16:28:00 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] thread info: [<_MainThread(MainThread, started 124875935469696)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86082) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 15 16:28:09 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:SELECT=30,cinder:UPDATE=29,cinder:DELETE=1,cinder:INSERT=14 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 16:28:09 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-0931232b-571a-4d94-b29e-1dcf464334ae tempest-ProjectReaderTests-906518931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:28:09 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0931232b-571a-4d94-b29e-1dcf464334ae tempest-ProjectReaderTests-906518931 None] Flow 'volume_create_manager' (d731d6e9-576b-45f7-80b0-4b8f06a319b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:28:09 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0931232b-571a-4d94-b29e-1dcf464334ae tempest-ProjectReaderTests-906518931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7368f19-561e-4ea0-8b32-d8c5497c8a11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:28:09 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0931232b-571a-4d94-b29e-1dcf464334ae tempest-ProjectReaderTests-906518931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7368f19-561e-4ea0-8b32-d8c5497c8a11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:28:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-905323282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41ff07ed-1da6-45ce-92a5-4a7c189260fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7135fd7ff875448c8ba0d42967dc7314',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:28:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:28:09Z,use_quota=True,user_id='48104e23ce7f4e0faf31f359b4d6e929',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:28:09 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0931232b-571a-4d94-b29e-1dcf464334ae tempest-ProjectReaderTests-906518931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (483a8d69-6846-4c8b-b42a-b90649b1f24c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:28:09 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0931232b-571a-4d94-b29e-1dcf464334ae tempest-ProjectReaderTests-906518931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (483a8d69-6846-4c8b-b42a-b90649b1f24c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:28:09 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0931232b-571a-4d94-b29e-1dcf464334ae tempest-ProjectReaderTests-906518931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec96cdfa-58fd-4589-a325-84aec7c94c25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:28:09 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0931232b-571a-4d94-b29e-1dcf464334ae tempest-ProjectReaderTests-906518931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec96cdfa-58fd-4589-a325-84aec7c94c25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41ff07ed-1da6-45ce-92a5-4a7c189260fe', 'volume_name': 'volume-41ff07ed-1da6-45ce-92a5-4a7c189260fe', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:28:09 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0931232b-571a-4d94-b29e-1dcf464334ae tempest-ProjectReaderTests-906518931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b24a1b9-df90-4c0f-892e-927355007798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:28:09 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0931232b-571a-4d94-b29e-1dcf464334ae tempest-ProjectReaderTests-906518931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9b24a1b9-df90-4c0f-892e-927355007798) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:28:09 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0931232b-571a-4d94-b29e-1dcf464334ae tempest-ProjectReaderTests-906518931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f480a567-de4f-4744-ad67-df1eb61d990e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:28:09 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-0931232b-571a-4d94-b29e-1dcf464334ae tempest-ProjectReaderTests-906518931 None] Volume 41ff07ed-1da6-45ce-92a5-4a7c189260fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41ff07ed-1da6-45ce-92a5-4a7c189260fe', 'volume_size': 1} Sep 15 16:28:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-0931232b-571a-4d94-b29e-1dcf464334ae tempest-ProjectReaderTests-906518931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:28:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-0931232b-571a-4d94-b29e-1dcf464334ae tempest-ProjectReaderTests-906518931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:28:09 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-0931232b-571a-4d94-b29e-1dcf464334ae tempest-ProjectReaderTests-906518931 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:28:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-905323282',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41ff07ed-1da6-45ce-92a5-4a7c189260fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7135fd7ff875448c8ba0d42967dc7314',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:28:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:28:09Z,use_quota=True,user_id='48104e23ce7f4e0faf31f359b4d6e929',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:28:09 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-0931232b-571a-4d94-b29e-1dcf464334ae tempest-ProjectReaderTests-906518931 None] Creating volume 41ff07ed-1da6-45ce-92a5-4a7c189260fe {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:28:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-0931232b-571a-4d94-b29e-1dcf464334ae tempest-ProjectReaderTests-906518931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:28:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-0931232b-571a-4d94-b29e-1dcf464334ae tempest-ProjectReaderTests-906518931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:28:09 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-0931232b-571a-4d94-b29e-1dcf464334ae tempest-ProjectReaderTests-906518931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:28:09 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-0931232b-571a-4d94-b29e-1dcf464334ae tempest-ProjectReaderTests-906518931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:28:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-0931232b-571a-4d94-b29e-1dcf464334ae tempest-ProjectReaderTests-906518931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:28:09 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-0931232b-571a-4d94-b29e-1dcf464334ae tempest-ProjectReaderTests-906518931 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:28:09 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-0931232b-571a-4d94-b29e-1dcf464334ae tempest-ProjectReaderTests-906518931 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:28:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0931232b-571a-4d94-b29e-1dcf464334ae tempest-ProjectReaderTests-906518931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-41ff07ed-1da6-45ce-92a5-4a7c189260fe 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:28:09 devstack sudo[100167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-41ff07ed-1da6-45ce-92a5-4a7c189260fe 1073741824 Sep 15 16:28:09 devstack sudo[100167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:28:10 devstack sudo[100167]: pam_unix(sudo:session): session closed for user root Sep 15 16:28:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0931232b-571a-4d94-b29e-1dcf464334ae tempest-ProjectReaderTests-906518931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-41ff07ed-1da6-45ce-92a5-4a7c189260fe 1073741824" returned: 0 in 0.781s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:28:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0931232b-571a-4d94-b29e-1dcf464334ae tempest-ProjectReaderTests-906518931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-41ff07ed-1da6-45ce-92a5-4a7c189260fe {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:28:10 devstack sudo[100173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-41ff07ed-1da6-45ce-92a5-4a7c189260fe Sep 15 16:28:10 devstack sudo[100173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:28:10 devstack sudo[100173]: pam_unix(sudo:session): session closed for user root Sep 15 16:28:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0931232b-571a-4d94-b29e-1dcf464334ae tempest-ProjectReaderTests-906518931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-41ff07ed-1da6-45ce-92a5-4a7c189260fe" returned: 0 in 0.381s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:28:10 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-0931232b-571a-4d94-b29e-1dcf464334ae tempest-ProjectReaderTests-906518931 None] <== create_volume: return (1236ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:28:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-0931232b-571a-4d94-b29e-1dcf464334ae tempest-ProjectReaderTests-906518931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.241s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:28:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0931232b-571a-4d94-b29e-1dcf464334ae tempest-ProjectReaderTests-906518931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f480a567-de4f-4744-ad67-df1eb61d990e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41ff07ed-1da6-45ce-92a5-4a7c189260fe', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:28:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0931232b-571a-4d94-b29e-1dcf464334ae tempest-ProjectReaderTests-906518931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9c13f79-25be-45dd-b135-86d50d5c4d41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:28:10 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-0931232b-571a-4d94-b29e-1dcf464334ae tempest-ProjectReaderTests-906518931 None] Volume volume-41ff07ed-1da6-45ce-92a5-4a7c189260fe (41ff07ed-1da6-45ce-92a5-4a7c189260fe): created successfully Sep 15 16:28:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0931232b-571a-4d94-b29e-1dcf464334ae tempest-ProjectReaderTests-906518931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9c13f79-25be-45dd-b135-86d50d5c4d41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:28:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0931232b-571a-4d94-b29e-1dcf464334ae tempest-ProjectReaderTests-906518931 None] Flow 'volume_create_manager' (d731d6e9-576b-45f7-80b0-4b8f06a319b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:28:10 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-0931232b-571a-4d94-b29e-1dcf464334ae tempest-ProjectReaderTests-906518931 None] Created volume successfully. Sep 15 16:28:11 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-4445b257-38f1-485f-8a6f-4c129564d0b3 tempest-ProjectReaderTests-906518931 None] Acquiring lock "cinder-41ff07ed-1da6-45ce-92a5-4a7c189260fe-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:28:11 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-55f8669d-5ce6-479c-9802-f1765e1c2b92 tempest-SnapshotDependencyTests-1564103874 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:28:11 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-55f8669d-5ce6-479c-9802-f1765e1c2b92 tempest-SnapshotDependencyTests-1564103874 None] Flow 'volume_create_manager' (466cbaba-c720-4d7c-9200-a2bae4fb246f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:28:11 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-55f8669d-5ce6-479c-9802-f1765e1c2b92 tempest-SnapshotDependencyTests-1564103874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afe93695-7627-4736-a5f1-0ec8f08974d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:28:11 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-55f8669d-5ce6-479c-9802-f1765e1c2b92 tempest-SnapshotDependencyTests-1564103874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afe93695-7627-4736-a5f1-0ec8f08974d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:28:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1375864060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebb4f137-5833-46f7-bcfa-81c4dab94be4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4671e9354896492994b74beb5390392a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:28:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:28:12Z,use_quota=True,user_id='34fc1392f4bd4a9cb37166f2d4061cfd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:28:11 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-55f8669d-5ce6-479c-9802-f1765e1c2b92 tempest-SnapshotDependencyTests-1564103874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36a523ea-ec66-419f-84bf-75c192b8104f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:28:11 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-55f8669d-5ce6-479c-9802-f1765e1c2b92 tempest-SnapshotDependencyTests-1564103874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36a523ea-ec66-419f-84bf-75c192b8104f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:28:11 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-55f8669d-5ce6-479c-9802-f1765e1c2b92 tempest-SnapshotDependencyTests-1564103874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56f06d81-361f-46f9-b3d7-bfbaf5ccab19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:28:11 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-55f8669d-5ce6-479c-9802-f1765e1c2b92 tempest-SnapshotDependencyTests-1564103874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56f06d81-361f-46f9-b3d7-bfbaf5ccab19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebb4f137-5833-46f7-bcfa-81c4dab94be4', 'volume_name': 'volume-ebb4f137-5833-46f7-bcfa-81c4dab94be4', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:28:11 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-55f8669d-5ce6-479c-9802-f1765e1c2b92 tempest-SnapshotDependencyTests-1564103874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95b8d0ce-b5f3-451d-8aeb-f5099cbd02f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:28:11 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-55f8669d-5ce6-479c-9802-f1765e1c2b92 tempest-SnapshotDependencyTests-1564103874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95b8d0ce-b5f3-451d-8aeb-f5099cbd02f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:28:11 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-55f8669d-5ce6-479c-9802-f1765e1c2b92 tempest-SnapshotDependencyTests-1564103874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a80e3d8a-0d3a-4e04-9ff6-2fdd093c457a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:28:11 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-55f8669d-5ce6-479c-9802-f1765e1c2b92 tempest-SnapshotDependencyTests-1564103874 None] Volume ebb4f137-5833-46f7-bcfa-81c4dab94be4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebb4f137-5833-46f7-bcfa-81c4dab94be4', 'volume_size': 1} Sep 15 16:28:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-55f8669d-5ce6-479c-9802-f1765e1c2b92 tempest-SnapshotDependencyTests-1564103874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:28:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-55f8669d-5ce6-479c-9802-f1765e1c2b92 tempest-SnapshotDependencyTests-1564103874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:28:11 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-55f8669d-5ce6-479c-9802-f1765e1c2b92 tempest-SnapshotDependencyTests-1564103874 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:28:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1375864060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebb4f137-5833-46f7-bcfa-81c4dab94be4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4671e9354896492994b74beb5390392a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:28:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:28:12Z,use_quota=True,user_id='34fc1392f4bd4a9cb37166f2d4061cfd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:28:11 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-55f8669d-5ce6-479c-9802-f1765e1c2b92 tempest-SnapshotDependencyTests-1564103874 None] Creating volume ebb4f137-5833-46f7-bcfa-81c4dab94be4 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:28:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-55f8669d-5ce6-479c-9802-f1765e1c2b92 tempest-SnapshotDependencyTests-1564103874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:28:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-55f8669d-5ce6-479c-9802-f1765e1c2b92 tempest-SnapshotDependencyTests-1564103874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:28:11 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-55f8669d-5ce6-479c-9802-f1765e1c2b92 tempest-SnapshotDependencyTests-1564103874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:28:11 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-55f8669d-5ce6-479c-9802-f1765e1c2b92 tempest-SnapshotDependencyTests-1564103874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:28:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-55f8669d-5ce6-479c-9802-f1765e1c2b92 tempest-SnapshotDependencyTests-1564103874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:28:11 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-55f8669d-5ce6-479c-9802-f1765e1c2b92 tempest-SnapshotDependencyTests-1564103874 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:28:11 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-55f8669d-5ce6-479c-9802-f1765e1c2b92 tempest-SnapshotDependencyTests-1564103874 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:28:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-55f8669d-5ce6-479c-9802-f1765e1c2b92 tempest-SnapshotDependencyTests-1564103874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ebb4f137-5833-46f7-bcfa-81c4dab94be4 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:28:11 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-4445b257-38f1-485f-8a6f-4c129564d0b3 tempest-ProjectReaderTests-906518931 None] Lock "cinder-41ff07ed-1da6-45ce-92a5-4a7c189260fe-delete_volume" acquired by "delete_volume" :: waited 0.149s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:28:11 devstack sudo[100177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ebb4f137-5833-46f7-bcfa-81c4dab94be4 1073741824 Sep 15 16:28:11 devstack sudo[100177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:28:11 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-4445b257-38f1-485f-8a6f-4c129564d0b3 tempest-ProjectReaderTests-906518931 None] Acquiring lock "cinder-quobyte-41ff07ed-1da6-45ce-92a5-4a7c189260fe" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:28:11 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-4445b257-38f1-485f-8a6f-4c129564d0b3 tempest-ProjectReaderTests-906518931 None] Lock "cinder-quobyte-41ff07ed-1da6-45ce-92a5-4a7c189260fe" acquired by "delete_volume" :: waited 0.016s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:28:11 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e2a28d1-e47f-4443-815a-9106903f4408]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:28:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4445b257-38f1-485f-8a6f-4c129564d0b3 tempest-ProjectReaderTests-906518931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-41ff07ed-1da6-45ce-92a5-4a7c189260fe {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:28:12 devstack sudo[100179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-41ff07ed-1da6-45ce-92a5-4a7c189260fe Sep 15 16:28:12 devstack sudo[100179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:28:12 devstack sudo[100177]: pam_unix(sudo:session): session closed for user root Sep 15 16:28:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-55f8669d-5ce6-479c-9802-f1765e1c2b92 tempest-SnapshotDependencyTests-1564103874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ebb4f137-5833-46f7-bcfa-81c4dab94be4 1073741824" returned: 0 in 0.608s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:28:12 devstack sudo[100179]: pam_unix(sudo:session): session closed for user root Sep 15 16:28:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4445b257-38f1-485f-8a6f-4c129564d0b3 tempest-ProjectReaderTests-906518931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-41ff07ed-1da6-45ce-92a5-4a7c189260fe" returned: 0 in 0.507s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:28:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4445b257-38f1-485f-8a6f-4c129564d0b3 tempest-ProjectReaderTests-906518931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-41ff07ed-1da6-45ce-92a5-4a7c189260fe {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:28:12 devstack sudo[100188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-41ff07ed-1da6-45ce-92a5-4a7c189260fe Sep 15 16:28:12 devstack sudo[100188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:28:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-55f8669d-5ce6-479c-9802-f1765e1c2b92 tempest-SnapshotDependencyTests-1564103874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ebb4f137-5833-46f7-bcfa-81c4dab94be4 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:28:12 devstack sudo[100190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ebb4f137-5833-46f7-bcfa-81c4dab94be4 Sep 15 16:28:12 devstack sudo[100190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:28:12 devstack sudo[100188]: pam_unix(sudo:session): session closed for user root Sep 15 16:28:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4445b257-38f1-485f-8a6f-4c129564d0b3 tempest-ProjectReaderTests-906518931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-41ff07ed-1da6-45ce-92a5-4a7c189260fe" returned: 0 in 0.339s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:28:12 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-4445b257-38f1-485f-8a6f-4c129564d0b3 tempest-ProjectReaderTests-906518931 None] Lock "cinder-quobyte-41ff07ed-1da6-45ce-92a5-4a7c189260fe" released by "delete_volume" :: held 0.917s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:28:12 devstack sudo[100190]: pam_unix(sudo:session): session closed for user root Sep 15 16:28:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-55f8669d-5ce6-479c-9802-f1765e1c2b92 tempest-SnapshotDependencyTests-1564103874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ebb4f137-5833-46f7-bcfa-81c4dab94be4" returned: 0 in 0.402s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:28:12 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-55f8669d-5ce6-479c-9802-f1765e1c2b92 tempest-SnapshotDependencyTests-1564103874 None] <== create_volume: return (1088ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:28:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-55f8669d-5ce6-479c-9802-f1765e1c2b92 tempest-SnapshotDependencyTests-1564103874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.090s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:28:12 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-4445b257-38f1-485f-8a6f-4c129564d0b3 tempest-ProjectReaderTests-906518931 None] Created reservations ['096a63f6-e583-4b06-bb4c-2b41605f5ecd', '4f01d4c8-666f-4b87-8db4-4cf48aeb191b', '47add443-f597-4755-8001-65adc320d544', 'b2abcd2c-4c62-4a34-8173-a8cc00a0c76e'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:28:12 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-55f8669d-5ce6-479c-9802-f1765e1c2b92 tempest-SnapshotDependencyTests-1564103874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a80e3d8a-0d3a-4e04-9ff6-2fdd093c457a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebb4f137-5833-46f7-bcfa-81c4dab94be4', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:28:12 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-55f8669d-5ce6-479c-9802-f1765e1c2b92 tempest-SnapshotDependencyTests-1564103874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4fc27b7-0045-4369-975d-69c548def317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:28:12 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-55f8669d-5ce6-479c-9802-f1765e1c2b92 tempest-SnapshotDependencyTests-1564103874 None] Volume volume-ebb4f137-5833-46f7-bcfa-81c4dab94be4 (ebb4f137-5833-46f7-bcfa-81c4dab94be4): created successfully Sep 15 16:28:12 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-55f8669d-5ce6-479c-9802-f1765e1c2b92 tempest-SnapshotDependencyTests-1564103874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4fc27b7-0045-4369-975d-69c548def317) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:28:12 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-55f8669d-5ce6-479c-9802-f1765e1c2b92 tempest-SnapshotDependencyTests-1564103874 None] Flow 'volume_create_manager' (466cbaba-c720-4d7c-9200-a2bae4fb246f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:28:12 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-55f8669d-5ce6-479c-9802-f1765e1c2b92 tempest-SnapshotDependencyTests-1564103874 None] Created volume successfully. Sep 15 16:28:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-4445b257-38f1-485f-8a6f-4c129564d0b3 tempest-ProjectReaderTests-906518931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:28:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-4445b257-38f1-485f-8a6f-4c129564d0b3 tempest-ProjectReaderTests-906518931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:28:12 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-4445b257-38f1-485f-8a6f-4c129564d0b3 tempest-ProjectReaderTests-906518931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:28:12 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-4445b257-38f1-485f-8a6f-4c129564d0b3 tempest-ProjectReaderTests-906518931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:28:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-4445b257-38f1-485f-8a6f-4c129564d0b3 tempest-ProjectReaderTests-906518931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:28:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4445b257-38f1-485f-8a6f-4c129564d0b3 tempest-ProjectReaderTests-906518931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:28:12 devstack sudo[100194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:28:12 devstack sudo[100194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:28:13 devstack sudo[100194]: pam_unix(sudo:session): session closed for user root Sep 15 16:28:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4445b257-38f1-485f-8a6f-4c129564d0b3 tempest-ProjectReaderTests-906518931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.260s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:28:13 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-4445b257-38f1-485f-8a6f-4c129564d0b3 tempest-ProjectReaderTests-906518931 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:28:13 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-4445b257-38f1-485f-8a6f-4c129564d0b3 tempest-ProjectReaderTests-906518931 None] Deleted volume successfully. Sep 15 16:28:13 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-4445b257-38f1-485f-8a6f-4c129564d0b3 tempest-ProjectReaderTests-906518931 None] Lock "cinder-41ff07ed-1da6-45ce-92a5-4a7c189260fe-delete_volume" released by "delete_volume" :: held 1.497s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:28:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-5352a1aa-0aa2-4e8b-bce7-6e1527142a02 tempest-SnapshotDependencyTests-1564103874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:28:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-5352a1aa-0aa2-4e8b-bce7-6e1527142a02 tempest-SnapshotDependencyTests-1564103874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:28:14 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-5352a1aa-0aa2-4e8b-bce7-6e1527142a02 tempest-SnapshotDependencyTests-1564103874 None] Creating offline snapshot 61bb2823-566e-482b-a792-9d9601060b27 of volume ebb4f137-5833-46f7-bcfa-81c4dab94be4 {{(pid=86082) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 15 16:28:14 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c28bc98-6b31-4cbd-b374-36879b04855d]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:28:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5352a1aa-0aa2-4e8b-bce7-6e1527142a02 tempest-SnapshotDependencyTests-1564103874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ebb4f137-5833-46f7-bcfa-81c4dab94be4 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:28:14 devstack sudo[100197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ebb4f137-5833-46f7-bcfa-81c4dab94be4 Sep 15 16:28:14 devstack sudo[100197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:28:14 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-f774ccfa-61a1-469f-8d66-72c3faceb54d tempest-ProjectReaderTests-906518931 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:28:14 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f774ccfa-61a1-469f-8d66-72c3faceb54d tempest-ProjectReaderTests-906518931 None] Flow 'volume_create_manager' (7fe4d170-1d0c-4859-b167-c9b77476edc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:28:14 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f774ccfa-61a1-469f-8d66-72c3faceb54d tempest-ProjectReaderTests-906518931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c64be635-53b5-4afe-9ad7-ed20312b9925) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:28:14 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f774ccfa-61a1-469f-8d66-72c3faceb54d tempest-ProjectReaderTests-906518931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c64be635-53b5-4afe-9ad7-ed20312b9925) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:28:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-894048817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2db191c0-a002-4735-ba11-de7635530d50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7135fd7ff875448c8ba0d42967dc7314',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:28:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:28:14Z,use_quota=True,user_id='48104e23ce7f4e0faf31f359b4d6e929',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:28:14 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f774ccfa-61a1-469f-8d66-72c3faceb54d tempest-ProjectReaderTests-906518931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcbbb9ab-d2a8-459a-839d-e1a9b49640a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:28:14 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f774ccfa-61a1-469f-8d66-72c3faceb54d tempest-ProjectReaderTests-906518931 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcbbb9ab-d2a8-459a-839d-e1a9b49640a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:28:14 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f774ccfa-61a1-469f-8d66-72c3faceb54d tempest-ProjectReaderTests-906518931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53bf8eda-2c8c-4d98-87c0-8a0cbf31b884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:28:14 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f774ccfa-61a1-469f-8d66-72c3faceb54d tempest-ProjectReaderTests-906518931 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53bf8eda-2c8c-4d98-87c0-8a0cbf31b884) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2db191c0-a002-4735-ba11-de7635530d50', 'volume_name': 'volume-2db191c0-a002-4735-ba11-de7635530d50', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:28:14 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f774ccfa-61a1-469f-8d66-72c3faceb54d tempest-ProjectReaderTests-906518931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bde6e19a-be90-4935-a4d8-4aa2ebcd571f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:28:14 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f774ccfa-61a1-469f-8d66-72c3faceb54d tempest-ProjectReaderTests-906518931 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bde6e19a-be90-4935-a4d8-4aa2ebcd571f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:28:14 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f774ccfa-61a1-469f-8d66-72c3faceb54d tempest-ProjectReaderTests-906518931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (631da1e2-4fc4-4973-b781-f45d6a7794fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:28:14 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-f774ccfa-61a1-469f-8d66-72c3faceb54d tempest-ProjectReaderTests-906518931 None] Volume 2db191c0-a002-4735-ba11-de7635530d50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2db191c0-a002-4735-ba11-de7635530d50', 'volume_size': 1} Sep 15 16:28:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f774ccfa-61a1-469f-8d66-72c3faceb54d tempest-ProjectReaderTests-906518931 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:28:14 devstack sudo[100197]: pam_unix(sudo:session): session closed for user root Sep 15 16:28:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5352a1aa-0aa2-4e8b-bce7-6e1527142a02 tempest-SnapshotDependencyTests-1564103874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ebb4f137-5833-46f7-bcfa-81c4dab94be4" returned: 0 in 0.543s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:28:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5352a1aa-0aa2-4e8b-bce7-6e1527142a02 tempest-SnapshotDependencyTests-1564103874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ebb4f137-5833-46f7-bcfa-81c4dab94be4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ebb4f137-5833-46f7-bcfa-81c4dab94be4.61bb2823-566e-482b-a792-9d9601060b27 1G {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:28:14 devstack sudo[100202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ebb4f137-5833-46f7-bcfa-81c4dab94be4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ebb4f137-5833-46f7-bcfa-81c4dab94be4.61bb2823-566e-482b-a792-9d9601060b27 1G Sep 15 16:28:14 devstack sudo[100202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:28:15 devstack sudo[100202]: pam_unix(sudo:session): session closed for user root Sep 15 16:28:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5352a1aa-0aa2-4e8b-bce7-6e1527142a02 tempest-SnapshotDependencyTests-1564103874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ebb4f137-5833-46f7-bcfa-81c4dab94be4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ebb4f137-5833-46f7-bcfa-81c4dab94be4.61bb2823-566e-482b-a792-9d9601060b27 1G" returned: 0 in 0.592s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:28:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5352a1aa-0aa2-4e8b-bce7-6e1527142a02 tempest-SnapshotDependencyTests-1564103874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebb4f137-5833-46f7-bcfa-81c4dab94be4 -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ebb4f137-5833-46f7-bcfa-81c4dab94be4.61bb2823-566e-482b-a792-9d9601060b27 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:28:15 devstack sudo[100242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebb4f137-5833-46f7-bcfa-81c4dab94be4 -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ebb4f137-5833-46f7-bcfa-81c4dab94be4.61bb2823-566e-482b-a792-9d9601060b27 Sep 15 16:28:15 devstack sudo[100242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:28:15 devstack sudo[100242]: pam_unix(sudo:session): session closed for user root Sep 15 16:28:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5352a1aa-0aa2-4e8b-bce7-6e1527142a02 tempest-SnapshotDependencyTests-1564103874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ebb4f137-5833-46f7-bcfa-81c4dab94be4 -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ebb4f137-5833-46f7-bcfa-81c4dab94be4.61bb2823-566e-482b-a792-9d9601060b27" returned: 0 in 0.543s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:28:15 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-5352a1aa-0aa2-4e8b-bce7-6e1527142a02 tempest-SnapshotDependencyTests-1564103874 None] /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ebb4f137-5833-46f7-bcfa-81c4dab94be4.61bb2823-566e-482b-a792-9d9601060b27 is being set with open permissions: ugo+rw Sep 15 16:28:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5352a1aa-0aa2-4e8b-bce7-6e1527142a02 tempest-SnapshotDependencyTests-1564103874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ebb4f137-5833-46f7-bcfa-81c4dab94be4.61bb2823-566e-482b-a792-9d9601060b27 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:28:15 devstack sudo[100250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ebb4f137-5833-46f7-bcfa-81c4dab94be4.61bb2823-566e-482b-a792-9d9601060b27 Sep 15 16:28:15 devstack sudo[100250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:28:16 devstack sudo[100250]: pam_unix(sudo:session): session closed for user root Sep 15 16:28:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5352a1aa-0aa2-4e8b-bce7-6e1527142a02 tempest-SnapshotDependencyTests-1564103874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ebb4f137-5833-46f7-bcfa-81c4dab94be4.61bb2823-566e-482b-a792-9d9601060b27" returned: 0 in 0.374s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:28:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5352a1aa-0aa2-4e8b-bce7-6e1527142a02 tempest-SnapshotDependencyTests-1564103874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ebb4f137-5833-46f7-bcfa-81c4dab94be4.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:28:16 devstack sudo[100253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ebb4f137-5833-46f7-bcfa-81c4dab94be4.info Sep 15 16:28:16 devstack sudo[100253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:28:16 devstack sudo[100253]: pam_unix(sudo:session): session closed for user root Sep 15 16:28:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5352a1aa-0aa2-4e8b-bce7-6e1527142a02 tempest-SnapshotDependencyTests-1564103874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ebb4f137-5833-46f7-bcfa-81c4dab94be4.info" returned: 0 in 0.358s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:28:16 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-5352a1aa-0aa2-4e8b-bce7-6e1527142a02 tempest-SnapshotDependencyTests-1564103874 None] /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ebb4f137-5833-46f7-bcfa-81c4dab94be4.info is being set with open permissions: ugo+rw Sep 15 16:28:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5352a1aa-0aa2-4e8b-bce7-6e1527142a02 tempest-SnapshotDependencyTests-1564103874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ebb4f137-5833-46f7-bcfa-81c4dab94be4.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:28:16 devstack sudo[100256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ebb4f137-5833-46f7-bcfa-81c4dab94be4.info Sep 15 16:28:16 devstack sudo[100256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:28:16 devstack sudo[100256]: pam_unix(sudo:session): session closed for user root Sep 15 16:28:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5352a1aa-0aa2-4e8b-bce7-6e1527142a02 tempest-SnapshotDependencyTests-1564103874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ebb4f137-5833-46f7-bcfa-81c4dab94be4.info" returned: 0 in 0.376s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:28:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-5352a1aa-0aa2-4e8b-bce7-6e1527142a02 tempest-SnapshotDependencyTests-1564103874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.927s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:28:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f774ccfa-61a1-469f-8d66-72c3faceb54d tempest-ProjectReaderTests-906518931 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.359s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:28:16 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-f774ccfa-61a1-469f-8d66-72c3faceb54d tempest-ProjectReaderTests-906518931 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:28:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-894048817',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2db191c0-a002-4735-ba11-de7635530d50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7135fd7ff875448c8ba0d42967dc7314',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:28:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:28:14Z,use_quota=True,user_id='48104e23ce7f4e0faf31f359b4d6e929',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:28:16 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-f774ccfa-61a1-469f-8d66-72c3faceb54d tempest-ProjectReaderTests-906518931 None] Creating volume 2db191c0-a002-4735-ba11-de7635530d50 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:28:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f774ccfa-61a1-469f-8d66-72c3faceb54d tempest-ProjectReaderTests-906518931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:28:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f774ccfa-61a1-469f-8d66-72c3faceb54d tempest-ProjectReaderTests-906518931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:28:16 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-f774ccfa-61a1-469f-8d66-72c3faceb54d tempest-ProjectReaderTests-906518931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:28:16 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-f774ccfa-61a1-469f-8d66-72c3faceb54d tempest-ProjectReaderTests-906518931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:28:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f774ccfa-61a1-469f-8d66-72c3faceb54d tempest-ProjectReaderTests-906518931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:28:16 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-f774ccfa-61a1-469f-8d66-72c3faceb54d tempest-ProjectReaderTests-906518931 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:28:16 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-f774ccfa-61a1-469f-8d66-72c3faceb54d tempest-ProjectReaderTests-906518931 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:28:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f774ccfa-61a1-469f-8d66-72c3faceb54d tempest-ProjectReaderTests-906518931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2db191c0-a002-4735-ba11-de7635530d50 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:28:17 devstack sudo[100260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2db191c0-a002-4735-ba11-de7635530d50 1073741824 Sep 15 16:28:17 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-5352a1aa-0aa2-4e8b-bce7-6e1527142a02 tempest-SnapshotDependencyTests-1564103874 None] Create snapshot completed successfully Sep 15 16:28:17 devstack sudo[100260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:28:17 devstack sudo[100260]: pam_unix(sudo:session): session closed for user root Sep 15 16:28:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f774ccfa-61a1-469f-8d66-72c3faceb54d tempest-ProjectReaderTests-906518931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2db191c0-a002-4735-ba11-de7635530d50 1073741824" returned: 0 in 0.772s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:28:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f774ccfa-61a1-469f-8d66-72c3faceb54d tempest-ProjectReaderTests-906518931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2db191c0-a002-4735-ba11-de7635530d50 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:28:17 devstack sudo[100266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2db191c0-a002-4735-ba11-de7635530d50 Sep 15 16:28:17 devstack sudo[100266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:28:18 devstack sudo[100266]: pam_unix(sudo:session): session closed for user root Sep 15 16:28:18 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-af892051-c253-48cd-b1d9-dde53743032b tempest-SnapshotDependencyTests-1564103874 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:28:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f774ccfa-61a1-469f-8d66-72c3faceb54d tempest-ProjectReaderTests-906518931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2db191c0-a002-4735-ba11-de7635530d50" returned: 0 in 0.393s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:28:18 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-f774ccfa-61a1-469f-8d66-72c3faceb54d tempest-ProjectReaderTests-906518931 None] <== create_volume: return (1256ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:28:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f774ccfa-61a1-469f-8d66-72c3faceb54d tempest-ProjectReaderTests-906518931 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.259s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:28:18 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f774ccfa-61a1-469f-8d66-72c3faceb54d tempest-ProjectReaderTests-906518931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (631da1e2-4fc4-4973-b781-f45d6a7794fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2db191c0-a002-4735-ba11-de7635530d50', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:28:18 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f774ccfa-61a1-469f-8d66-72c3faceb54d tempest-ProjectReaderTests-906518931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf224999-6e72-4143-8c88-a2255f6e24ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:28:18 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-af892051-c253-48cd-b1d9-dde53743032b tempest-SnapshotDependencyTests-1564103874 None] Flow 'volume_create_manager' (e45a5432-dac7-4f63-b37c-383f6f2d5f31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:28:18 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-af892051-c253-48cd-b1d9-dde53743032b tempest-SnapshotDependencyTests-1564103874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (010c9210-7657-493d-92ef-97c285ecfaa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:28:18 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-f774ccfa-61a1-469f-8d66-72c3faceb54d tempest-ProjectReaderTests-906518931 None] Volume volume-2db191c0-a002-4735-ba11-de7635530d50 (2db191c0-a002-4735-ba11-de7635530d50): created successfully Sep 15 16:28:18 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f774ccfa-61a1-469f-8d66-72c3faceb54d tempest-ProjectReaderTests-906518931 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf224999-6e72-4143-8c88-a2255f6e24ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:28:18 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f774ccfa-61a1-469f-8d66-72c3faceb54d tempest-ProjectReaderTests-906518931 None] Flow 'volume_create_manager' (7fe4d170-1d0c-4859-b167-c9b77476edc0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:28:18 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-af892051-c253-48cd-b1d9-dde53743032b tempest-SnapshotDependencyTests-1564103874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (010c9210-7657-493d-92ef-97c285ecfaa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:28:18Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08338982-4f57-40fc-a632-89f3f52afa97,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4671e9354896492994b74beb5390392a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:28:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=61bb2823-566e-482b-a792-9d9601060b27,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:28:18Z,use_quota=True,user_id='34fc1392f4bd4a9cb37166f2d4061cfd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:28:18 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-af892051-c253-48cd-b1d9-dde53743032b tempest-SnapshotDependencyTests-1564103874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1908de65-cc61-4450-a491-1dcc15b94c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:28:18 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-af892051-c253-48cd-b1d9-dde53743032b tempest-SnapshotDependencyTests-1564103874 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1908de65-cc61-4450-a491-1dcc15b94c3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:28:18 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-af892051-c253-48cd-b1d9-dde53743032b tempest-SnapshotDependencyTests-1564103874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (034c9cf6-6387-40ee-9453-5b7b73dd48c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:28:18 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-af892051-c253-48cd-b1d9-dde53743032b tempest-SnapshotDependencyTests-1564103874 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (034c9cf6-6387-40ee-9453-5b7b73dd48c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '08338982-4f57-40fc-a632-89f3f52afa97', 'volume_name': 'volume-08338982-4f57-40fc-a632-89f3f52afa97', 'volume_size': 1, 'snapshot_id': '61bb2823-566e-482b-a792-9d9601060b27'}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:28:18 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-af892051-c253-48cd-b1d9-dde53743032b tempest-SnapshotDependencyTests-1564103874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (619336a4-c638-43a1-8576-73abcbc408a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:28:18 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-af892051-c253-48cd-b1d9-dde53743032b tempest-SnapshotDependencyTests-1564103874 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (619336a4-c638-43a1-8576-73abcbc408a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:28:18 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-af892051-c253-48cd-b1d9-dde53743032b tempest-SnapshotDependencyTests-1564103874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (635f7ea2-106c-4334-9048-927d8f2b8434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:28:18 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-af892051-c253-48cd-b1d9-dde53743032b tempest-SnapshotDependencyTests-1564103874 None] Volume 08338982-4f57-40fc-a632-89f3f52afa97: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-08338982-4f57-40fc-a632-89f3f52afa97', 'volume_size': 1, 'snapshot_id': '61bb2823-566e-482b-a792-9d9601060b27'} Sep 15 16:28:18 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-f774ccfa-61a1-469f-8d66-72c3faceb54d tempest-ProjectReaderTests-906518931 None] Created volume successfully. Sep 15 16:28:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-af892051-c253-48cd-b1d9-dde53743032b tempest-SnapshotDependencyTests-1564103874 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:28:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-af892051-c253-48cd-b1d9-dde53743032b tempest-SnapshotDependencyTests-1564103874 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:28:18 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-af892051-c253-48cd-b1d9-dde53743032b tempest-SnapshotDependencyTests-1564103874 None] Acquiring lock "cinder-quobyte-61bb2823-566e-482b-a792-9d9601060b27-08338982-4f57-40fc-a632-89f3f52afa97" by "_create_volume_from_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:28:18 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-af892051-c253-48cd-b1d9-dde53743032b tempest-SnapshotDependencyTests-1564103874 None] Lock "cinder-quobyte-61bb2823-566e-482b-a792-9d9601060b27-08338982-4f57-40fc-a632-89f3f52afa97" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:28:18 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-af892051-c253-48cd-b1d9-dde53743032b tempest-SnapshotDependencyTests-1564103874 None] Creating volume 08338982-4f57-40fc-a632-89f3f52afa97 from snapshot 61bb2823-566e-482b-a792-9d9601060b27 {{(pid=86082) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 15 16:28:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-af892051-c253-48cd-b1d9-dde53743032b tempest-SnapshotDependencyTests-1564103874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:28:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-af892051-c253-48cd-b1d9-dde53743032b tempest-SnapshotDependencyTests-1564103874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:28:18 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-af892051-c253-48cd-b1d9-dde53743032b tempest-SnapshotDependencyTests-1564103874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:28:18 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-af892051-c253-48cd-b1d9-dde53743032b tempest-SnapshotDependencyTests-1564103874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:28:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-af892051-c253-48cd-b1d9-dde53743032b tempest-SnapshotDependencyTests-1564103874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:28:18 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-af892051-c253-48cd-b1d9-dde53743032b tempest-SnapshotDependencyTests-1564103874 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:28:18 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-af892051-c253-48cd-b1d9-dde53743032b tempest-SnapshotDependencyTests-1564103874 None] Acquiring lock "cinder-quobyte-08338982-4f57-40fc-a632-89f3f52afa97" by "_copy_volume_from_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:28:18 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-af892051-c253-48cd-b1d9-dde53743032b tempest-SnapshotDependencyTests-1564103874 None] Lock "cinder-quobyte-08338982-4f57-40fc-a632-89f3f52afa97" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:28:18 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-af892051-c253-48cd-b1d9-dde53743032b tempest-SnapshotDependencyTests-1564103874 None] snapshot: 61bb2823-566e-482b-a792-9d9601060b27, volume: 08338982-4f57-40fc-a632-89f3f52afa97, {{(pid=86082) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 15 16:28:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-af892051-c253-48cd-b1d9-dde53743032b tempest-SnapshotDependencyTests-1564103874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:28:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-af892051-c253-48cd-b1d9-dde53743032b tempest-SnapshotDependencyTests-1564103874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:28:18 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-af892051-c253-48cd-b1d9-dde53743032b tempest-SnapshotDependencyTests-1564103874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:28:18 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-af892051-c253-48cd-b1d9-dde53743032b tempest-SnapshotDependencyTests-1564103874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:28:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-af892051-c253-48cd-b1d9-dde53743032b tempest-SnapshotDependencyTests-1564103874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:28:18 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[530ba2bf-c6d4-4714-88e4-b6966c47ec59]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:28:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-af892051-c253-48cd-b1d9-dde53743032b tempest-SnapshotDependencyTests-1564103874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ebb4f137-5833-46f7-bcfa-81c4dab94be4.61bb2823-566e-482b-a792-9d9601060b27 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:28:18 devstack sudo[100269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ebb4f137-5833-46f7-bcfa-81c4dab94be4.61bb2823-566e-482b-a792-9d9601060b27 Sep 15 16:28:18 devstack sudo[100269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:28:18 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-d58a86bd-6f61-4661-90ff-f42a664c8956 tempest-ProjectReaderTests-906518931 None] Acquiring lock "cinder-2db191c0-a002-4735-ba11-de7635530d50-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:28:18 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-d58a86bd-6f61-4661-90ff-f42a664c8956 tempest-ProjectReaderTests-906518931 None] Lock "cinder-2db191c0-a002-4735-ba11-de7635530d50-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:28:18 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-d58a86bd-6f61-4661-90ff-f42a664c8956 tempest-ProjectReaderTests-906518931 None] Acquiring lock "cinder-quobyte-2db191c0-a002-4735-ba11-de7635530d50" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:28:19 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-d58a86bd-6f61-4661-90ff-f42a664c8956 tempest-ProjectReaderTests-906518931 None] Lock "cinder-quobyte-2db191c0-a002-4735-ba11-de7635530d50" acquired by "delete_volume" :: waited 0.023s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:28:19 devstack sudo[100269]: pam_unix(sudo:session): session closed for user root Sep 15 16:28:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-af892051-c253-48cd-b1d9-dde53743032b tempest-SnapshotDependencyTests-1564103874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ebb4f137-5833-46f7-bcfa-81c4dab94be4.61bb2823-566e-482b-a792-9d9601060b27" returned: 0 in 0.527s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:28:19 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-af892051-c253-48cd-b1d9-dde53743032b tempest-SnapshotDependencyTests-1564103874 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ebb4f137-5833-46f7-bcfa-81c4dab94be4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 16:28:19 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[55fd919a-5f40-49ac-b99a-61f58c2f8150]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:28:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d58a86bd-6f61-4661-90ff-f42a664c8956 tempest-ProjectReaderTests-906518931 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2db191c0-a002-4735-ba11-de7635530d50 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:28:19 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[75930a3e-380e-4e22-8769-85997fc6ca2a]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:28:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-af892051-c253-48cd-b1d9-dde53743032b tempest-SnapshotDependencyTests-1564103874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ebb4f137-5833-46f7-bcfa-81c4dab94be4 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:28:19 devstack sudo[100274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2db191c0-a002-4735-ba11-de7635530d50 Sep 15 16:28:19 devstack sudo[100274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:28:19 devstack sudo[100275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ebb4f137-5833-46f7-bcfa-81c4dab94be4 Sep 15 16:28:19 devstack sudo[100275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:28:19 devstack sudo[100274]: pam_unix(sudo:session): session closed for user root Sep 15 16:28:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d58a86bd-6f61-4661-90ff-f42a664c8956 tempest-ProjectReaderTests-906518931 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2db191c0-a002-4735-ba11-de7635530d50" returned: 0 in 0.571s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:28:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d58a86bd-6f61-4661-90ff-f42a664c8956 tempest-ProjectReaderTests-906518931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2db191c0-a002-4735-ba11-de7635530d50 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:28:19 devstack sudo[100275]: pam_unix(sudo:session): session closed for user root Sep 15 16:28:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-af892051-c253-48cd-b1d9-dde53743032b tempest-SnapshotDependencyTests-1564103874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ebb4f137-5833-46f7-bcfa-81c4dab94be4" returned: 0 in 0.589s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:28:19 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-af892051-c253-48cd-b1d9-dde53743032b tempest-SnapshotDependencyTests-1564103874 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ebb4f137-5833-46f7-bcfa-81c4dab94be4 {{(pid=86082) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 15 16:28:19 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-af892051-c253-48cd-b1d9-dde53743032b tempest-SnapshotDependencyTests-1564103874 None] Creating direct copy from snapshot {{(pid=86082) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 15 16:28:19 devstack cinder-volume[86082]: DEBUG cinder.utils [None req-af892051-c253-48cd-b1d9-dde53743032b tempest-SnapshotDependencyTests-1564103874 None] Path /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-08338982-4f57-40fc-a632-89f3f52afa97 not found in is_blk_device check {{(pid=86082) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 15 16:28:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-af892051-c253-48cd-b1d9-dde53743032b tempest-SnapshotDependencyTests-1564103874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ebb4f137-5833-46f7-bcfa-81c4dab94be4 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-08338982-4f57-40fc-a632-89f3f52afa97 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:28:19 devstack sudo[100285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2db191c0-a002-4735-ba11-de7635530d50 Sep 15 16:28:19 devstack sudo[100285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:28:19 devstack sudo[100287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ebb4f137-5833-46f7-bcfa-81c4dab94be4 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-08338982-4f57-40fc-a632-89f3f52afa97 Sep 15 16:28:19 devstack sudo[100287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:28:19 devstack sudo[100285]: pam_unix(sudo:session): session closed for user root Sep 15 16:28:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d58a86bd-6f61-4661-90ff-f42a664c8956 tempest-ProjectReaderTests-906518931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2db191c0-a002-4735-ba11-de7635530d50" returned: 0 in 0.318s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:28:19 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-d58a86bd-6f61-4661-90ff-f42a664c8956 tempest-ProjectReaderTests-906518931 None] Lock "cinder-quobyte-2db191c0-a002-4735-ba11-de7635530d50" released by "delete_volume" :: held 0.944s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:28:20 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-d58a86bd-6f61-4661-90ff-f42a664c8956 tempest-ProjectReaderTests-906518931 None] Created reservations ['73eabf00-53ba-4304-bffe-a92d3e07f862', 'ddaa0d7c-1b92-4718-8904-bdafea9cc243', '51cfe130-c135-41d4-8acc-a78c57fcc224', '20f330ec-71fa-4b4a-83de-de3c5f459dd0'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:28:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-d58a86bd-6f61-4661-90ff-f42a664c8956 tempest-ProjectReaderTests-906518931 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:28:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-d58a86bd-6f61-4661-90ff-f42a664c8956 tempest-ProjectReaderTests-906518931 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:28:20 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-d58a86bd-6f61-4661-90ff-f42a664c8956 tempest-ProjectReaderTests-906518931 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:28:20 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-d58a86bd-6f61-4661-90ff-f42a664c8956 tempest-ProjectReaderTests-906518931 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:28:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-d58a86bd-6f61-4661-90ff-f42a664c8956 tempest-ProjectReaderTests-906518931 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:28:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d58a86bd-6f61-4661-90ff-f42a664c8956 tempest-ProjectReaderTests-906518931 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:28:20 devstack sudo[100293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:28:20 devstack sudo[100293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:28:20 devstack sudo[100293]: pam_unix(sudo:session): session closed for user root Sep 15 16:28:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d58a86bd-6f61-4661-90ff-f42a664c8956 tempest-ProjectReaderTests-906518931 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.498s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:28:20 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-d58a86bd-6f61-4661-90ff-f42a664c8956 tempest-ProjectReaderTests-906518931 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:28:20 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-d58a86bd-6f61-4661-90ff-f42a664c8956 tempest-ProjectReaderTests-906518931 None] Deleted volume successfully. Sep 15 16:28:20 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-d58a86bd-6f61-4661-90ff-f42a664c8956 tempest-ProjectReaderTests-906518931 None] Lock "cinder-2db191c0-a002-4735-ba11-de7635530d50-delete_volume" released by "delete_volume" :: held 1.850s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:28:21 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-9332a6f2-c309-4c7e-a061-b8acc9772fd1 tempest-TestServerVolumeAttachmentScenario-1564993328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:28:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9332a6f2-c309-4c7e-a061-b8acc9772fd1 tempest-TestServerVolumeAttachmentScenario-1564993328 None] Flow 'volume_create_manager' (b8b0f6a9-aaac-4552-a3bf-e08fdc3fb438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:28:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9332a6f2-c309-4c7e-a061-b8acc9772fd1 tempest-TestServerVolumeAttachmentScenario-1564993328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cb97820-dce7-4725-bc69-96377adb235c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:28:22 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9332a6f2-c309-4c7e-a061-b8acc9772fd1 tempest-TestServerVolumeAttachmentScenario-1564993328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cb97820-dce7-4725-bc69-96377adb235c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:28:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-682636344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06f3fa68-94ee-4f9b-8a79-5dde93802350,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66eae75bf1574121b0e1975b73bb63d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:28:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:28:22Z,use_quota=True,user_id='4f79bc0262944535a94395dc92fe1c84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:28:22 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9332a6f2-c309-4c7e-a061-b8acc9772fd1 tempest-TestServerVolumeAttachmentScenario-1564993328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6335e71-0e15-48c0-ab66-3d19a31a0c6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:28:22 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9332a6f2-c309-4c7e-a061-b8acc9772fd1 tempest-TestServerVolumeAttachmentScenario-1564993328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6335e71-0e15-48c0-ab66-3d19a31a0c6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:28:22 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9332a6f2-c309-4c7e-a061-b8acc9772fd1 tempest-TestServerVolumeAttachmentScenario-1564993328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96d8fe89-6683-4485-8be7-767c816022cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:28:22 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9332a6f2-c309-4c7e-a061-b8acc9772fd1 tempest-TestServerVolumeAttachmentScenario-1564993328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96d8fe89-6683-4485-8be7-767c816022cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06f3fa68-94ee-4f9b-8a79-5dde93802350', 'volume_name': 'volume-06f3fa68-94ee-4f9b-8a79-5dde93802350', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:28:22 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9332a6f2-c309-4c7e-a061-b8acc9772fd1 tempest-TestServerVolumeAttachmentScenario-1564993328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8975ae6b-2ecd-43b4-a395-6e22e6414378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:28:22 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9332a6f2-c309-4c7e-a061-b8acc9772fd1 tempest-TestServerVolumeAttachmentScenario-1564993328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8975ae6b-2ecd-43b4-a395-6e22e6414378) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:28:22 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9332a6f2-c309-4c7e-a061-b8acc9772fd1 tempest-TestServerVolumeAttachmentScenario-1564993328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (546e3623-c1b5-40fa-a4ca-cde5470b1471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:28:22 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-9332a6f2-c309-4c7e-a061-b8acc9772fd1 tempest-TestServerVolumeAttachmentScenario-1564993328 None] Volume 06f3fa68-94ee-4f9b-8a79-5dde93802350: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06f3fa68-94ee-4f9b-8a79-5dde93802350', 'volume_size': 1} Sep 15 16:28:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-9332a6f2-c309-4c7e-a061-b8acc9772fd1 tempest-TestServerVolumeAttachmentScenario-1564993328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:28:22 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a734e15-87c8-4ac2-850b-33df716a7b4e tempest-TestServerVolumeAttachmentScenario-1564993328 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:28:23 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2a734e15-87c8-4ac2-850b-33df716a7b4e tempest-TestServerVolumeAttachmentScenario-1564993328 None] Flow 'volume_create_manager' (dea76240-daee-43a2-8040-18b4799cb8b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:28:23 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2a734e15-87c8-4ac2-850b-33df716a7b4e tempest-TestServerVolumeAttachmentScenario-1564993328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1350a5a1-322a-4454-bba4-38b9fbba59de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:28:23 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2a734e15-87c8-4ac2-850b-33df716a7b4e tempest-TestServerVolumeAttachmentScenario-1564993328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1350a5a1-322a-4454-bba4-38b9fbba59de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:28:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-364862072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1c51ebf-b0d2-4737-ac5c-e15b99e8db4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66eae75bf1574121b0e1975b73bb63d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:28:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:28:23Z,use_quota=True,user_id='4f79bc0262944535a94395dc92fe1c84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:28:23 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2a734e15-87c8-4ac2-850b-33df716a7b4e tempest-TestServerVolumeAttachmentScenario-1564993328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62da3571-5d65-4957-86a5-999fc83f59b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:28:23 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2a734e15-87c8-4ac2-850b-33df716a7b4e tempest-TestServerVolumeAttachmentScenario-1564993328 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62da3571-5d65-4957-86a5-999fc83f59b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:28:23 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2a734e15-87c8-4ac2-850b-33df716a7b4e tempest-TestServerVolumeAttachmentScenario-1564993328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79f630cd-bf85-4bd6-a6e1-b335ac610c86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:28:23 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2a734e15-87c8-4ac2-850b-33df716a7b4e tempest-TestServerVolumeAttachmentScenario-1564993328 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79f630cd-bf85-4bd6-a6e1-b335ac610c86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1c51ebf-b0d2-4737-ac5c-e15b99e8db4b', 'volume_name': 'volume-f1c51ebf-b0d2-4737-ac5c-e15b99e8db4b', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:28:23 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2a734e15-87c8-4ac2-850b-33df716a7b4e tempest-TestServerVolumeAttachmentScenario-1564993328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (493e13e8-ac6d-4431-98ff-b3db96799f00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:28:23 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2a734e15-87c8-4ac2-850b-33df716a7b4e tempest-TestServerVolumeAttachmentScenario-1564993328 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (493e13e8-ac6d-4431-98ff-b3db96799f00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:28:23 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2a734e15-87c8-4ac2-850b-33df716a7b4e tempest-TestServerVolumeAttachmentScenario-1564993328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df91245c-29b7-4a57-a67e-6b08b924d91c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:28:23 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-2a734e15-87c8-4ac2-850b-33df716a7b4e tempest-TestServerVolumeAttachmentScenario-1564993328 None] Volume f1c51ebf-b0d2-4737-ac5c-e15b99e8db4b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1c51ebf-b0d2-4737-ac5c-e15b99e8db4b', 'volume_size': 1} Sep 15 16:28:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-2a734e15-87c8-4ac2-850b-33df716a7b4e tempest-TestServerVolumeAttachmentScenario-1564993328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:28:29 devstack sudo[100287]: pam_unix(sudo:session): session closed for user root Sep 15 16:28:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-af892051-c253-48cd-b1d9-dde53743032b tempest-SnapshotDependencyTests-1564103874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ebb4f137-5833-46f7-bcfa-81c4dab94be4 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-08338982-4f57-40fc-a632-89f3f52afa97" returned: 0 in 9.836s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:28:29 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-af892051-c253-48cd-b1d9-dde53743032b tempest-SnapshotDependencyTests-1564103874 None] Image conversion details: src /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ebb4f137-5833-46f7-bcfa-81c4dab94be4, size 1024.00 MB, duration 9.84 sec, destination /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-08338982-4f57-40fc-a632-89f3f52afa97 {{(pid=86082) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 15 16:28:29 devstack cinder-volume[86082]: INFO cinder.image.image_utils [None req-af892051-c253-48cd-b1d9-dde53743032b tempest-SnapshotDependencyTests-1564103874 None] Converted 1024.00 MB image at 104.08 MB/s Sep 15 16:28:29 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-af892051-c253-48cd-b1d9-dde53743032b tempest-SnapshotDependencyTests-1564103874 None] /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-08338982-4f57-40fc-a632-89f3f52afa97 is being set with open permissions: ugo+rw Sep 15 16:28:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-af892051-c253-48cd-b1d9-dde53743032b tempest-SnapshotDependencyTests-1564103874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-08338982-4f57-40fc-a632-89f3f52afa97 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:28:29 devstack sudo[100308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-08338982-4f57-40fc-a632-89f3f52afa97 Sep 15 16:28:29 devstack sudo[100308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:28:29 devstack sudo[100308]: pam_unix(sudo:session): session closed for user root Sep 15 16:28:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-af892051-c253-48cd-b1d9-dde53743032b tempest-SnapshotDependencyTests-1564103874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-08338982-4f57-40fc-a632-89f3f52afa97" returned: 0 in 0.344s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:28:29 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-af892051-c253-48cd-b1d9-dde53743032b tempest-SnapshotDependencyTests-1564103874 None] Lock "cinder-quobyte-08338982-4f57-40fc-a632-89f3f52afa97" released by "_copy_volume_from_snapshot" :: held 11.426s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:28:29 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-af892051-c253-48cd-b1d9-dde53743032b tempest-SnapshotDependencyTests-1564103874 None] Lock "cinder-quobyte-61bb2823-566e-482b-a792-9d9601060b27-08338982-4f57-40fc-a632-89f3f52afa97" released by "_create_volume_from_snapshot" :: held 11.520s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:28:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-af892051-c253-48cd-b1d9-dde53743032b tempest-SnapshotDependencyTests-1564103874 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.540s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:28:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-9332a6f2-c309-4c7e-a061-b8acc9772fd1 tempest-TestServerVolumeAttachmentScenario-1564993328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.746s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:28:29 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-9332a6f2-c309-4c7e-a061-b8acc9772fd1 tempest-TestServerVolumeAttachmentScenario-1564993328 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:28:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-682636344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06f3fa68-94ee-4f9b-8a79-5dde93802350,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66eae75bf1574121b0e1975b73bb63d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:28:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:28:22Z,use_quota=True,user_id='4f79bc0262944535a94395dc92fe1c84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:28:29 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-9332a6f2-c309-4c7e-a061-b8acc9772fd1 tempest-TestServerVolumeAttachmentScenario-1564993328 None] Creating volume 06f3fa68-94ee-4f9b-8a79-5dde93802350 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:28:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-9332a6f2-c309-4c7e-a061-b8acc9772fd1 tempest-TestServerVolumeAttachmentScenario-1564993328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:28:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-9332a6f2-c309-4c7e-a061-b8acc9772fd1 tempest-TestServerVolumeAttachmentScenario-1564993328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:28:29 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-9332a6f2-c309-4c7e-a061-b8acc9772fd1 tempest-TestServerVolumeAttachmentScenario-1564993328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:28:29 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-9332a6f2-c309-4c7e-a061-b8acc9772fd1 tempest-TestServerVolumeAttachmentScenario-1564993328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:28:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-9332a6f2-c309-4c7e-a061-b8acc9772fd1 tempest-TestServerVolumeAttachmentScenario-1564993328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:28:29 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-9332a6f2-c309-4c7e-a061-b8acc9772fd1 tempest-TestServerVolumeAttachmentScenario-1564993328 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:28:29 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-9332a6f2-c309-4c7e-a061-b8acc9772fd1 tempest-TestServerVolumeAttachmentScenario-1564993328 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:28:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9332a6f2-c309-4c7e-a061-b8acc9772fd1 tempest-TestServerVolumeAttachmentScenario-1564993328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-06f3fa68-94ee-4f9b-8a79-5dde93802350 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:28:29 devstack sudo[100311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-06f3fa68-94ee-4f9b-8a79-5dde93802350 1073741824 Sep 15 16:28:29 devstack sudo[100311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:28:30 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-af892051-c253-48cd-b1d9-dde53743032b tempest-SnapshotDependencyTests-1564103874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (635f7ea2-106c-4334-9048-927d8f2b8434) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08338982-4f57-40fc-a632-89f3f52afa97', 'volume_size': 1, 'snapshot_id': '61bb2823-566e-482b-a792-9d9601060b27'}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:28:30 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-af892051-c253-48cd-b1d9-dde53743032b tempest-SnapshotDependencyTests-1564103874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f81f9363-abae-4f27-8136-476612d943ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:28:30 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-af892051-c253-48cd-b1d9-dde53743032b tempest-SnapshotDependencyTests-1564103874 None] Volume volume-08338982-4f57-40fc-a632-89f3f52afa97 (08338982-4f57-40fc-a632-89f3f52afa97): created successfully Sep 15 16:28:30 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-af892051-c253-48cd-b1d9-dde53743032b tempest-SnapshotDependencyTests-1564103874 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f81f9363-abae-4f27-8136-476612d943ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:28:30 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-af892051-c253-48cd-b1d9-dde53743032b tempest-SnapshotDependencyTests-1564103874 None] Flow 'volume_create_manager' (e45a5432-dac7-4f63-b37c-383f6f2d5f31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:28:30 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-af892051-c253-48cd-b1d9-dde53743032b tempest-SnapshotDependencyTests-1564103874 None] Created volume successfully. Sep 15 16:28:30 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-0734f1b4-0cc2-4750-ad60-24130da8b876 tempest-ProjectReaderTests-1166262798 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:28:30 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0734f1b4-0cc2-4750-ad60-24130da8b876 tempest-ProjectReaderTests-1166262798 None] Flow 'volume_create_manager' (67520fb2-9898-42a8-ba57-afda25bd7e8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:28:30 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0734f1b4-0cc2-4750-ad60-24130da8b876 tempest-ProjectReaderTests-1166262798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c1412e3-10e7-42c0-8dc8-0d55c4b90cd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:28:30 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0734f1b4-0cc2-4750-ad60-24130da8b876 tempest-ProjectReaderTests-1166262798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c1412e3-10e7-42c0-8dc8-0d55c4b90cd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:28:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-455450196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f098a206-235d-46ec-aa96-6819fa2e5eb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f10add438931461e934dfa3f3d813619',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:28:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:28:30Z,use_quota=True,user_id='4927118af22042fc91a74b27416b4df3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:28:30 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0734f1b4-0cc2-4750-ad60-24130da8b876 tempest-ProjectReaderTests-1166262798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cffba86c-705f-497f-baf5-8dffc9578948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:28:30 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0734f1b4-0cc2-4750-ad60-24130da8b876 tempest-ProjectReaderTests-1166262798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cffba86c-705f-497f-baf5-8dffc9578948) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:28:30 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0734f1b4-0cc2-4750-ad60-24130da8b876 tempest-ProjectReaderTests-1166262798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8047f4c-c05d-47f2-b93d-01e7e4a74421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:28:30 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0734f1b4-0cc2-4750-ad60-24130da8b876 tempest-ProjectReaderTests-1166262798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8047f4c-c05d-47f2-b93d-01e7e4a74421) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f098a206-235d-46ec-aa96-6819fa2e5eb6', 'volume_name': 'volume-f098a206-235d-46ec-aa96-6819fa2e5eb6', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:28:30 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0734f1b4-0cc2-4750-ad60-24130da8b876 tempest-ProjectReaderTests-1166262798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7ba10eb-6227-4a74-b5c1-42289bb39f54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:28:30 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0734f1b4-0cc2-4750-ad60-24130da8b876 tempest-ProjectReaderTests-1166262798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7ba10eb-6227-4a74-b5c1-42289bb39f54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:28:30 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0734f1b4-0cc2-4750-ad60-24130da8b876 tempest-ProjectReaderTests-1166262798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (518d9881-5638-4afd-a26e-5557939bd602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:28:30 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-0734f1b4-0cc2-4750-ad60-24130da8b876 tempest-ProjectReaderTests-1166262798 None] Volume f098a206-235d-46ec-aa96-6819fa2e5eb6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f098a206-235d-46ec-aa96-6819fa2e5eb6', 'volume_size': 1} Sep 15 16:28:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-0734f1b4-0cc2-4750-ad60-24130da8b876 tempest-ProjectReaderTests-1166262798 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:28:30 devstack sudo[100311]: pam_unix(sudo:session): session closed for user root Sep 15 16:28:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9332a6f2-c309-4c7e-a061-b8acc9772fd1 tempest-TestServerVolumeAttachmentScenario-1564993328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-06f3fa68-94ee-4f9b-8a79-5dde93802350 1073741824" returned: 0 in 0.667s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:28:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9332a6f2-c309-4c7e-a061-b8acc9772fd1 tempest-TestServerVolumeAttachmentScenario-1564993328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-06f3fa68-94ee-4f9b-8a79-5dde93802350 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:28:30 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-56c7b65f-d849-497a-82c0-1e455e563f94 tempest-SnapshotDependencyTests-1564103874 None] Acquiring lock "cinder-61bb2823-566e-482b-a792-9d9601060b27-delete_snapshot" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:28:30 devstack sudo[100317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-06f3fa68-94ee-4f9b-8a79-5dde93802350 Sep 15 16:28:30 devstack sudo[100317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:28:30 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-56c7b65f-d849-497a-82c0-1e455e563f94 tempest-SnapshotDependencyTests-1564103874 None] Lock "cinder-61bb2823-566e-482b-a792-9d9601060b27-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:28:30 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-56c7b65f-d849-497a-82c0-1e455e563f94 tempest-SnapshotDependencyTests-1564103874 None] Acquiring lock "cinder-quobyte-ebb4f137-5833-46f7-bcfa-81c4dab94be4" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:28:30 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-56c7b65f-d849-497a-82c0-1e455e563f94 tempest-SnapshotDependencyTests-1564103874 None] Lock "cinder-quobyte-ebb4f137-5833-46f7-bcfa-81c4dab94be4" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:28:30 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-56c7b65f-d849-497a-82c0-1e455e563f94 tempest-SnapshotDependencyTests-1564103874 None] Acquiring lock "cinder-quobyte-61bb2823-566e-482b-a792-9d9601060b27" by "_delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:28:30 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-56c7b65f-d849-497a-82c0-1e455e563f94 tempest-SnapshotDependencyTests-1564103874 None] Lock "cinder-quobyte-61bb2823-566e-482b-a792-9d9601060b27" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:28:30 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-56c7b65f-d849-497a-82c0-1e455e563f94 tempest-SnapshotDependencyTests-1564103874 None] Deleting offline snapshot 61bb2823-566e-482b-a792-9d9601060b27 of volume ebb4f137-5833-46f7-bcfa-81c4dab94be4 {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 15 16:28:30 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-56c7b65f-d849-497a-82c0-1e455e563f94 tempest-SnapshotDependencyTests-1564103874 None] snapshot_file for this snap is: volume-ebb4f137-5833-46f7-bcfa-81c4dab94be4.61bb2823-566e-482b-a792-9d9601060b27 {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 15 16:28:30 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[6651cb04-df4e-40e8-a84f-f87954f26fb1]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:28:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-56c7b65f-d849-497a-82c0-1e455e563f94 tempest-SnapshotDependencyTests-1564103874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ebb4f137-5833-46f7-bcfa-81c4dab94be4.61bb2823-566e-482b-a792-9d9601060b27 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:28:31 devstack sudo[100319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ebb4f137-5833-46f7-bcfa-81c4dab94be4.61bb2823-566e-482b-a792-9d9601060b27 Sep 15 16:28:31 devstack sudo[100319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:28:31 devstack sudo[100317]: pam_unix(sudo:session): session closed for user root Sep 15 16:28:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9332a6f2-c309-4c7e-a061-b8acc9772fd1 tempest-TestServerVolumeAttachmentScenario-1564993328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-06f3fa68-94ee-4f9b-8a79-5dde93802350" returned: 0 in 0.350s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:28:31 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-9332a6f2-c309-4c7e-a061-b8acc9772fd1 tempest-TestServerVolumeAttachmentScenario-1564993328 None] <== create_volume: return (1125ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:28:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-9332a6f2-c309-4c7e-a061-b8acc9772fd1 tempest-TestServerVolumeAttachmentScenario-1564993328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.129s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:28:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-2a734e15-87c8-4ac2-850b-33df716a7b4e tempest-TestServerVolumeAttachmentScenario-1564993328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.855s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:28:31 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-2a734e15-87c8-4ac2-850b-33df716a7b4e tempest-TestServerVolumeAttachmentScenario-1564993328 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:28:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-364862072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1c51ebf-b0d2-4737-ac5c-e15b99e8db4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66eae75bf1574121b0e1975b73bb63d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:28:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:28:23Z,use_quota=True,user_id='4f79bc0262944535a94395dc92fe1c84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:28:31 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-2a734e15-87c8-4ac2-850b-33df716a7b4e tempest-TestServerVolumeAttachmentScenario-1564993328 None] Creating volume f1c51ebf-b0d2-4737-ac5c-e15b99e8db4b {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:28:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-2a734e15-87c8-4ac2-850b-33df716a7b4e tempest-TestServerVolumeAttachmentScenario-1564993328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:28:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-2a734e15-87c8-4ac2-850b-33df716a7b4e tempest-TestServerVolumeAttachmentScenario-1564993328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:28:31 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-2a734e15-87c8-4ac2-850b-33df716a7b4e tempest-TestServerVolumeAttachmentScenario-1564993328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:28:31 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-2a734e15-87c8-4ac2-850b-33df716a7b4e tempest-TestServerVolumeAttachmentScenario-1564993328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:28:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-2a734e15-87c8-4ac2-850b-33df716a7b4e tempest-TestServerVolumeAttachmentScenario-1564993328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:28:31 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-2a734e15-87c8-4ac2-850b-33df716a7b4e tempest-TestServerVolumeAttachmentScenario-1564993328 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:28:31 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-2a734e15-87c8-4ac2-850b-33df716a7b4e tempest-TestServerVolumeAttachmentScenario-1564993328 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:28:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2a734e15-87c8-4ac2-850b-33df716a7b4e tempest-TestServerVolumeAttachmentScenario-1564993328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-f1c51ebf-b0d2-4737-ac5c-e15b99e8db4b 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:28:31 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9332a6f2-c309-4c7e-a061-b8acc9772fd1 tempest-TestServerVolumeAttachmentScenario-1564993328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (546e3623-c1b5-40fa-a4ca-cde5470b1471) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06f3fa68-94ee-4f9b-8a79-5dde93802350', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:28:31 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9332a6f2-c309-4c7e-a061-b8acc9772fd1 tempest-TestServerVolumeAttachmentScenario-1564993328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31f03de6-827f-4027-86a8-b530349b7358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:28:31 devstack sudo[100322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-f1c51ebf-b0d2-4737-ac5c-e15b99e8db4b 1073741824 Sep 15 16:28:31 devstack sudo[100322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:28:31 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-9332a6f2-c309-4c7e-a061-b8acc9772fd1 tempest-TestServerVolumeAttachmentScenario-1564993328 None] Volume volume-06f3fa68-94ee-4f9b-8a79-5dde93802350 (06f3fa68-94ee-4f9b-8a79-5dde93802350): created successfully Sep 15 16:28:31 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9332a6f2-c309-4c7e-a061-b8acc9772fd1 tempest-TestServerVolumeAttachmentScenario-1564993328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31f03de6-827f-4027-86a8-b530349b7358) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:28:31 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9332a6f2-c309-4c7e-a061-b8acc9772fd1 tempest-TestServerVolumeAttachmentScenario-1564993328 None] Flow 'volume_create_manager' (b8b0f6a9-aaac-4552-a3bf-e08fdc3fb438) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:28:31 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-9332a6f2-c309-4c7e-a061-b8acc9772fd1 tempest-TestServerVolumeAttachmentScenario-1564993328 None] Created volume successfully. Sep 15 16:28:31 devstack sudo[100319]: pam_unix(sudo:session): session closed for user root Sep 15 16:28:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-56c7b65f-d849-497a-82c0-1e455e563f94 tempest-SnapshotDependencyTests-1564103874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ebb4f137-5833-46f7-bcfa-81c4dab94be4.61bb2823-566e-482b-a792-9d9601060b27" returned: 0 in 0.482s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:28:31 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-56c7b65f-d849-497a-82c0-1e455e563f94 tempest-SnapshotDependencyTests-1564103874 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ebb4f137-5833-46f7-bcfa-81c4dab94be4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 16:28:31 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2ac988c-af7c-4cc6-92c6-cf5ebb324a56]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:28:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-56c7b65f-d849-497a-82c0-1e455e563f94 tempest-SnapshotDependencyTests-1564103874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ebb4f137-5833-46f7-bcfa-81c4dab94be4 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:28:31 devstack sudo[100335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ebb4f137-5833-46f7-bcfa-81c4dab94be4 Sep 15 16:28:31 devstack sudo[100335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:28:31 devstack sudo[100322]: pam_unix(sudo:session): session closed for user root Sep 15 16:28:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2a734e15-87c8-4ac2-850b-33df716a7b4e tempest-TestServerVolumeAttachmentScenario-1564993328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-f1c51ebf-b0d2-4737-ac5c-e15b99e8db4b 1073741824" returned: 0 in 0.802s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:28:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2a734e15-87c8-4ac2-850b-33df716a7b4e tempest-TestServerVolumeAttachmentScenario-1564993328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-f1c51ebf-b0d2-4737-ac5c-e15b99e8db4b {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:28:31 devstack sudo[100345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-f1c51ebf-b0d2-4737-ac5c-e15b99e8db4b Sep 15 16:28:31 devstack sudo[100345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:28:32 devstack sudo[100335]: pam_unix(sudo:session): session closed for user root Sep 15 16:28:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-56c7b65f-d849-497a-82c0-1e455e563f94 tempest-SnapshotDependencyTests-1564103874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ebb4f137-5833-46f7-bcfa-81c4dab94be4" returned: 0 in 0.819s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:28:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-56c7b65f-d849-497a-82c0-1e455e563f94 tempest-SnapshotDependencyTests-1564103874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ebb4f137-5833-46f7-bcfa-81c4dab94be4.61bb2823-566e-482b-a792-9d9601060b27 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:28:32 devstack sudo[100352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ebb4f137-5833-46f7-bcfa-81c4dab94be4.61bb2823-566e-482b-a792-9d9601060b27 Sep 15 16:28:32 devstack sudo[100352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:28:32 devstack sudo[100345]: pam_unix(sudo:session): session closed for user root Sep 15 16:28:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2a734e15-87c8-4ac2-850b-33df716a7b4e tempest-TestServerVolumeAttachmentScenario-1564993328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-f1c51ebf-b0d2-4737-ac5c-e15b99e8db4b" returned: 0 in 0.452s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:28:32 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-2a734e15-87c8-4ac2-850b-33df716a7b4e tempest-TestServerVolumeAttachmentScenario-1564993328 None] <== create_volume: return (1320ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:28:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-2a734e15-87c8-4ac2-850b-33df716a7b4e tempest-TestServerVolumeAttachmentScenario-1564993328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.323s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:28:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-0734f1b4-0cc2-4750-ad60-24130da8b876 tempest-ProjectReaderTests-1166262798 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.990s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:28:32 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-0734f1b4-0cc2-4750-ad60-24130da8b876 tempest-ProjectReaderTests-1166262798 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:28:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-455450196',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f098a206-235d-46ec-aa96-6819fa2e5eb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f10add438931461e934dfa3f3d813619',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:28:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:28:30Z,use_quota=True,user_id='4927118af22042fc91a74b27416b4df3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:28:32 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-0734f1b4-0cc2-4750-ad60-24130da8b876 tempest-ProjectReaderTests-1166262798 None] Creating volume f098a206-235d-46ec-aa96-6819fa2e5eb6 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:28:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-0734f1b4-0cc2-4750-ad60-24130da8b876 tempest-ProjectReaderTests-1166262798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:28:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-0734f1b4-0cc2-4750-ad60-24130da8b876 tempest-ProjectReaderTests-1166262798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:28:32 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-0734f1b4-0cc2-4750-ad60-24130da8b876 tempest-ProjectReaderTests-1166262798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:28:32 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-0734f1b4-0cc2-4750-ad60-24130da8b876 tempest-ProjectReaderTests-1166262798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:28:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-0734f1b4-0cc2-4750-ad60-24130da8b876 tempest-ProjectReaderTests-1166262798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:28:32 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-0734f1b4-0cc2-4750-ad60-24130da8b876 tempest-ProjectReaderTests-1166262798 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:28:32 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-0734f1b4-0cc2-4750-ad60-24130da8b876 tempest-ProjectReaderTests-1166262798 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:28:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0734f1b4-0cc2-4750-ad60-24130da8b876 tempest-ProjectReaderTests-1166262798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-f098a206-235d-46ec-aa96-6819fa2e5eb6 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:28:32 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2a734e15-87c8-4ac2-850b-33df716a7b4e tempest-TestServerVolumeAttachmentScenario-1564993328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df91245c-29b7-4a57-a67e-6b08b924d91c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1c51ebf-b0d2-4737-ac5c-e15b99e8db4b', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:28:32 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2a734e15-87c8-4ac2-850b-33df716a7b4e tempest-TestServerVolumeAttachmentScenario-1564993328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9057bf8-2e64-4425-8bad-937269576142) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:28:32 devstack sudo[100366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-f098a206-235d-46ec-aa96-6819fa2e5eb6 1073741824 Sep 15 16:28:32 devstack sudo[100366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:28:32 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-2a734e15-87c8-4ac2-850b-33df716a7b4e tempest-TestServerVolumeAttachmentScenario-1564993328 None] Volume volume-f1c51ebf-b0d2-4737-ac5c-e15b99e8db4b (f1c51ebf-b0d2-4737-ac5c-e15b99e8db4b): created successfully Sep 15 16:28:32 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2a734e15-87c8-4ac2-850b-33df716a7b4e tempest-TestServerVolumeAttachmentScenario-1564993328 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9057bf8-2e64-4425-8bad-937269576142) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:28:32 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2a734e15-87c8-4ac2-850b-33df716a7b4e tempest-TestServerVolumeAttachmentScenario-1564993328 None] Flow 'volume_create_manager' (dea76240-daee-43a2-8040-18b4799cb8b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:28:32 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-2a734e15-87c8-4ac2-850b-33df716a7b4e tempest-TestServerVolumeAttachmentScenario-1564993328 None] Created volume successfully. Sep 15 16:28:32 devstack sudo[100352]: pam_unix(sudo:session): session closed for user root Sep 15 16:28:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-56c7b65f-d849-497a-82c0-1e455e563f94 tempest-SnapshotDependencyTests-1564103874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ebb4f137-5833-46f7-bcfa-81c4dab94be4.61bb2823-566e-482b-a792-9d9601060b27" returned: 0 in 0.580s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:28:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-56c7b65f-d849-497a-82c0-1e455e563f94 tempest-SnapshotDependencyTests-1564103874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ebb4f137-5833-46f7-bcfa-81c4dab94be4.61bb2823-566e-482b-a792-9d9601060b27 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:28:32 devstack sudo[100380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ebb4f137-5833-46f7-bcfa-81c4dab94be4.61bb2823-566e-482b-a792-9d9601060b27 Sep 15 16:28:32 devstack sudo[100380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:28:33 devstack sudo[100366]: pam_unix(sudo:session): session closed for user root Sep 15 16:28:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0734f1b4-0cc2-4750-ad60-24130da8b876 tempest-ProjectReaderTests-1166262798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-f098a206-235d-46ec-aa96-6819fa2e5eb6 1073741824" returned: 0 in 0.688s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:28:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0734f1b4-0cc2-4750-ad60-24130da8b876 tempest-ProjectReaderTests-1166262798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-f098a206-235d-46ec-aa96-6819fa2e5eb6 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:28:33 devstack sudo[100380]: pam_unix(sudo:session): session closed for user root Sep 15 16:28:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-56c7b65f-d849-497a-82c0-1e455e563f94 tempest-SnapshotDependencyTests-1564103874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ebb4f137-5833-46f7-bcfa-81c4dab94be4.61bb2823-566e-482b-a792-9d9601060b27" returned: 0 in 0.316s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:28:33 devstack sudo[100384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-f098a206-235d-46ec-aa96-6819fa2e5eb6 Sep 15 16:28:33 devstack sudo[100384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:28:33 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-56c7b65f-d849-497a-82c0-1e455e563f94 tempest-SnapshotDependencyTests-1564103874 None] Lock "cinder-quobyte-61bb2823-566e-482b-a792-9d9601060b27" released by "_delete_snapshot" :: held 2.368s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:28:33 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-56c7b65f-d849-497a-82c0-1e455e563f94 tempest-SnapshotDependencyTests-1564103874 None] Lock "cinder-quobyte-ebb4f137-5833-46f7-bcfa-81c4dab94be4" released by "delete_snapshot" :: held 2.408s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:28:33 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-56c7b65f-d849-497a-82c0-1e455e563f94 tempest-SnapshotDependencyTests-1564103874 None] Created reservations ['bf7288b6-f06b-4671-96bd-1b9c0a560be8', 'b91759a8-5acd-4ef3-9a85-a679b27e431b', '30d146c8-7222-4715-bb23-a92eb1486a6a', '7982447d-3500-4b74-a157-e8c23a156c47'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:28:33 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-56c7b65f-d849-497a-82c0-1e455e563f94 tempest-SnapshotDependencyTests-1564103874 None] Delete snapshot completed successfully. Sep 15 16:28:33 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-56c7b65f-d849-497a-82c0-1e455e563f94 tempest-SnapshotDependencyTests-1564103874 None] Lock "cinder-61bb2823-566e-482b-a792-9d9601060b27-delete_snapshot" released by "delete_snapshot" :: held 2.636s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:28:33 devstack sudo[100384]: pam_unix(sudo:session): session closed for user root Sep 15 16:28:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0734f1b4-0cc2-4750-ad60-24130da8b876 tempest-ProjectReaderTests-1166262798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-f098a206-235d-46ec-aa96-6819fa2e5eb6" returned: 0 in 0.343s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:28:33 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-0734f1b4-0cc2-4750-ad60-24130da8b876 tempest-ProjectReaderTests-1166262798 None] <== create_volume: return (1082ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:28:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-0734f1b4-0cc2-4750-ad60-24130da8b876 tempest-ProjectReaderTests-1166262798 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.087s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:28:33 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0734f1b4-0cc2-4750-ad60-24130da8b876 tempest-ProjectReaderTests-1166262798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (518d9881-5638-4afd-a26e-5557939bd602) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f098a206-235d-46ec-aa96-6819fa2e5eb6', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:28:33 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0734f1b4-0cc2-4750-ad60-24130da8b876 tempest-ProjectReaderTests-1166262798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (218c5db0-aa56-4852-89fd-db9e11740069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:28:33 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-0734f1b4-0cc2-4750-ad60-24130da8b876 tempest-ProjectReaderTests-1166262798 None] Volume volume-f098a206-235d-46ec-aa96-6819fa2e5eb6 (f098a206-235d-46ec-aa96-6819fa2e5eb6): created successfully Sep 15 16:28:33 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0734f1b4-0cc2-4750-ad60-24130da8b876 tempest-ProjectReaderTests-1166262798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (218c5db0-aa56-4852-89fd-db9e11740069) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:28:33 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0734f1b4-0cc2-4750-ad60-24130da8b876 tempest-ProjectReaderTests-1166262798 None] Flow 'volume_create_manager' (67520fb2-9898-42a8-ba57-afda25bd7e8c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:28:33 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-0734f1b4-0cc2-4750-ad60-24130da8b876 tempest-ProjectReaderTests-1166262798 None] Created volume successfully. Sep 15 16:28:34 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-921dd6cb-7ec9-456a-8566-b1b5258c33b9 tempest-SnapshotDependencyTests-1564103874 None] Acquiring lock "cinder-ebb4f137-5833-46f7-bcfa-81c4dab94be4-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:28:34 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-921dd6cb-7ec9-456a-8566-b1b5258c33b9 tempest-SnapshotDependencyTests-1564103874 None] Lock "cinder-ebb4f137-5833-46f7-bcfa-81c4dab94be4-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:28:34 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-921dd6cb-7ec9-456a-8566-b1b5258c33b9 tempest-SnapshotDependencyTests-1564103874 None] Acquiring lock "cinder-quobyte-ebb4f137-5833-46f7-bcfa-81c4dab94be4" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:28:34 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-921dd6cb-7ec9-456a-8566-b1b5258c33b9 tempest-SnapshotDependencyTests-1564103874 None] Lock "cinder-quobyte-ebb4f137-5833-46f7-bcfa-81c4dab94be4" acquired by "delete_volume" :: waited 0.015s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:28:34 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2f21e57-a7c8-417a-acf7-11e68a96c9a2]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:28:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-921dd6cb-7ec9-456a-8566-b1b5258c33b9 tempest-SnapshotDependencyTests-1564103874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ebb4f137-5833-46f7-bcfa-81c4dab94be4 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:28:34 devstack sudo[100388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ebb4f137-5833-46f7-bcfa-81c4dab94be4 Sep 15 16:28:34 devstack sudo[100388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:28:34 devstack sudo[100388]: pam_unix(sudo:session): session closed for user root Sep 15 16:28:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-921dd6cb-7ec9-456a-8566-b1b5258c33b9 tempest-SnapshotDependencyTests-1564103874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ebb4f137-5833-46f7-bcfa-81c4dab94be4" returned: 0 in 0.464s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:28:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-921dd6cb-7ec9-456a-8566-b1b5258c33b9 tempest-SnapshotDependencyTests-1564103874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ebb4f137-5833-46f7-bcfa-81c4dab94be4 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:28:34 devstack sudo[100393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ebb4f137-5833-46f7-bcfa-81c4dab94be4 Sep 15 16:28:34 devstack sudo[100393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:28:34 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-21cd7d4c-4164-4d38-b893-ac0d69b107f7 tempest-ProjectReaderTests-1166262798 None] Acquiring lock "cinder-f098a206-235d-46ec-aa96-6819fa2e5eb6-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:28:34 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-21cd7d4c-4164-4d38-b893-ac0d69b107f7 tempest-ProjectReaderTests-1166262798 None] Lock "cinder-f098a206-235d-46ec-aa96-6819fa2e5eb6-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:28:34 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-21cd7d4c-4164-4d38-b893-ac0d69b107f7 tempest-ProjectReaderTests-1166262798 None] Acquiring lock "cinder-quobyte-f098a206-235d-46ec-aa96-6819fa2e5eb6" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:28:35 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-21cd7d4c-4164-4d38-b893-ac0d69b107f7 tempest-ProjectReaderTests-1166262798 None] Lock "cinder-quobyte-f098a206-235d-46ec-aa96-6819fa2e5eb6" acquired by "delete_volume" :: waited 0.017s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:28:35 devstack sudo[100393]: pam_unix(sudo:session): session closed for user root Sep 15 16:28:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-921dd6cb-7ec9-456a-8566-b1b5258c33b9 tempest-SnapshotDependencyTests-1564103874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ebb4f137-5833-46f7-bcfa-81c4dab94be4" returned: 0 in 0.363s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:28:35 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[2036edc4-4876-4492-8292-6ab1b0847a11]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:28:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-21cd7d4c-4164-4d38-b893-ac0d69b107f7 tempest-ProjectReaderTests-1166262798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-f098a206-235d-46ec-aa96-6819fa2e5eb6 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:28:35 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-921dd6cb-7ec9-456a-8566-b1b5258c33b9 tempest-SnapshotDependencyTests-1564103874 None] Lock "cinder-quobyte-ebb4f137-5833-46f7-bcfa-81c4dab94be4" released by "delete_volume" :: held 0.932s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:28:35 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-921dd6cb-7ec9-456a-8566-b1b5258c33b9 tempest-SnapshotDependencyTests-1564103874 None] Created reservations ['07b52a1a-ff71-4ee6-9189-7349e060bf91', 'e09510b5-15b7-4c2c-bf24-d5ca2445f98d', 'e8cbbf73-509e-41d2-bb71-c492acc7e1f9', '1e7faf49-489b-4488-a194-94c87030ee53'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:28:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-921dd6cb-7ec9-456a-8566-b1b5258c33b9 tempest-SnapshotDependencyTests-1564103874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:28:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-921dd6cb-7ec9-456a-8566-b1b5258c33b9 tempest-SnapshotDependencyTests-1564103874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:28:35 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-921dd6cb-7ec9-456a-8566-b1b5258c33b9 tempest-SnapshotDependencyTests-1564103874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:28:35 devstack sudo[100397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-f098a206-235d-46ec-aa96-6819fa2e5eb6 Sep 15 16:28:35 devstack sudo[100397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:28:35 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-921dd6cb-7ec9-456a-8566-b1b5258c33b9 tempest-SnapshotDependencyTests-1564103874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:28:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-921dd6cb-7ec9-456a-8566-b1b5258c33b9 tempest-SnapshotDependencyTests-1564103874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:28:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-921dd6cb-7ec9-456a-8566-b1b5258c33b9 tempest-SnapshotDependencyTests-1564103874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:28:35 devstack sudo[100399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:28:35 devstack sudo[100399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:28:35 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-1639c8ea-3d33-4931-9d5d-58b30ad90d15 tempest-SnapshotDependencyTests-1564103874 None] Acquiring lock "cinder-08338982-4f57-40fc-a632-89f3f52afa97-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:28:35 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-1639c8ea-3d33-4931-9d5d-58b30ad90d15 tempest-SnapshotDependencyTests-1564103874 None] Lock "cinder-08338982-4f57-40fc-a632-89f3f52afa97-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:28:35 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-1639c8ea-3d33-4931-9d5d-58b30ad90d15 tempest-SnapshotDependencyTests-1564103874 None] Acquiring lock "cinder-quobyte-08338982-4f57-40fc-a632-89f3f52afa97" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:28:35 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-1639c8ea-3d33-4931-9d5d-58b30ad90d15 tempest-SnapshotDependencyTests-1564103874 None] Lock "cinder-quobyte-08338982-4f57-40fc-a632-89f3f52afa97" acquired by "delete_volume" :: waited 0.032s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:28:35 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[02c9e74e-43df-4f93-8191-56fdf847b71f]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:28:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-1639c8ea-3d33-4931-9d5d-58b30ad90d15 tempest-SnapshotDependencyTests-1564103874 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-08338982-4f57-40fc-a632-89f3f52afa97 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:28:35 devstack sudo[100397]: pam_unix(sudo:session): session closed for user root Sep 15 16:28:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-21cd7d4c-4164-4d38-b893-ac0d69b107f7 tempest-ProjectReaderTests-1166262798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-f098a206-235d-46ec-aa96-6819fa2e5eb6" returned: 0 in 0.566s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:28:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-21cd7d4c-4164-4d38-b893-ac0d69b107f7 tempest-ProjectReaderTests-1166262798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-f098a206-235d-46ec-aa96-6819fa2e5eb6 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:28:35 devstack sudo[100399]: pam_unix(sudo:session): session closed for user root Sep 15 16:28:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-921dd6cb-7ec9-456a-8566-b1b5258c33b9 tempest-SnapshotDependencyTests-1564103874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.418s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:28:35 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-921dd6cb-7ec9-456a-8566-b1b5258c33b9 tempest-SnapshotDependencyTests-1564103874 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:28:35 devstack sudo[100406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-f098a206-235d-46ec-aa96-6819fa2e5eb6 Sep 15 16:28:35 devstack sudo[100406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:28:35 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-921dd6cb-7ec9-456a-8566-b1b5258c33b9 tempest-SnapshotDependencyTests-1564103874 None] Deleted volume successfully. Sep 15 16:28:35 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-921dd6cb-7ec9-456a-8566-b1b5258c33b9 tempest-SnapshotDependencyTests-1564103874 None] Lock "cinder-ebb4f137-5833-46f7-bcfa-81c4dab94be4-delete_volume" released by "delete_volume" :: held 1.649s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:28:35 devstack sudo[100404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-08338982-4f57-40fc-a632-89f3f52afa97 Sep 15 16:28:35 devstack sudo[100404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:28:35 devstack sudo[100406]: pam_unix(sudo:session): session closed for user root Sep 15 16:28:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-21cd7d4c-4164-4d38-b893-ac0d69b107f7 tempest-ProjectReaderTests-1166262798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-f098a206-235d-46ec-aa96-6819fa2e5eb6" returned: 0 in 0.406s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:28:36 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-21cd7d4c-4164-4d38-b893-ac0d69b107f7 tempest-ProjectReaderTests-1166262798 None] Lock "cinder-quobyte-f098a206-235d-46ec-aa96-6819fa2e5eb6" released by "delete_volume" :: held 1.076s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:28:36 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-21cd7d4c-4164-4d38-b893-ac0d69b107f7 tempest-ProjectReaderTests-1166262798 None] Created reservations ['2dc417a1-e136-49f9-a71f-9d6aaabbcd5d', 'b6d0c62e-f226-49c3-b44e-9a424c2a3e27', '050780e2-029b-4bb5-87ca-153b35284051', '13b57379-ed24-4c68-8c60-5675944f7468'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:28:36 devstack sudo[100404]: pam_unix(sudo:session): session closed for user root Sep 15 16:28:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-1639c8ea-3d33-4931-9d5d-58b30ad90d15 tempest-SnapshotDependencyTests-1564103874 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-08338982-4f57-40fc-a632-89f3f52afa97" returned: 0 in 0.830s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:28:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-1639c8ea-3d33-4931-9d5d-58b30ad90d15 tempest-SnapshotDependencyTests-1564103874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-08338982-4f57-40fc-a632-89f3f52afa97 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:28:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-21cd7d4c-4164-4d38-b893-ac0d69b107f7 tempest-ProjectReaderTests-1166262798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:28:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-21cd7d4c-4164-4d38-b893-ac0d69b107f7 tempest-ProjectReaderTests-1166262798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:28:36 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-21cd7d4c-4164-4d38-b893-ac0d69b107f7 tempest-ProjectReaderTests-1166262798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:28:36 devstack sudo[100446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-08338982-4f57-40fc-a632-89f3f52afa97 Sep 15 16:28:36 devstack sudo[100446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:28:36 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-21cd7d4c-4164-4d38-b893-ac0d69b107f7 tempest-ProjectReaderTests-1166262798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:28:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-21cd7d4c-4164-4d38-b893-ac0d69b107f7 tempest-ProjectReaderTests-1166262798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:28:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-21cd7d4c-4164-4d38-b893-ac0d69b107f7 tempest-ProjectReaderTests-1166262798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:28:36 devstack sudo[100453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:28:36 devstack sudo[100453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:28:36 devstack sudo[100446]: pam_unix(sudo:session): session closed for user root Sep 15 16:28:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-1639c8ea-3d33-4931-9d5d-58b30ad90d15 tempest-SnapshotDependencyTests-1564103874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-08338982-4f57-40fc-a632-89f3f52afa97" returned: 0 in 0.537s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:28:36 devstack sudo[100453]: pam_unix(sudo:session): session closed for user root Sep 15 16:28:36 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-1639c8ea-3d33-4931-9d5d-58b30ad90d15 tempest-SnapshotDependencyTests-1564103874 None] Lock "cinder-quobyte-08338982-4f57-40fc-a632-89f3f52afa97" released by "delete_volume" :: held 1.468s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:28:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-21cd7d4c-4164-4d38-b893-ac0d69b107f7 tempest-ProjectReaderTests-1166262798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.548s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:28:36 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-21cd7d4c-4164-4d38-b893-ac0d69b107f7 tempest-ProjectReaderTests-1166262798 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:28:36 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-21cd7d4c-4164-4d38-b893-ac0d69b107f7 tempest-ProjectReaderTests-1166262798 None] Deleted volume successfully. Sep 15 16:28:37 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-21cd7d4c-4164-4d38-b893-ac0d69b107f7 tempest-ProjectReaderTests-1166262798 None] Lock "cinder-f098a206-235d-46ec-aa96-6819fa2e5eb6-delete_volume" released by "delete_volume" :: held 2.100s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:28:37 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-1639c8ea-3d33-4931-9d5d-58b30ad90d15 tempest-SnapshotDependencyTests-1564103874 None] Created reservations ['3ff960d1-0df1-471c-8cdb-599c152f2b9e', '73a2e5dd-a8e0-4ca3-8116-b6f51b9f2378', 'c4f4a40c-d5c8-4443-89b4-3aaeb1d3bf40', '2f4e5d3f-464a-42c1-be23-e2cff64deb69'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:28:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-1639c8ea-3d33-4931-9d5d-58b30ad90d15 tempest-SnapshotDependencyTests-1564103874 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:28:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-1639c8ea-3d33-4931-9d5d-58b30ad90d15 tempest-SnapshotDependencyTests-1564103874 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:28:37 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-1639c8ea-3d33-4931-9d5d-58b30ad90d15 tempest-SnapshotDependencyTests-1564103874 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:28:37 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-1639c8ea-3d33-4931-9d5d-58b30ad90d15 tempest-SnapshotDependencyTests-1564103874 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:28:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-1639c8ea-3d33-4931-9d5d-58b30ad90d15 tempest-SnapshotDependencyTests-1564103874 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.053s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:28:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-1639c8ea-3d33-4931-9d5d-58b30ad90d15 tempest-SnapshotDependencyTests-1564103874 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:28:37 devstack sudo[100486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:28:37 devstack sudo[100486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:28:37 devstack sudo[100486]: pam_unix(sudo:session): session closed for user root Sep 15 16:28:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-1639c8ea-3d33-4931-9d5d-58b30ad90d15 tempest-SnapshotDependencyTests-1564103874 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.657s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:28:37 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-1639c8ea-3d33-4931-9d5d-58b30ad90d15 tempest-SnapshotDependencyTests-1564103874 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:28:37 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-1639c8ea-3d33-4931-9d5d-58b30ad90d15 tempest-SnapshotDependencyTests-1564103874 None] Deleted volume successfully. Sep 15 16:28:38 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-1639c8ea-3d33-4931-9d5d-58b30ad90d15 tempest-SnapshotDependencyTests-1564103874 None] Lock "cinder-08338982-4f57-40fc-a632-89f3f52afa97-delete_volume" released by "delete_volume" :: held 2.682s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:28:38 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ede1290-198f-48a8-ab2f-a2282c01c819 tempest-ProjectReaderTests-1166262798 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:28:38 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9ede1290-198f-48a8-ab2f-a2282c01c819 tempest-ProjectReaderTests-1166262798 None] Flow 'volume_create_manager' (6a9c851e-4e6c-453d-ae53-d982e5bad366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:28:38 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9ede1290-198f-48a8-ab2f-a2282c01c819 tempest-ProjectReaderTests-1166262798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbd0f65e-b7e7-47d9-853b-8d28d92df819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:28:38 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9ede1290-198f-48a8-ab2f-a2282c01c819 tempest-ProjectReaderTests-1166262798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbd0f65e-b7e7-47d9-853b-8d28d92df819) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:28:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-500588821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f04f7e2-34ef-4e2b-a178-1ca696ff08f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f10add438931461e934dfa3f3d813619',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:28:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:28:38Z,use_quota=True,user_id='4927118af22042fc91a74b27416b4df3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:28:38 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9ede1290-198f-48a8-ab2f-a2282c01c819 tempest-ProjectReaderTests-1166262798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e7ab0b7-d7ea-4fec-b385-b0b6135427e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:28:38 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9ede1290-198f-48a8-ab2f-a2282c01c819 tempest-ProjectReaderTests-1166262798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e7ab0b7-d7ea-4fec-b385-b0b6135427e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:28:38 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9ede1290-198f-48a8-ab2f-a2282c01c819 tempest-ProjectReaderTests-1166262798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3377d4b8-b71b-4eaa-af68-d7dbfceadcea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:28:38 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9ede1290-198f-48a8-ab2f-a2282c01c819 tempest-ProjectReaderTests-1166262798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3377d4b8-b71b-4eaa-af68-d7dbfceadcea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f04f7e2-34ef-4e2b-a178-1ca696ff08f6', 'volume_name': 'volume-1f04f7e2-34ef-4e2b-a178-1ca696ff08f6', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:28:38 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9ede1290-198f-48a8-ab2f-a2282c01c819 tempest-ProjectReaderTests-1166262798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (238392e4-dde5-4c48-a6bc-ed0bd6fa4141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:28:38 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9ede1290-198f-48a8-ab2f-a2282c01c819 tempest-ProjectReaderTests-1166262798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (238392e4-dde5-4c48-a6bc-ed0bd6fa4141) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:28:38 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9ede1290-198f-48a8-ab2f-a2282c01c819 tempest-ProjectReaderTests-1166262798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93f4b5d9-9d88-419d-b5d1-31abb80af080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:28:38 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-9ede1290-198f-48a8-ab2f-a2282c01c819 tempest-ProjectReaderTests-1166262798 None] Volume 1f04f7e2-34ef-4e2b-a178-1ca696ff08f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f04f7e2-34ef-4e2b-a178-1ca696ff08f6', 'volume_size': 1} Sep 15 16:28:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-9ede1290-198f-48a8-ab2f-a2282c01c819 tempest-ProjectReaderTests-1166262798 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:28:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-9ede1290-198f-48a8-ab2f-a2282c01c819 tempest-ProjectReaderTests-1166262798 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:28:38 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-9ede1290-198f-48a8-ab2f-a2282c01c819 tempest-ProjectReaderTests-1166262798 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:28:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-500588821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f04f7e2-34ef-4e2b-a178-1ca696ff08f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f10add438931461e934dfa3f3d813619',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:28:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:28:38Z,use_quota=True,user_id='4927118af22042fc91a74b27416b4df3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:28:38 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-9ede1290-198f-48a8-ab2f-a2282c01c819 tempest-ProjectReaderTests-1166262798 None] Creating volume 1f04f7e2-34ef-4e2b-a178-1ca696ff08f6 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:28:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-9ede1290-198f-48a8-ab2f-a2282c01c819 tempest-ProjectReaderTests-1166262798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:28:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-9ede1290-198f-48a8-ab2f-a2282c01c819 tempest-ProjectReaderTests-1166262798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:28:38 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-9ede1290-198f-48a8-ab2f-a2282c01c819 tempest-ProjectReaderTests-1166262798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:28:38 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-9ede1290-198f-48a8-ab2f-a2282c01c819 tempest-ProjectReaderTests-1166262798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:28:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-9ede1290-198f-48a8-ab2f-a2282c01c819 tempest-ProjectReaderTests-1166262798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:28:38 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-9ede1290-198f-48a8-ab2f-a2282c01c819 tempest-ProjectReaderTests-1166262798 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:28:38 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-9ede1290-198f-48a8-ab2f-a2282c01c819 tempest-ProjectReaderTests-1166262798 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:28:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9ede1290-198f-48a8-ab2f-a2282c01c819 tempest-ProjectReaderTests-1166262798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1f04f7e2-34ef-4e2b-a178-1ca696ff08f6 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:28:38 devstack sudo[100494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1f04f7e2-34ef-4e2b-a178-1ca696ff08f6 1073741824 Sep 15 16:28:38 devstack sudo[100494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:28:39 devstack sudo[100494]: pam_unix(sudo:session): session closed for user root Sep 15 16:28:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9ede1290-198f-48a8-ab2f-a2282c01c819 tempest-ProjectReaderTests-1166262798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1f04f7e2-34ef-4e2b-a178-1ca696ff08f6 1073741824" returned: 0 in 0.769s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:28:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9ede1290-198f-48a8-ab2f-a2282c01c819 tempest-ProjectReaderTests-1166262798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1f04f7e2-34ef-4e2b-a178-1ca696ff08f6 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:28:39 devstack sudo[100499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1f04f7e2-34ef-4e2b-a178-1ca696ff08f6 Sep 15 16:28:39 devstack sudo[100499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:28:39 devstack sudo[100499]: pam_unix(sudo:session): session closed for user root Sep 15 16:28:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9ede1290-198f-48a8-ab2f-a2282c01c819 tempest-ProjectReaderTests-1166262798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1f04f7e2-34ef-4e2b-a178-1ca696ff08f6" returned: 0 in 0.386s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:28:39 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-9ede1290-198f-48a8-ab2f-a2282c01c819 tempest-ProjectReaderTests-1166262798 None] <== create_volume: return (1244ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:28:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-9ede1290-198f-48a8-ab2f-a2282c01c819 tempest-ProjectReaderTests-1166262798 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.247s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:28:39 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9ede1290-198f-48a8-ab2f-a2282c01c819 tempest-ProjectReaderTests-1166262798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (93f4b5d9-9d88-419d-b5d1-31abb80af080) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f04f7e2-34ef-4e2b-a178-1ca696ff08f6', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:28:39 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9ede1290-198f-48a8-ab2f-a2282c01c819 tempest-ProjectReaderTests-1166262798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60f5ba0c-f252-4d6a-9ac5-b019a17c03aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:28:39 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-9ede1290-198f-48a8-ab2f-a2282c01c819 tempest-ProjectReaderTests-1166262798 None] Volume volume-1f04f7e2-34ef-4e2b-a178-1ca696ff08f6 (1f04f7e2-34ef-4e2b-a178-1ca696ff08f6): created successfully Sep 15 16:28:39 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9ede1290-198f-48a8-ab2f-a2282c01c819 tempest-ProjectReaderTests-1166262798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60f5ba0c-f252-4d6a-9ac5-b019a17c03aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:28:39 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9ede1290-198f-48a8-ab2f-a2282c01c819 tempest-ProjectReaderTests-1166262798 None] Flow 'volume_create_manager' (6a9c851e-4e6c-453d-ae53-d982e5bad366) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:28:39 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-9ede1290-198f-48a8-ab2f-a2282c01c819 tempest-ProjectReaderTests-1166262798 None] Created volume successfully. Sep 15 16:28:40 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f2ec9243-b231-4b62-8e0a-8a0004235068 tempest-ProjectReaderTests-1166262798 None] Acquiring lock "cinder-1f04f7e2-34ef-4e2b-a178-1ca696ff08f6-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:28:40 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f2ec9243-b231-4b62-8e0a-8a0004235068 tempest-ProjectReaderTests-1166262798 None] Lock "cinder-1f04f7e2-34ef-4e2b-a178-1ca696ff08f6-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:28:40 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f2ec9243-b231-4b62-8e0a-8a0004235068 tempest-ProjectReaderTests-1166262798 None] Acquiring lock "cinder-quobyte-1f04f7e2-34ef-4e2b-a178-1ca696ff08f6" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:28:40 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f2ec9243-b231-4b62-8e0a-8a0004235068 tempest-ProjectReaderTests-1166262798 None] Lock "cinder-quobyte-1f04f7e2-34ef-4e2b-a178-1ca696ff08f6" acquired by "delete_volume" :: waited 0.031s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:28:40 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[63abdaa0-237e-4054-83b3-b6522cf2d095]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:28:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f2ec9243-b231-4b62-8e0a-8a0004235068 tempest-ProjectReaderTests-1166262798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1f04f7e2-34ef-4e2b-a178-1ca696ff08f6 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:28:40 devstack sudo[100503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1f04f7e2-34ef-4e2b-a178-1ca696ff08f6 Sep 15 16:28:40 devstack sudo[100503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:28:41 devstack sudo[100503]: pam_unix(sudo:session): session closed for user root Sep 15 16:28:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f2ec9243-b231-4b62-8e0a-8a0004235068 tempest-ProjectReaderTests-1166262798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1f04f7e2-34ef-4e2b-a178-1ca696ff08f6" returned: 0 in 0.553s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:28:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f2ec9243-b231-4b62-8e0a-8a0004235068 tempest-ProjectReaderTests-1166262798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1f04f7e2-34ef-4e2b-a178-1ca696ff08f6 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:28:41 devstack sudo[100509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1f04f7e2-34ef-4e2b-a178-1ca696ff08f6 Sep 15 16:28:41 devstack sudo[100509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:28:41 devstack sudo[100509]: pam_unix(sudo:session): session closed for user root Sep 15 16:28:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f2ec9243-b231-4b62-8e0a-8a0004235068 tempest-ProjectReaderTests-1166262798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1f04f7e2-34ef-4e2b-a178-1ca696ff08f6" returned: 0 in 0.439s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:28:41 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f2ec9243-b231-4b62-8e0a-8a0004235068 tempest-ProjectReaderTests-1166262798 None] Lock "cinder-quobyte-1f04f7e2-34ef-4e2b-a178-1ca696ff08f6" released by "delete_volume" :: held 1.075s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:28:41 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-f2ec9243-b231-4b62-8e0a-8a0004235068 tempest-ProjectReaderTests-1166262798 None] Created reservations ['b739ca3c-a00a-4663-9b29-7e9c70896e4a', '7ec35879-bace-469f-abdc-2062c58fba1a', '59a07da0-2dc9-42a0-9512-4291c522441b', '4bd2e669-6e92-435d-933f-aad47f551a0e'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:28:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f2ec9243-b231-4b62-8e0a-8a0004235068 tempest-ProjectReaderTests-1166262798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:28:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f2ec9243-b231-4b62-8e0a-8a0004235068 tempest-ProjectReaderTests-1166262798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:28:41 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-f2ec9243-b231-4b62-8e0a-8a0004235068 tempest-ProjectReaderTests-1166262798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:28:41 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-f2ec9243-b231-4b62-8e0a-8a0004235068 tempest-ProjectReaderTests-1166262798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:28:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f2ec9243-b231-4b62-8e0a-8a0004235068 tempest-ProjectReaderTests-1166262798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:28:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f2ec9243-b231-4b62-8e0a-8a0004235068 tempest-ProjectReaderTests-1166262798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:28:41 devstack sudo[100512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:28:41 devstack sudo[100512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:28:42 devstack sudo[100512]: pam_unix(sudo:session): session closed for user root Sep 15 16:28:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f2ec9243-b231-4b62-8e0a-8a0004235068 tempest-ProjectReaderTests-1166262798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.307s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:28:42 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-f2ec9243-b231-4b62-8e0a-8a0004235068 tempest-ProjectReaderTests-1166262798 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:28:42 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-f2ec9243-b231-4b62-8e0a-8a0004235068 tempest-ProjectReaderTests-1166262798 None] Deleted volume successfully. Sep 15 16:28:42 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f2ec9243-b231-4b62-8e0a-8a0004235068 tempest-ProjectReaderTests-1166262798 None] Lock "cinder-1f04f7e2-34ef-4e2b-a178-1ca696ff08f6-delete_volume" released by "delete_volume" :: held 1.781s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:28:43 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ac0b0d4-8112-48db-92d4-f6b6900bad91 tempest-ProjectReaderTests-1166262798 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:28:43 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-6ac0b0d4-8112-48db-92d4-f6b6900bad91 tempest-ProjectReaderTests-1166262798 None] Flow 'volume_create_manager' (b68e2ddf-97cd-4e87-91e6-dcc6f7b54751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:28:43 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-6ac0b0d4-8112-48db-92d4-f6b6900bad91 tempest-ProjectReaderTests-1166262798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c39cb457-13ed-4b17-b99c-4c5aa1ebed59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:28:43 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-6ac0b0d4-8112-48db-92d4-f6b6900bad91 tempest-ProjectReaderTests-1166262798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c39cb457-13ed-4b17-b99c-4c5aa1ebed59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:28:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2009814027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a71a3d1-48f7-4c47-addd-c00999ac59fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f10add438931461e934dfa3f3d813619',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:28:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:28:43Z,use_quota=True,user_id='4927118af22042fc91a74b27416b4df3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:28:43 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-6ac0b0d4-8112-48db-92d4-f6b6900bad91 tempest-ProjectReaderTests-1166262798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65c81e6d-fe64-4b68-9b42-66035b057a11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:28:43 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-6ac0b0d4-8112-48db-92d4-f6b6900bad91 tempest-ProjectReaderTests-1166262798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65c81e6d-fe64-4b68-9b42-66035b057a11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:28:43 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-6ac0b0d4-8112-48db-92d4-f6b6900bad91 tempest-ProjectReaderTests-1166262798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a96dee7-f136-4320-825e-d39ebd49c676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:28:43 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-6ac0b0d4-8112-48db-92d4-f6b6900bad91 tempest-ProjectReaderTests-1166262798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a96dee7-f136-4320-825e-d39ebd49c676) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a71a3d1-48f7-4c47-addd-c00999ac59fa', 'volume_name': 'volume-7a71a3d1-48f7-4c47-addd-c00999ac59fa', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:28:43 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-6ac0b0d4-8112-48db-92d4-f6b6900bad91 tempest-ProjectReaderTests-1166262798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f88ce77-1400-475a-82a5-dcf21277df85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:28:43 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-6ac0b0d4-8112-48db-92d4-f6b6900bad91 tempest-ProjectReaderTests-1166262798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f88ce77-1400-475a-82a5-dcf21277df85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:28:43 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-6ac0b0d4-8112-48db-92d4-f6b6900bad91 tempest-ProjectReaderTests-1166262798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fb21cb4-d2d0-4d75-857d-2c87016a76b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:28:43 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-6ac0b0d4-8112-48db-92d4-f6b6900bad91 tempest-ProjectReaderTests-1166262798 None] Volume 7a71a3d1-48f7-4c47-addd-c00999ac59fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a71a3d1-48f7-4c47-addd-c00999ac59fa', 'volume_size': 1} Sep 15 16:28:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-6ac0b0d4-8112-48db-92d4-f6b6900bad91 tempest-ProjectReaderTests-1166262798 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:28:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-6ac0b0d4-8112-48db-92d4-f6b6900bad91 tempest-ProjectReaderTests-1166262798 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:28:43 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-6ac0b0d4-8112-48db-92d4-f6b6900bad91 tempest-ProjectReaderTests-1166262798 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:28:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2009814027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a71a3d1-48f7-4c47-addd-c00999ac59fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f10add438931461e934dfa3f3d813619',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:28:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:28:43Z,use_quota=True,user_id='4927118af22042fc91a74b27416b4df3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:28:43 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-6ac0b0d4-8112-48db-92d4-f6b6900bad91 tempest-ProjectReaderTests-1166262798 None] Creating volume 7a71a3d1-48f7-4c47-addd-c00999ac59fa {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:28:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-6ac0b0d4-8112-48db-92d4-f6b6900bad91 tempest-ProjectReaderTests-1166262798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:28:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-6ac0b0d4-8112-48db-92d4-f6b6900bad91 tempest-ProjectReaderTests-1166262798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:28:43 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-6ac0b0d4-8112-48db-92d4-f6b6900bad91 tempest-ProjectReaderTests-1166262798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:28:43 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-6ac0b0d4-8112-48db-92d4-f6b6900bad91 tempest-ProjectReaderTests-1166262798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:28:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-6ac0b0d4-8112-48db-92d4-f6b6900bad91 tempest-ProjectReaderTests-1166262798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:28:43 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-6ac0b0d4-8112-48db-92d4-f6b6900bad91 tempest-ProjectReaderTests-1166262798 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:28:43 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-6ac0b0d4-8112-48db-92d4-f6b6900bad91 tempest-ProjectReaderTests-1166262798 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:28:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-6ac0b0d4-8112-48db-92d4-f6b6900bad91 tempest-ProjectReaderTests-1166262798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-7a71a3d1-48f7-4c47-addd-c00999ac59fa 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:28:43 devstack sudo[100515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-7a71a3d1-48f7-4c47-addd-c00999ac59fa 1073741824 Sep 15 16:28:43 devstack sudo[100515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:28:44 devstack sudo[100515]: pam_unix(sudo:session): session closed for user root Sep 15 16:28:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-6ac0b0d4-8112-48db-92d4-f6b6900bad91 tempest-ProjectReaderTests-1166262798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-7a71a3d1-48f7-4c47-addd-c00999ac59fa 1073741824" returned: 0 in 1.089s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:28:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-6ac0b0d4-8112-48db-92d4-f6b6900bad91 tempest-ProjectReaderTests-1166262798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-7a71a3d1-48f7-4c47-addd-c00999ac59fa {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:28:44 devstack sudo[100530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-7a71a3d1-48f7-4c47-addd-c00999ac59fa Sep 15 16:28:44 devstack sudo[100530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:28:45 devstack sudo[100530]: pam_unix(sudo:session): session closed for user root Sep 15 16:28:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-6ac0b0d4-8112-48db-92d4-f6b6900bad91 tempest-ProjectReaderTests-1166262798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-7a71a3d1-48f7-4c47-addd-c00999ac59fa" returned: 0 in 0.309s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:28:45 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-6ac0b0d4-8112-48db-92d4-f6b6900bad91 tempest-ProjectReaderTests-1166262798 None] <== create_volume: return (1471ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:28:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-6ac0b0d4-8112-48db-92d4-f6b6900bad91 tempest-ProjectReaderTests-1166262798 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.476s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:28:45 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-6ac0b0d4-8112-48db-92d4-f6b6900bad91 tempest-ProjectReaderTests-1166262798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fb21cb4-d2d0-4d75-857d-2c87016a76b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a71a3d1-48f7-4c47-addd-c00999ac59fa', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:28:45 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-6ac0b0d4-8112-48db-92d4-f6b6900bad91 tempest-ProjectReaderTests-1166262798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6674e1d4-f13c-4338-9881-9ad639534424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:28:45 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-6ac0b0d4-8112-48db-92d4-f6b6900bad91 tempest-ProjectReaderTests-1166262798 None] Volume volume-7a71a3d1-48f7-4c47-addd-c00999ac59fa (7a71a3d1-48f7-4c47-addd-c00999ac59fa): created successfully Sep 15 16:28:45 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-6ac0b0d4-8112-48db-92d4-f6b6900bad91 tempest-ProjectReaderTests-1166262798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6674e1d4-f13c-4338-9881-9ad639534424) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:28:45 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-6ac0b0d4-8112-48db-92d4-f6b6900bad91 tempest-ProjectReaderTests-1166262798 None] Flow 'volume_create_manager' (b68e2ddf-97cd-4e87-91e6-dcc6f7b54751) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:28:45 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-6ac0b0d4-8112-48db-92d4-f6b6900bad91 tempest-ProjectReaderTests-1166262798 None] Created volume successfully. Sep 15 16:28:45 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-01b6bcd5-9940-48a0-999e-cb8cab5de77a tempest-ProjectReaderTests-1166262798 None] Acquiring lock "cinder-7a71a3d1-48f7-4c47-addd-c00999ac59fa-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:28:45 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-01b6bcd5-9940-48a0-999e-cb8cab5de77a tempest-ProjectReaderTests-1166262798 None] Lock "cinder-7a71a3d1-48f7-4c47-addd-c00999ac59fa-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:28:45 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-01b6bcd5-9940-48a0-999e-cb8cab5de77a tempest-ProjectReaderTests-1166262798 None] Acquiring lock "cinder-quobyte-7a71a3d1-48f7-4c47-addd-c00999ac59fa" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:28:45 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-01b6bcd5-9940-48a0-999e-cb8cab5de77a tempest-ProjectReaderTests-1166262798 None] Lock "cinder-quobyte-7a71a3d1-48f7-4c47-addd-c00999ac59fa" acquired by "delete_volume" :: waited 0.029s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:28:46 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[1896b0a8-93ef-466f-89ac-1f9668709d18]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:28:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-01b6bcd5-9940-48a0-999e-cb8cab5de77a tempest-ProjectReaderTests-1166262798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-7a71a3d1-48f7-4c47-addd-c00999ac59fa {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:28:46 devstack sudo[100534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-7a71a3d1-48f7-4c47-addd-c00999ac59fa Sep 15 16:28:46 devstack sudo[100534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:28:46 devstack sudo[100534]: pam_unix(sudo:session): session closed for user root Sep 15 16:28:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-01b6bcd5-9940-48a0-999e-cb8cab5de77a tempest-ProjectReaderTests-1166262798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-7a71a3d1-48f7-4c47-addd-c00999ac59fa" returned: 0 in 0.482s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:28:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-01b6bcd5-9940-48a0-999e-cb8cab5de77a tempest-ProjectReaderTests-1166262798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-7a71a3d1-48f7-4c47-addd-c00999ac59fa {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:28:46 devstack sudo[100540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-7a71a3d1-48f7-4c47-addd-c00999ac59fa Sep 15 16:28:46 devstack sudo[100540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:28:46 devstack sudo[100540]: pam_unix(sudo:session): session closed for user root Sep 15 16:28:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-01b6bcd5-9940-48a0-999e-cb8cab5de77a tempest-ProjectReaderTests-1166262798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-7a71a3d1-48f7-4c47-addd-c00999ac59fa" returned: 0 in 0.382s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:28:46 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-01b6bcd5-9940-48a0-999e-cb8cab5de77a tempest-ProjectReaderTests-1166262798 None] Lock "cinder-quobyte-7a71a3d1-48f7-4c47-addd-c00999ac59fa" released by "delete_volume" :: held 0.968s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:28:47 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-01b6bcd5-9940-48a0-999e-cb8cab5de77a tempest-ProjectReaderTests-1166262798 None] Created reservations ['ae1edc1c-6b8b-4afc-b5a6-0ddbf2cf4caa', 'be4621d0-2883-4a6e-a549-79855e2aa7a7', 'b8b3ae7c-95ef-4d7e-b947-da2db49267a6', '4e6dbf36-52de-4a75-b404-61d270def0b0'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:28:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-01b6bcd5-9940-48a0-999e-cb8cab5de77a tempest-ProjectReaderTests-1166262798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:28:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-01b6bcd5-9940-48a0-999e-cb8cab5de77a tempest-ProjectReaderTests-1166262798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:28:47 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-01b6bcd5-9940-48a0-999e-cb8cab5de77a tempest-ProjectReaderTests-1166262798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:28:47 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-01b6bcd5-9940-48a0-999e-cb8cab5de77a tempest-ProjectReaderTests-1166262798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:28:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-01b6bcd5-9940-48a0-999e-cb8cab5de77a tempest-ProjectReaderTests-1166262798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:28:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-01b6bcd5-9940-48a0-999e-cb8cab5de77a tempest-ProjectReaderTests-1166262798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:28:47 devstack sudo[100545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:28:47 devstack sudo[100545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:28:47 devstack sudo[100545]: pam_unix(sudo:session): session closed for user root Sep 15 16:28:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-01b6bcd5-9940-48a0-999e-cb8cab5de77a tempest-ProjectReaderTests-1166262798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.425s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:28:47 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-01b6bcd5-9940-48a0-999e-cb8cab5de77a tempest-ProjectReaderTests-1166262798 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:28:47 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-01b6bcd5-9940-48a0-999e-cb8cab5de77a tempest-ProjectReaderTests-1166262798 None] Deleted volume successfully. Sep 15 16:28:47 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-01b6bcd5-9940-48a0-999e-cb8cab5de77a tempest-ProjectReaderTests-1166262798 None] Lock "cinder-7a71a3d1-48f7-4c47-addd-c00999ac59fa-delete_volume" released by "delete_volume" :: held 1.835s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:28:48 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:SELECT=86,cinder:INSERT=34,cinder:UPDATE=123,cinder:DELETE=11 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 16:28:48 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-8bb01795-a4c8-4e18-9cb0-97d1ae51d8cf tempest-ProjectReaderTests-1166262798 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:28:48 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8bb01795-a4c8-4e18-9cb0-97d1ae51d8cf tempest-ProjectReaderTests-1166262798 None] Flow 'volume_create_manager' (8ea6cea4-6f8d-4d99-bc67-3babe7df01fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:28:48 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8bb01795-a4c8-4e18-9cb0-97d1ae51d8cf tempest-ProjectReaderTests-1166262798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da67fed9-c20c-43fa-968c-9c1a39aa4459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:28:48 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8bb01795-a4c8-4e18-9cb0-97d1ae51d8cf tempest-ProjectReaderTests-1166262798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da67fed9-c20c-43fa-968c-9c1a39aa4459) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:28:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1915190944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eee2bd7c-74ad-4a92-8d56-818c615abb91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f10add438931461e934dfa3f3d813619',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:28:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:28:49Z,use_quota=True,user_id='4927118af22042fc91a74b27416b4df3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:28:48 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8bb01795-a4c8-4e18-9cb0-97d1ae51d8cf tempest-ProjectReaderTests-1166262798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0087d16f-e0fc-46b8-be60-9b0c80fd5e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:28:48 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8bb01795-a4c8-4e18-9cb0-97d1ae51d8cf tempest-ProjectReaderTests-1166262798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0087d16f-e0fc-46b8-be60-9b0c80fd5e25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:28:48 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8bb01795-a4c8-4e18-9cb0-97d1ae51d8cf tempest-ProjectReaderTests-1166262798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2e81cc4-ac10-44f0-ab9d-4072dbac2890) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:28:48 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8bb01795-a4c8-4e18-9cb0-97d1ae51d8cf tempest-ProjectReaderTests-1166262798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2e81cc4-ac10-44f0-ab9d-4072dbac2890) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eee2bd7c-74ad-4a92-8d56-818c615abb91', 'volume_name': 'volume-eee2bd7c-74ad-4a92-8d56-818c615abb91', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:28:48 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8bb01795-a4c8-4e18-9cb0-97d1ae51d8cf tempest-ProjectReaderTests-1166262798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd93f722-574e-41b7-9ff3-b7a75c7d8160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:28:48 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8bb01795-a4c8-4e18-9cb0-97d1ae51d8cf tempest-ProjectReaderTests-1166262798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd93f722-574e-41b7-9ff3-b7a75c7d8160) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:28:48 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8bb01795-a4c8-4e18-9cb0-97d1ae51d8cf tempest-ProjectReaderTests-1166262798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e79e578-2797-48a5-9917-8555aaf7f189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:28:48 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-8bb01795-a4c8-4e18-9cb0-97d1ae51d8cf tempest-ProjectReaderTests-1166262798 None] Volume eee2bd7c-74ad-4a92-8d56-818c615abb91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eee2bd7c-74ad-4a92-8d56-818c615abb91', 'volume_size': 1} Sep 15 16:28:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-8bb01795-a4c8-4e18-9cb0-97d1ae51d8cf tempest-ProjectReaderTests-1166262798 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:28:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-8bb01795-a4c8-4e18-9cb0-97d1ae51d8cf tempest-ProjectReaderTests-1166262798 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:28:48 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-8bb01795-a4c8-4e18-9cb0-97d1ae51d8cf tempest-ProjectReaderTests-1166262798 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:28:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1915190944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eee2bd7c-74ad-4a92-8d56-818c615abb91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f10add438931461e934dfa3f3d813619',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:28:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:28:49Z,use_quota=True,user_id='4927118af22042fc91a74b27416b4df3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:28:48 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-8bb01795-a4c8-4e18-9cb0-97d1ae51d8cf tempest-ProjectReaderTests-1166262798 None] Creating volume eee2bd7c-74ad-4a92-8d56-818c615abb91 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:28:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-8bb01795-a4c8-4e18-9cb0-97d1ae51d8cf tempest-ProjectReaderTests-1166262798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:28:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-8bb01795-a4c8-4e18-9cb0-97d1ae51d8cf tempest-ProjectReaderTests-1166262798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:28:48 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-8bb01795-a4c8-4e18-9cb0-97d1ae51d8cf tempest-ProjectReaderTests-1166262798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:28:48 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-8bb01795-a4c8-4e18-9cb0-97d1ae51d8cf tempest-ProjectReaderTests-1166262798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:28:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-8bb01795-a4c8-4e18-9cb0-97d1ae51d8cf tempest-ProjectReaderTests-1166262798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:28:48 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-8bb01795-a4c8-4e18-9cb0-97d1ae51d8cf tempest-ProjectReaderTests-1166262798 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:28:48 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-8bb01795-a4c8-4e18-9cb0-97d1ae51d8cf tempest-ProjectReaderTests-1166262798 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:28:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8bb01795-a4c8-4e18-9cb0-97d1ae51d8cf tempest-ProjectReaderTests-1166262798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-eee2bd7c-74ad-4a92-8d56-818c615abb91 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:28:49 devstack sudo[100548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-eee2bd7c-74ad-4a92-8d56-818c615abb91 1073741824 Sep 15 16:28:49 devstack sudo[100548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:28:49 devstack sudo[100548]: pam_unix(sudo:session): session closed for user root Sep 15 16:28:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8bb01795-a4c8-4e18-9cb0-97d1ae51d8cf tempest-ProjectReaderTests-1166262798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-eee2bd7c-74ad-4a92-8d56-818c615abb91 1073741824" returned: 0 in 0.821s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:28:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8bb01795-a4c8-4e18-9cb0-97d1ae51d8cf tempest-ProjectReaderTests-1166262798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-eee2bd7c-74ad-4a92-8d56-818c615abb91 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:28:49 devstack sudo[100555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-eee2bd7c-74ad-4a92-8d56-818c615abb91 Sep 15 16:28:49 devstack sudo[100555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:28:50 devstack sudo[100555]: pam_unix(sudo:session): session closed for user root Sep 15 16:28:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8bb01795-a4c8-4e18-9cb0-97d1ae51d8cf tempest-ProjectReaderTests-1166262798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-eee2bd7c-74ad-4a92-8d56-818c615abb91" returned: 0 in 0.381s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:28:50 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-8bb01795-a4c8-4e18-9cb0-97d1ae51d8cf tempest-ProjectReaderTests-1166262798 None] <== create_volume: return (1268ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:28:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-8bb01795-a4c8-4e18-9cb0-97d1ae51d8cf tempest-ProjectReaderTests-1166262798 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.274s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:28:50 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8bb01795-a4c8-4e18-9cb0-97d1ae51d8cf tempest-ProjectReaderTests-1166262798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e79e578-2797-48a5-9917-8555aaf7f189) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eee2bd7c-74ad-4a92-8d56-818c615abb91', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:28:50 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8bb01795-a4c8-4e18-9cb0-97d1ae51d8cf tempest-ProjectReaderTests-1166262798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec5970a7-2112-4ce1-82ff-c92eb0c43260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:28:50 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-8bb01795-a4c8-4e18-9cb0-97d1ae51d8cf tempest-ProjectReaderTests-1166262798 None] Volume volume-eee2bd7c-74ad-4a92-8d56-818c615abb91 (eee2bd7c-74ad-4a92-8d56-818c615abb91): created successfully Sep 15 16:28:50 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8bb01795-a4c8-4e18-9cb0-97d1ae51d8cf tempest-ProjectReaderTests-1166262798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec5970a7-2112-4ce1-82ff-c92eb0c43260) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:28:50 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8bb01795-a4c8-4e18-9cb0-97d1ae51d8cf tempest-ProjectReaderTests-1166262798 None] Flow 'volume_create_manager' (8ea6cea4-6f8d-4d99-bc67-3babe7df01fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:28:50 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-8bb01795-a4c8-4e18-9cb0-97d1ae51d8cf tempest-ProjectReaderTests-1166262798 None] Created volume successfully. Sep 15 16:28:51 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-4e38f8f1-538c-4934-883a-f3a9d9ef52f0 tempest-ProjectReaderTests-1166262798 None] Acquiring lock "cinder-eee2bd7c-74ad-4a92-8d56-818c615abb91-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:28:51 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-4e38f8f1-538c-4934-883a-f3a9d9ef52f0 tempest-ProjectReaderTests-1166262798 None] Lock "cinder-eee2bd7c-74ad-4a92-8d56-818c615abb91-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:28:51 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-4e38f8f1-538c-4934-883a-f3a9d9ef52f0 tempest-ProjectReaderTests-1166262798 None] Acquiring lock "cinder-quobyte-eee2bd7c-74ad-4a92-8d56-818c615abb91" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:28:51 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-4e38f8f1-538c-4934-883a-f3a9d9ef52f0 tempest-ProjectReaderTests-1166262798 None] Lock "cinder-quobyte-eee2bd7c-74ad-4a92-8d56-818c615abb91" acquired by "delete_volume" :: waited 0.014s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:28:51 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cd95a5d-86a9-4ed5-bb99-f33400da3dde]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:28:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4e38f8f1-538c-4934-883a-f3a9d9ef52f0 tempest-ProjectReaderTests-1166262798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-eee2bd7c-74ad-4a92-8d56-818c615abb91 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:28:51 devstack sudo[100578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-eee2bd7c-74ad-4a92-8d56-818c615abb91 Sep 15 16:28:51 devstack sudo[100578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:28:51 devstack sudo[100578]: pam_unix(sudo:session): session closed for user root Sep 15 16:28:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4e38f8f1-538c-4934-883a-f3a9d9ef52f0 tempest-ProjectReaderTests-1166262798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-eee2bd7c-74ad-4a92-8d56-818c615abb91" returned: 0 in 0.367s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:28:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4e38f8f1-538c-4934-883a-f3a9d9ef52f0 tempest-ProjectReaderTests-1166262798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-eee2bd7c-74ad-4a92-8d56-818c615abb91 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:28:51 devstack sudo[100583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-eee2bd7c-74ad-4a92-8d56-818c615abb91 Sep 15 16:28:51 devstack sudo[100583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:28:51 devstack sudo[100583]: pam_unix(sudo:session): session closed for user root Sep 15 16:28:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4e38f8f1-538c-4934-883a-f3a9d9ef52f0 tempest-ProjectReaderTests-1166262798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-eee2bd7c-74ad-4a92-8d56-818c615abb91" returned: 0 in 0.341s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:28:51 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-4e38f8f1-538c-4934-883a-f3a9d9ef52f0 tempest-ProjectReaderTests-1166262798 None] Lock "cinder-quobyte-eee2bd7c-74ad-4a92-8d56-818c615abb91" released by "delete_volume" :: held 0.764s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:28:51 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-4e38f8f1-538c-4934-883a-f3a9d9ef52f0 tempest-ProjectReaderTests-1166262798 None] Created reservations ['0aa3ed77-2b9e-4144-9305-cedb78dade1a', '89c55527-5737-4d97-93e3-a2d8e027387d', '16473106-d527-4fa2-b834-0252c96bddbd', '31ec3615-620b-4899-b098-e28aa4869e87'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:28:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-4e38f8f1-538c-4934-883a-f3a9d9ef52f0 tempest-ProjectReaderTests-1166262798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:28:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-4e38f8f1-538c-4934-883a-f3a9d9ef52f0 tempest-ProjectReaderTests-1166262798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:28:51 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-4e38f8f1-538c-4934-883a-f3a9d9ef52f0 tempest-ProjectReaderTests-1166262798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:28:52 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-4e38f8f1-538c-4934-883a-f3a9d9ef52f0 tempest-ProjectReaderTests-1166262798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:28:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-4e38f8f1-538c-4934-883a-f3a9d9ef52f0 tempest-ProjectReaderTests-1166262798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:28:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4e38f8f1-538c-4934-883a-f3a9d9ef52f0 tempest-ProjectReaderTests-1166262798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:28:52 devstack sudo[100586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:28:52 devstack sudo[100586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:28:52 devstack sudo[100586]: pam_unix(sudo:session): session closed for user root Sep 15 16:28:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4e38f8f1-538c-4934-883a-f3a9d9ef52f0 tempest-ProjectReaderTests-1166262798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.398s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:28:52 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-4e38f8f1-538c-4934-883a-f3a9d9ef52f0 tempest-ProjectReaderTests-1166262798 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:28:52 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-4e38f8f1-538c-4934-883a-f3a9d9ef52f0 tempest-ProjectReaderTests-1166262798 None] Deleted volume successfully. Sep 15 16:28:52 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-4e38f8f1-538c-4934-883a-f3a9d9ef52f0 tempest-ProjectReaderTests-1166262798 None] Lock "cinder-eee2bd7c-74ad-4a92-8d56-818c615abb91-delete_volume" released by "delete_volume" :: held 1.408s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:28:59 devstack cinder-volume[86082]: DEBUG oslo_service.periodic_task [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86082) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 15 16:28:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:28:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:28:59 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:28:59 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:28:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:28:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:28:59 devstack sudo[100594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:28:59 devstack sudo[100594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:29:00 devstack sudo[100594]: pam_unix(sudo:session): session closed for user root Sep 15 16:29:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.280s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:29:00 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:29:00 devstack cinder-volume[86082]: DEBUG oslo_service.periodic_task [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Running periodic task VolumeManager._thread_info {{(pid=86082) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 15 16:29:00 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] thread count: 28 {{(pid=86082) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 15 16:29:00 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] thread info: [<_MainThread(MainThread, started 124875935469696)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86082) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 15 16:29:01 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:SELECT=5,cinder:UPDATE=9,cinder:DELETE=1,cinder:INSERT=3 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 16:29:02 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:UPDATE=105,cinder:SELECT=76,cinder:DELETE=10,cinder:INSERT=22 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 16:29:06 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-b02f0889-5ca1-4354-b030-66bf4fbd261e tempest-VolumesActionsTest-120108262 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:29:06 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b02f0889-5ca1-4354-b030-66bf4fbd261e tempest-VolumesActionsTest-120108262 None] Flow 'volume_create_manager' (41f426bb-70fd-424c-9cf9-3f0be0fba36c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:29:06 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b02f0889-5ca1-4354-b030-66bf4fbd261e tempest-VolumesActionsTest-120108262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcb96cf6-cd55-4bdb-a52a-ff355666b9fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:29:06 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b02f0889-5ca1-4354-b030-66bf4fbd261e tempest-VolumesActionsTest-120108262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcb96cf6-cd55-4bdb-a52a-ff355666b9fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:29:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1708795047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d14102d1-bb47-47f1-90f3-cd503101bfaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf724d027de944b68cf4f9140c05fe12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:29:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:29:06Z,use_quota=True,user_id='c9a15206cb504c7bafaefa02ba291bd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:29:06 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b02f0889-5ca1-4354-b030-66bf4fbd261e tempest-VolumesActionsTest-120108262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e21a06b0-a963-4a9c-ab6f-9613a2bded59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:29:06 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b02f0889-5ca1-4354-b030-66bf4fbd261e tempest-VolumesActionsTest-120108262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e21a06b0-a963-4a9c-ab6f-9613a2bded59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:29:06 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b02f0889-5ca1-4354-b030-66bf4fbd261e tempest-VolumesActionsTest-120108262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6cfc06d-7169-40db-bc38-6a0191804225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:29:06 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b02f0889-5ca1-4354-b030-66bf4fbd261e tempest-VolumesActionsTest-120108262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6cfc06d-7169-40db-bc38-6a0191804225) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd14102d1-bb47-47f1-90f3-cd503101bfaf', 'volume_name': 'volume-d14102d1-bb47-47f1-90f3-cd503101bfaf', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:29:06 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b02f0889-5ca1-4354-b030-66bf4fbd261e tempest-VolumesActionsTest-120108262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6121ee9d-0d3e-4766-b116-c48ab34ea007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:29:06 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b02f0889-5ca1-4354-b030-66bf4fbd261e tempest-VolumesActionsTest-120108262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6121ee9d-0d3e-4766-b116-c48ab34ea007) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:29:06 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b02f0889-5ca1-4354-b030-66bf4fbd261e tempest-VolumesActionsTest-120108262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef7f3500-cb32-4615-8da5-1534aeeef989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:29:06 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-b02f0889-5ca1-4354-b030-66bf4fbd261e tempest-VolumesActionsTest-120108262 None] Volume d14102d1-bb47-47f1-90f3-cd503101bfaf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d14102d1-bb47-47f1-90f3-cd503101bfaf', 'volume_size': 1} Sep 15 16:29:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b02f0889-5ca1-4354-b030-66bf4fbd261e tempest-VolumesActionsTest-120108262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:29:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b02f0889-5ca1-4354-b030-66bf4fbd261e tempest-VolumesActionsTest-120108262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:29:06 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-b02f0889-5ca1-4354-b030-66bf4fbd261e tempest-VolumesActionsTest-120108262 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:29:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1708795047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d14102d1-bb47-47f1-90f3-cd503101bfaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf724d027de944b68cf4f9140c05fe12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:29:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:29:06Z,use_quota=True,user_id='c9a15206cb504c7bafaefa02ba291bd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:29:06 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-b02f0889-5ca1-4354-b030-66bf4fbd261e tempest-VolumesActionsTest-120108262 None] Creating volume d14102d1-bb47-47f1-90f3-cd503101bfaf {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:29:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b02f0889-5ca1-4354-b030-66bf4fbd261e tempest-VolumesActionsTest-120108262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:29:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b02f0889-5ca1-4354-b030-66bf4fbd261e tempest-VolumesActionsTest-120108262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:29:06 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-b02f0889-5ca1-4354-b030-66bf4fbd261e tempest-VolumesActionsTest-120108262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:29:06 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-b02f0889-5ca1-4354-b030-66bf4fbd261e tempest-VolumesActionsTest-120108262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:29:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b02f0889-5ca1-4354-b030-66bf4fbd261e tempest-VolumesActionsTest-120108262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:29:06 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-b02f0889-5ca1-4354-b030-66bf4fbd261e tempest-VolumesActionsTest-120108262 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:29:06 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-b02f0889-5ca1-4354-b030-66bf4fbd261e tempest-VolumesActionsTest-120108262 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:29:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b02f0889-5ca1-4354-b030-66bf4fbd261e tempest-VolumesActionsTest-120108262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-d14102d1-bb47-47f1-90f3-cd503101bfaf 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:29:06 devstack sudo[100687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-d14102d1-bb47-47f1-90f3-cd503101bfaf 1073741824 Sep 15 16:29:06 devstack sudo[100687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:29:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-cd08e5d1-a387-49fe-a343-6976a5892e77 req-9ab1814c-798d-44e0-9b47-271f6948ba2e tempest-TestServerVolumeAttachmentScenario-1564993328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:29:07 devstack sudo[100687]: pam_unix(sudo:session): session closed for user root Sep 15 16:29:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b02f0889-5ca1-4354-b030-66bf4fbd261e tempest-VolumesActionsTest-120108262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-d14102d1-bb47-47f1-90f3-cd503101bfaf 1073741824" returned: 0 in 0.541s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:29:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b02f0889-5ca1-4354-b030-66bf4fbd261e tempest-VolumesActionsTest-120108262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-d14102d1-bb47-47f1-90f3-cd503101bfaf {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:29:07 devstack sudo[100702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-d14102d1-bb47-47f1-90f3-cd503101bfaf Sep 15 16:29:07 devstack sudo[100702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:29:07 devstack sudo[100702]: pam_unix(sudo:session): session closed for user root Sep 15 16:29:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b02f0889-5ca1-4354-b030-66bf4fbd261e tempest-VolumesActionsTest-120108262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-d14102d1-bb47-47f1-90f3-cd503101bfaf" returned: 0 in 0.255s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:29:07 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-b02f0889-5ca1-4354-b030-66bf4fbd261e tempest-VolumesActionsTest-120108262 None] <== create_volume: return (843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:29:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b02f0889-5ca1-4354-b030-66bf4fbd261e tempest-VolumesActionsTest-120108262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.845s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:29:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-cd08e5d1-a387-49fe-a343-6976a5892e77 req-9ab1814c-798d-44e0-9b47-271f6948ba2e tempest-TestServerVolumeAttachmentScenario-1564993328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.425s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:29:07 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b02f0889-5ca1-4354-b030-66bf4fbd261e tempest-VolumesActionsTest-120108262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef7f3500-cb32-4615-8da5-1534aeeef989) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d14102d1-bb47-47f1-90f3-cd503101bfaf', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:29:07 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b02f0889-5ca1-4354-b030-66bf4fbd261e tempest-VolumesActionsTest-120108262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5459e2bc-d2e4-4273-950a-881ba6e0ec29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:29:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-cd08e5d1-a387-49fe-a343-6976a5892e77 req-9ab1814c-798d-44e0-9b47-271f6948ba2e tempest-TestServerVolumeAttachmentScenario-1564993328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:29:07 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-b02f0889-5ca1-4354-b030-66bf4fbd261e tempest-VolumesActionsTest-120108262 None] Volume volume-d14102d1-bb47-47f1-90f3-cd503101bfaf (d14102d1-bb47-47f1-90f3-cd503101bfaf): created successfully Sep 15 16:29:07 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b02f0889-5ca1-4354-b030-66bf4fbd261e tempest-VolumesActionsTest-120108262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5459e2bc-d2e4-4273-950a-881ba6e0ec29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:29:07 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b02f0889-5ca1-4354-b030-66bf4fbd261e tempest-VolumesActionsTest-120108262 None] Flow 'volume_create_manager' (41f426bb-70fd-424c-9cf9-3f0be0fba36c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:29:07 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-b02f0889-5ca1-4354-b030-66bf4fbd261e tempest-VolumesActionsTest-120108262 None] Created volume successfully. Sep 15 16:29:07 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-cd08e5d1-a387-49fe-a343-6976a5892e77 req-9ab1814c-798d-44e0-9b47-271f6948ba2e tempest-TestServerVolumeAttachmentScenario-1564993328 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a', 'name': 'volume-06f3fa68-94ee-4f9b-8a79-5dde93802350', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '84b39a2a-6501-4a28-9a0b-90aa0db0ed83', 'enforce_multipath': True} {{(pid=86082) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 15 16:29:07 devstack cinder-volume[86082]: INFO cinder.volume.manager [req-cd08e5d1-a387-49fe-a343-6976a5892e77 req-9ab1814c-798d-44e0-9b47-271f6948ba2e tempest-TestServerVolumeAttachmentScenario-1564993328 None] attachment_update completed successfully. Sep 15 16:29:08 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-30cc9947-0a16-4908-993a-195b53991591 tempest-VolumesActionsTest-120108262 None] Acquiring lock "cinder-d14102d1-bb47-47f1-90f3-cd503101bfaf" by "attach_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:29:08 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-30cc9947-0a16-4908-993a-195b53991591 tempest-VolumesActionsTest-120108262 None] Lock "cinder-d14102d1-bb47-47f1-90f3-cd503101bfaf" acquired by "attach_volume" :: waited 0.015s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:29:08 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-30cc9947-0a16-4908-993a-195b53991591 tempest-VolumesActionsTest-120108262 None] Attaching volume d14102d1-bb47-47f1-90f3-cd503101bfaf to instance ebf33e77-3f4c-42e2-8dea-efc93f590383 at mountpoint /dev/vdb on host None. Sep 15 16:29:08 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-30cc9947-0a16-4908-993a-195b53991591 tempest-VolumesActionsTest-120108262 None] Attach volume completed successfully. Sep 15 16:29:08 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-30cc9947-0a16-4908-993a-195b53991591 tempest-VolumesActionsTest-120108262 None] Lock "cinder-d14102d1-bb47-47f1-90f3-cd503101bfaf" released by "attach_volume" :: held 0.090s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:29:08 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-6a5d5ded-82f6-4c24-aa80-657e8accb24a tempest-VolumesActionsTest-909266678 None] Terminate volume connection completed successfully. Sep 15 16:29:09 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-6a5d5ded-82f6-4c24-aa80-657e8accb24a tempest-VolumesActionsTest-909266678 None] Acquiring lock "cinder-d14102d1-bb47-47f1-90f3-cd503101bfaf-detach_volume" by "detach_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:29:09 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-6a5d5ded-82f6-4c24-aa80-657e8accb24a tempest-VolumesActionsTest-909266678 None] Lock "cinder-d14102d1-bb47-47f1-90f3-cd503101bfaf-detach_volume" acquired by "detach_volume" :: waited 0.032s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:29:09 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-6a5d5ded-82f6-4c24-aa80-657e8accb24a tempest-VolumesActionsTest-909266678 None] Detaching volume d14102d1-bb47-47f1-90f3-cd503101bfaf from instance ebf33e77-3f4c-42e2-8dea-efc93f590383. Sep 15 16:29:09 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-6a5d5ded-82f6-4c24-aa80-657e8accb24a tempest-VolumesActionsTest-909266678 None] Detach volume completed successfully. Sep 15 16:29:09 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-6a5d5ded-82f6-4c24-aa80-657e8accb24a tempest-VolumesActionsTest-909266678 None] Lock "cinder-d14102d1-bb47-47f1-90f3-cd503101bfaf-detach_volume" released by "detach_volume" :: held 0.071s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:29:09 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-754b868d-6207-4cdf-b2c4-943df5c68540 tempest-VolumesActionsTest-120108262 None] Acquiring lock "cinder-d14102d1-bb47-47f1-90f3-cd503101bfaf-detach_volume" by "detach_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:29:09 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-754b868d-6207-4cdf-b2c4-943df5c68540 tempest-VolumesActionsTest-120108262 None] Lock "cinder-d14102d1-bb47-47f1-90f3-cd503101bfaf-detach_volume" acquired by "detach_volume" :: waited 0.027s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:29:09 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-754b868d-6207-4cdf-b2c4-943df5c68540 tempest-VolumesActionsTest-120108262 None] Volume detach called, but volume not attached. Sep 15 16:29:09 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-754b868d-6207-4cdf-b2c4-943df5c68540 tempest-VolumesActionsTest-120108262 None] Lock "cinder-d14102d1-bb47-47f1-90f3-cd503101bfaf-detach_volume" released by "detach_volume" :: held 0.016s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:29:09 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-030faeb9-2af8-4ec8-92f4-271d6c901c88 tempest-VolumesActionsTest-120108262 None] Acquiring lock "cinder-d14102d1-bb47-47f1-90f3-cd503101bfaf-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:29:09 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-030faeb9-2af8-4ec8-92f4-271d6c901c88 tempest-VolumesActionsTest-120108262 None] Lock "cinder-d14102d1-bb47-47f1-90f3-cd503101bfaf-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:29:09 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-030faeb9-2af8-4ec8-92f4-271d6c901c88 tempest-VolumesActionsTest-120108262 None] Acquiring lock "cinder-quobyte-d14102d1-bb47-47f1-90f3-cd503101bfaf" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:29:09 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-030faeb9-2af8-4ec8-92f4-271d6c901c88 tempest-VolumesActionsTest-120108262 None] Lock "cinder-quobyte-d14102d1-bb47-47f1-90f3-cd503101bfaf" acquired by "delete_volume" :: waited 0.028s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:29:09 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[49683bdc-7bd1-4e68-8ad4-07b877879d88]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:29:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-030faeb9-2af8-4ec8-92f4-271d6c901c88 tempest-VolumesActionsTest-120108262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-d14102d1-bb47-47f1-90f3-cd503101bfaf {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:29:09 devstack sudo[101118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-d14102d1-bb47-47f1-90f3-cd503101bfaf Sep 15 16:29:09 devstack sudo[101118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:29:10 devstack sudo[101118]: pam_unix(sudo:session): session closed for user root Sep 15 16:29:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-030faeb9-2af8-4ec8-92f4-271d6c901c88 tempest-VolumesActionsTest-120108262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-d14102d1-bb47-47f1-90f3-cd503101bfaf" returned: 0 in 0.402s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:29:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-030faeb9-2af8-4ec8-92f4-271d6c901c88 tempest-VolumesActionsTest-120108262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-d14102d1-bb47-47f1-90f3-cd503101bfaf {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:29:10 devstack sudo[101123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-d14102d1-bb47-47f1-90f3-cd503101bfaf Sep 15 16:29:10 devstack sudo[101123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:29:10 devstack sudo[101123]: pam_unix(sudo:session): session closed for user root Sep 15 16:29:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-030faeb9-2af8-4ec8-92f4-271d6c901c88 tempest-VolumesActionsTest-120108262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-d14102d1-bb47-47f1-90f3-cd503101bfaf" returned: 0 in 0.334s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:29:10 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-030faeb9-2af8-4ec8-92f4-271d6c901c88 tempest-VolumesActionsTest-120108262 None] Lock "cinder-quobyte-d14102d1-bb47-47f1-90f3-cd503101bfaf" released by "delete_volume" :: held 0.794s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:29:10 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-030faeb9-2af8-4ec8-92f4-271d6c901c88 tempest-VolumesActionsTest-120108262 None] Created reservations ['9885fbb1-14ed-4729-9b16-91c0574e5f28', 'ff51250f-fddd-453f-9203-762b4a5b0057', 'fca50448-126e-4a11-a3bc-2c45654428d0', '67645b3a-27aa-40ab-b589-6817ed3b99f8'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:29:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-030faeb9-2af8-4ec8-92f4-271d6c901c88 tempest-VolumesActionsTest-120108262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:29:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-030faeb9-2af8-4ec8-92f4-271d6c901c88 tempest-VolumesActionsTest-120108262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:29:10 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-030faeb9-2af8-4ec8-92f4-271d6c901c88 tempest-VolumesActionsTest-120108262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:29:10 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-030faeb9-2af8-4ec8-92f4-271d6c901c88 tempest-VolumesActionsTest-120108262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:29:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-030faeb9-2af8-4ec8-92f4-271d6c901c88 tempest-VolumesActionsTest-120108262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:29:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-030faeb9-2af8-4ec8-92f4-271d6c901c88 tempest-VolumesActionsTest-120108262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:29:10 devstack sudo[101126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:29:10 devstack sudo[101126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:29:11 devstack sudo[101126]: pam_unix(sudo:session): session closed for user root Sep 15 16:29:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-030faeb9-2af8-4ec8-92f4-271d6c901c88 tempest-VolumesActionsTest-120108262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.319s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:29:11 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-030faeb9-2af8-4ec8-92f4-271d6c901c88 tempest-VolumesActionsTest-120108262 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:29:11 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-030faeb9-2af8-4ec8-92f4-271d6c901c88 tempest-VolumesActionsTest-120108262 None] Deleted volume successfully. Sep 15 16:29:11 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-030faeb9-2af8-4ec8-92f4-271d6c901c88 tempest-VolumesActionsTest-120108262 None] Lock "cinder-d14102d1-bb47-47f1-90f3-cd503101bfaf-delete_volume" released by "delete_volume" :: held 1.396s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:29:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-2a3396cf-397a-45b9-babf-361450a87684 req-f8ed6bd1-13ec-4241-9ac0-f5937ecf342e tempest-TestServerVolumeAttachmentScenario-1564993328 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:29:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-2a3396cf-397a-45b9-babf-361450a87684 req-f8ed6bd1-13ec-4241-9ac0-f5937ecf342e tempest-TestServerVolumeAttachmentScenario-1564993328 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:29:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-2a3396cf-397a-45b9-babf-361450a87684 req-f8ed6bd1-13ec-4241-9ac0-f5937ecf342e tempest-TestServerVolumeAttachmentScenario-1564993328 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:29:12 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-2a3396cf-397a-45b9-babf-361450a87684 req-f8ed6bd1-13ec-4241-9ac0-f5937ecf342e tempest-TestServerVolumeAttachmentScenario-1564993328 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a', 'name': 'volume-f1c51ebf-b0d2-4737-ac5c-e15b99e8db4b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f17ce68f-1bb6-40e2-93dc-3f7629210bd9', 'enforce_multipath': True} {{(pid=86082) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 15 16:29:12 devstack cinder-volume[86082]: INFO cinder.volume.manager [req-2a3396cf-397a-45b9-babf-361450a87684 req-f8ed6bd1-13ec-4241-9ac0-f5937ecf342e tempest-TestServerVolumeAttachmentScenario-1564993328 None] attachment_update completed successfully. Sep 15 16:29:14 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-30f9e374-01ba-4e61-898b-5233233d1c78 tempest-VolumesActionsTest-120108262 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:29:14 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-30f9e374-01ba-4e61-898b-5233233d1c78 tempest-VolumesActionsTest-120108262 None] Flow 'volume_create_manager' (04fedef2-19e5-4cc2-881a-a4c9cda54553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:29:14 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-30f9e374-01ba-4e61-898b-5233233d1c78 tempest-VolumesActionsTest-120108262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58fd9b09-06e7-4025-8967-78a08e1e3226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:29:14 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-30f9e374-01ba-4e61-898b-5233233d1c78 tempest-VolumesActionsTest-120108262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58fd9b09-06e7-4025-8967-78a08e1e3226) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:29:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-564755167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0494a060-00f4-4c10-b96b-c6a91bb3266c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf724d027de944b68cf4f9140c05fe12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:29:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:29:14Z,use_quota=True,user_id='c9a15206cb504c7bafaefa02ba291bd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:29:14 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-30f9e374-01ba-4e61-898b-5233233d1c78 tempest-VolumesActionsTest-120108262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (babeb92b-ebb5-43a9-bd3c-2e3698d9d252) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:29:14 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-30f9e374-01ba-4e61-898b-5233233d1c78 tempest-VolumesActionsTest-120108262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (babeb92b-ebb5-43a9-bd3c-2e3698d9d252) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:29:14 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-30f9e374-01ba-4e61-898b-5233233d1c78 tempest-VolumesActionsTest-120108262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42fafd32-72ff-4b17-95ed-221da0847ee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:29:14 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-30f9e374-01ba-4e61-898b-5233233d1c78 tempest-VolumesActionsTest-120108262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42fafd32-72ff-4b17-95ed-221da0847ee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0494a060-00f4-4c10-b96b-c6a91bb3266c', 'volume_name': 'volume-0494a060-00f4-4c10-b96b-c6a91bb3266c', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:29:14 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-30f9e374-01ba-4e61-898b-5233233d1c78 tempest-VolumesActionsTest-120108262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5cfa03d-271d-4c1b-adbf-ecb9bd72b828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:29:14 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-30f9e374-01ba-4e61-898b-5233233d1c78 tempest-VolumesActionsTest-120108262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5cfa03d-271d-4c1b-adbf-ecb9bd72b828) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:29:14 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-30f9e374-01ba-4e61-898b-5233233d1c78 tempest-VolumesActionsTest-120108262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9726b0eb-bab8-4af3-aede-4acb625fe72c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:29:14 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-30f9e374-01ba-4e61-898b-5233233d1c78 tempest-VolumesActionsTest-120108262 None] Volume 0494a060-00f4-4c10-b96b-c6a91bb3266c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0494a060-00f4-4c10-b96b-c6a91bb3266c', 'volume_size': 1} Sep 15 16:29:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-30f9e374-01ba-4e61-898b-5233233d1c78 tempest-VolumesActionsTest-120108262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:29:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-30f9e374-01ba-4e61-898b-5233233d1c78 tempest-VolumesActionsTest-120108262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:29:14 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-30f9e374-01ba-4e61-898b-5233233d1c78 tempest-VolumesActionsTest-120108262 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:29:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-564755167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0494a060-00f4-4c10-b96b-c6a91bb3266c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf724d027de944b68cf4f9140c05fe12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:29:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:29:14Z,use_quota=True,user_id='c9a15206cb504c7bafaefa02ba291bd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:29:14 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-30f9e374-01ba-4e61-898b-5233233d1c78 tempest-VolumesActionsTest-120108262 None] Creating volume 0494a060-00f4-4c10-b96b-c6a91bb3266c {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:29:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-30f9e374-01ba-4e61-898b-5233233d1c78 tempest-VolumesActionsTest-120108262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:29:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-30f9e374-01ba-4e61-898b-5233233d1c78 tempest-VolumesActionsTest-120108262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:29:14 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-30f9e374-01ba-4e61-898b-5233233d1c78 tempest-VolumesActionsTest-120108262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:29:14 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-30f9e374-01ba-4e61-898b-5233233d1c78 tempest-VolumesActionsTest-120108262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:29:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-30f9e374-01ba-4e61-898b-5233233d1c78 tempest-VolumesActionsTest-120108262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:29:14 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-30f9e374-01ba-4e61-898b-5233233d1c78 tempest-VolumesActionsTest-120108262 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:29:14 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-30f9e374-01ba-4e61-898b-5233233d1c78 tempest-VolumesActionsTest-120108262 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:29:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-30f9e374-01ba-4e61-898b-5233233d1c78 tempest-VolumesActionsTest-120108262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0494a060-00f4-4c10-b96b-c6a91bb3266c 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:29:14 devstack sudo[101167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0494a060-00f4-4c10-b96b-c6a91bb3266c 1073741824 Sep 15 16:29:14 devstack sudo[101167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:29:14 devstack cinder-volume[86082]: INFO cinder.volume.manager [req-348bf721-9246-41d7-9a4b-14211521a585 req-5d1e9945-3917-4ba5-a775-aba1a81f7938 tempest-TestServerVolumeAttachmentScenario-1564993328 None] Terminate volume connection completed successfully. Sep 15 16:29:14 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-348bf721-9246-41d7-9a4b-14211521a585 req-5d1e9945-3917-4ba5-a775-aba1a81f7938 tempest-TestServerVolumeAttachmentScenario-1564993328 None] Deleting attachment f17ce68f-1bb6-40e2-93dc-3f7629210bd9. {{(pid=86082) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 15 16:29:14 devstack sudo[101167]: pam_unix(sudo:session): session closed for user root Sep 15 16:29:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-30f9e374-01ba-4e61-898b-5233233d1c78 tempest-VolumesActionsTest-120108262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0494a060-00f4-4c10-b96b-c6a91bb3266c 1073741824" returned: 0 in 0.470s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:29:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-30f9e374-01ba-4e61-898b-5233233d1c78 tempest-VolumesActionsTest-120108262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0494a060-00f4-4c10-b96b-c6a91bb3266c {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:29:15 devstack sudo[101174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0494a060-00f4-4c10-b96b-c6a91bb3266c Sep 15 16:29:15 devstack sudo[101174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:29:15 devstack sudo[101174]: pam_unix(sudo:session): session closed for user root Sep 15 16:29:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-30f9e374-01ba-4e61-898b-5233233d1c78 tempest-VolumesActionsTest-120108262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0494a060-00f4-4c10-b96b-c6a91bb3266c" returned: 0 in 0.232s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:29:15 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-30f9e374-01ba-4e61-898b-5233233d1c78 tempest-VolumesActionsTest-120108262 None] <== create_volume: return (754ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:29:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-30f9e374-01ba-4e61-898b-5233233d1c78 tempest-VolumesActionsTest-120108262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.757s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:29:15 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-30f9e374-01ba-4e61-898b-5233233d1c78 tempest-VolumesActionsTest-120108262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9726b0eb-bab8-4af3-aede-4acb625fe72c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0494a060-00f4-4c10-b96b-c6a91bb3266c', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:29:15 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-30f9e374-01ba-4e61-898b-5233233d1c78 tempest-VolumesActionsTest-120108262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd2762fe-68a8-4283-a102-fe479a6671b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:29:15 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-30f9e374-01ba-4e61-898b-5233233d1c78 tempest-VolumesActionsTest-120108262 None] Volume volume-0494a060-00f4-4c10-b96b-c6a91bb3266c (0494a060-00f4-4c10-b96b-c6a91bb3266c): created successfully Sep 15 16:29:15 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-30f9e374-01ba-4e61-898b-5233233d1c78 tempest-VolumesActionsTest-120108262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd2762fe-68a8-4283-a102-fe479a6671b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:29:15 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-30f9e374-01ba-4e61-898b-5233233d1c78 tempest-VolumesActionsTest-120108262 None] Flow 'volume_create_manager' (04fedef2-19e5-4cc2-881a-a4c9cda54553) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:29:15 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-30f9e374-01ba-4e61-898b-5233233d1c78 tempest-VolumesActionsTest-120108262 None] Created volume successfully. Sep 15 16:29:15 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-eebfdd67-07aa-46f3-856a-dac52056502a tempest-VolumesActionsTest-909266678 None] Acquiring lock "cinder-0494a060-00f4-4c10-b96b-c6a91bb3266c-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:29:15 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-eebfdd67-07aa-46f3-856a-dac52056502a tempest-VolumesActionsTest-909266678 None] Lock "cinder-0494a060-00f4-4c10-b96b-c6a91bb3266c-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:29:15 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-eebfdd67-07aa-46f3-856a-dac52056502a tempest-VolumesActionsTest-909266678 None] Acquiring lock "cinder-quobyte-0494a060-00f4-4c10-b96b-c6a91bb3266c" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:29:15 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-eebfdd67-07aa-46f3-856a-dac52056502a tempest-VolumesActionsTest-909266678 None] Lock "cinder-quobyte-0494a060-00f4-4c10-b96b-c6a91bb3266c" acquired by "delete_volume" :: waited 0.020s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:29:15 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb02db48-75df-4d47-a707-0d21a95cd81d]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:29:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-eebfdd67-07aa-46f3-856a-dac52056502a tempest-VolumesActionsTest-909266678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0494a060-00f4-4c10-b96b-c6a91bb3266c {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:29:15 devstack sudo[101191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0494a060-00f4-4c10-b96b-c6a91bb3266c Sep 15 16:29:15 devstack sudo[101191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:29:16 devstack sudo[101191]: pam_unix(sudo:session): session closed for user root Sep 15 16:29:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-eebfdd67-07aa-46f3-856a-dac52056502a tempest-VolumesActionsTest-909266678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0494a060-00f4-4c10-b96b-c6a91bb3266c" returned: 0 in 0.399s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:29:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-eebfdd67-07aa-46f3-856a-dac52056502a tempest-VolumesActionsTest-909266678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0494a060-00f4-4c10-b96b-c6a91bb3266c {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:29:16 devstack sudo[101219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0494a060-00f4-4c10-b96b-c6a91bb3266c Sep 15 16:29:16 devstack sudo[101219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:29:16 devstack sudo[101219]: pam_unix(sudo:session): session closed for user root Sep 15 16:29:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-eebfdd67-07aa-46f3-856a-dac52056502a tempest-VolumesActionsTest-909266678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0494a060-00f4-4c10-b96b-c6a91bb3266c" returned: 0 in 0.254s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:29:16 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-eebfdd67-07aa-46f3-856a-dac52056502a tempest-VolumesActionsTest-909266678 None] Lock "cinder-quobyte-0494a060-00f4-4c10-b96b-c6a91bb3266c" released by "delete_volume" :: held 0.701s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:29:16 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-eebfdd67-07aa-46f3-856a-dac52056502a tempest-VolumesActionsTest-909266678 None] Created reservations ['b7ea4454-b44b-45da-8ea6-b3024eaf77f7', '748e6ceb-ce2f-40ca-8639-e52499eeb233', 'f9d06267-8bd0-4063-8ee5-8ff2d1576eaf', 'b2afc266-59ab-4d35-b125-cd2a9428672b'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:29:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-eebfdd67-07aa-46f3-856a-dac52056502a tempest-VolumesActionsTest-909266678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:29:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-eebfdd67-07aa-46f3-856a-dac52056502a tempest-VolumesActionsTest-909266678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:29:16 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-eebfdd67-07aa-46f3-856a-dac52056502a tempest-VolumesActionsTest-909266678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:29:16 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-eebfdd67-07aa-46f3-856a-dac52056502a tempest-VolumesActionsTest-909266678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:29:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-eebfdd67-07aa-46f3-856a-dac52056502a tempest-VolumesActionsTest-909266678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:29:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-eebfdd67-07aa-46f3-856a-dac52056502a tempest-VolumesActionsTest-909266678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:29:16 devstack cinder-volume[86082]: INFO cinder.volume.manager [req-f063076c-9deb-4785-b3ee-e4bcbe5bcdf0 req-dd21098b-412f-4c61-acf0-3930909fcc5e tempest-TestServerVolumeAttachmentScenario-1564993328 None] Terminate volume connection completed successfully. Sep 15 16:29:16 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-f063076c-9deb-4785-b3ee-e4bcbe5bcdf0 req-dd21098b-412f-4c61-acf0-3930909fcc5e tempest-TestServerVolumeAttachmentScenario-1564993328 None] Deleting attachment 84b39a2a-6501-4a28-9a0b-90aa0db0ed83. {{(pid=86082) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 15 16:29:16 devstack sudo[101249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:29:16 devstack sudo[101249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:29:16 devstack sudo[101249]: pam_unix(sudo:session): session closed for user root Sep 15 16:29:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-eebfdd67-07aa-46f3-856a-dac52056502a tempest-VolumesActionsTest-909266678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.272s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:29:16 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-eebfdd67-07aa-46f3-856a-dac52056502a tempest-VolumesActionsTest-909266678 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:29:16 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-eebfdd67-07aa-46f3-856a-dac52056502a tempest-VolumesActionsTest-909266678 None] Deleted volume successfully. Sep 15 16:29:16 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-eebfdd67-07aa-46f3-856a-dac52056502a tempest-VolumesActionsTest-909266678 None] Lock "cinder-0494a060-00f4-4c10-b96b-c6a91bb3266c-delete_volume" released by "delete_volume" :: held 1.199s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:29:17 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-c77218f8-81ea-4a55-9976-8d80ff3c3d8b tempest-VolumesActionsTest-120108262 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:29:17 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c77218f8-81ea-4a55-9976-8d80ff3c3d8b tempest-VolumesActionsTest-120108262 None] Flow 'volume_create_manager' (6073e483-589c-4053-a756-34c3d20a5c9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:29:17 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c77218f8-81ea-4a55-9976-8d80ff3c3d8b tempest-VolumesActionsTest-120108262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e12e0649-8543-4a8c-a7a1-4bb0b6997b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:29:17 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c77218f8-81ea-4a55-9976-8d80ff3c3d8b tempest-VolumesActionsTest-120108262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e12e0649-8543-4a8c-a7a1-4bb0b6997b1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:29:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1942111464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e73a949-4fa2-4379-a9bf-d8c752b217ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf724d027de944b68cf4f9140c05fe12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:29:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:29:17Z,use_quota=True,user_id='c9a15206cb504c7bafaefa02ba291bd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:29:17 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c77218f8-81ea-4a55-9976-8d80ff3c3d8b tempest-VolumesActionsTest-120108262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c3459c2-8e7b-4c37-9793-0c6361514b68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:29:17 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c77218f8-81ea-4a55-9976-8d80ff3c3d8b tempest-VolumesActionsTest-120108262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c3459c2-8e7b-4c37-9793-0c6361514b68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:29:17 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c77218f8-81ea-4a55-9976-8d80ff3c3d8b tempest-VolumesActionsTest-120108262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5406a48b-b34c-486c-bc01-e7c2a8535ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:29:17 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c77218f8-81ea-4a55-9976-8d80ff3c3d8b tempest-VolumesActionsTest-120108262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5406a48b-b34c-486c-bc01-e7c2a8535ffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e73a949-4fa2-4379-a9bf-d8c752b217ff', 'volume_name': 'volume-4e73a949-4fa2-4379-a9bf-d8c752b217ff', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:29:17 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c77218f8-81ea-4a55-9976-8d80ff3c3d8b tempest-VolumesActionsTest-120108262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c753f6ad-1a00-45eb-ba4f-cd8df6f08b2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:29:17 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c77218f8-81ea-4a55-9976-8d80ff3c3d8b tempest-VolumesActionsTest-120108262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c753f6ad-1a00-45eb-ba4f-cd8df6f08b2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:29:17 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c77218f8-81ea-4a55-9976-8d80ff3c3d8b tempest-VolumesActionsTest-120108262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d23869b-841a-4708-8183-b5af73dd3c7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:29:17 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-c77218f8-81ea-4a55-9976-8d80ff3c3d8b tempest-VolumesActionsTest-120108262 None] Volume 4e73a949-4fa2-4379-a9bf-d8c752b217ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e73a949-4fa2-4379-a9bf-d8c752b217ff', 'volume_size': 1} Sep 15 16:29:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c77218f8-81ea-4a55-9976-8d80ff3c3d8b tempest-VolumesActionsTest-120108262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:29:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c77218f8-81ea-4a55-9976-8d80ff3c3d8b tempest-VolumesActionsTest-120108262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:29:17 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c77218f8-81ea-4a55-9976-8d80ff3c3d8b tempest-VolumesActionsTest-120108262 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:29:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1942111464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e73a949-4fa2-4379-a9bf-d8c752b217ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf724d027de944b68cf4f9140c05fe12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:29:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:29:17Z,use_quota=True,user_id='c9a15206cb504c7bafaefa02ba291bd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:29:17 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-c77218f8-81ea-4a55-9976-8d80ff3c3d8b tempest-VolumesActionsTest-120108262 None] Creating volume 4e73a949-4fa2-4379-a9bf-d8c752b217ff {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:29:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c77218f8-81ea-4a55-9976-8d80ff3c3d8b tempest-VolumesActionsTest-120108262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:29:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c77218f8-81ea-4a55-9976-8d80ff3c3d8b tempest-VolumesActionsTest-120108262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:29:17 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c77218f8-81ea-4a55-9976-8d80ff3c3d8b tempest-VolumesActionsTest-120108262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:29:17 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c77218f8-81ea-4a55-9976-8d80ff3c3d8b tempest-VolumesActionsTest-120108262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:29:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c77218f8-81ea-4a55-9976-8d80ff3c3d8b tempest-VolumesActionsTest-120108262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:29:17 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c77218f8-81ea-4a55-9976-8d80ff3c3d8b tempest-VolumesActionsTest-120108262 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:29:17 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-c77218f8-81ea-4a55-9976-8d80ff3c3d8b tempest-VolumesActionsTest-120108262 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:29:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c77218f8-81ea-4a55-9976-8d80ff3c3d8b tempest-VolumesActionsTest-120108262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-4e73a949-4fa2-4379-a9bf-d8c752b217ff 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:29:17 devstack sudo[101253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-4e73a949-4fa2-4379-a9bf-d8c752b217ff 1073741824 Sep 15 16:29:17 devstack sudo[101253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:29:17 devstack sudo[101253]: pam_unix(sudo:session): session closed for user root Sep 15 16:29:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c77218f8-81ea-4a55-9976-8d80ff3c3d8b tempest-VolumesActionsTest-120108262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-4e73a949-4fa2-4379-a9bf-d8c752b217ff 1073741824" returned: 0 in 0.500s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:29:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c77218f8-81ea-4a55-9976-8d80ff3c3d8b tempest-VolumesActionsTest-120108262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-4e73a949-4fa2-4379-a9bf-d8c752b217ff {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:29:17 devstack sudo[101271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-4e73a949-4fa2-4379-a9bf-d8c752b217ff Sep 15 16:29:17 devstack sudo[101271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:29:18 devstack sudo[101271]: pam_unix(sudo:session): session closed for user root Sep 15 16:29:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c77218f8-81ea-4a55-9976-8d80ff3c3d8b tempest-VolumesActionsTest-120108262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-4e73a949-4fa2-4379-a9bf-d8c752b217ff" returned: 0 in 0.332s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:29:18 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c77218f8-81ea-4a55-9976-8d80ff3c3d8b tempest-VolumesActionsTest-120108262 None] <== create_volume: return (933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:29:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c77218f8-81ea-4a55-9976-8d80ff3c3d8b tempest-VolumesActionsTest-120108262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.935s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:29:18 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c77218f8-81ea-4a55-9976-8d80ff3c3d8b tempest-VolumesActionsTest-120108262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d23869b-841a-4708-8183-b5af73dd3c7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e73a949-4fa2-4379-a9bf-d8c752b217ff', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:29:18 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c77218f8-81ea-4a55-9976-8d80ff3c3d8b tempest-VolumesActionsTest-120108262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab06ea5d-181f-458b-9a96-5a0c6372e5a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:29:18 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-c77218f8-81ea-4a55-9976-8d80ff3c3d8b tempest-VolumesActionsTest-120108262 None] Volume volume-4e73a949-4fa2-4379-a9bf-d8c752b217ff (4e73a949-4fa2-4379-a9bf-d8c752b217ff): created successfully Sep 15 16:29:18 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c77218f8-81ea-4a55-9976-8d80ff3c3d8b tempest-VolumesActionsTest-120108262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab06ea5d-181f-458b-9a96-5a0c6372e5a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:29:18 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c77218f8-81ea-4a55-9976-8d80ff3c3d8b tempest-VolumesActionsTest-120108262 None] Flow 'volume_create_manager' (6073e483-589c-4053-a756-34c3d20a5c9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:29:18 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-c77218f8-81ea-4a55-9976-8d80ff3c3d8b tempest-VolumesActionsTest-120108262 None] Created volume successfully. Sep 15 16:29:19 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-94be4820-7022-4f71-817b-8ee895224cc3 tempest-VolumesActionsTest-909266678 None] Acquiring lock "cinder-4e73a949-4fa2-4379-a9bf-d8c752b217ff-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:29:19 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-94be4820-7022-4f71-817b-8ee895224cc3 tempest-VolumesActionsTest-909266678 None] Lock "cinder-4e73a949-4fa2-4379-a9bf-d8c752b217ff-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:29:19 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-94be4820-7022-4f71-817b-8ee895224cc3 tempest-VolumesActionsTest-909266678 None] Acquiring lock "cinder-quobyte-4e73a949-4fa2-4379-a9bf-d8c752b217ff" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:29:19 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-94be4820-7022-4f71-817b-8ee895224cc3 tempest-VolumesActionsTest-909266678 None] Lock "cinder-quobyte-4e73a949-4fa2-4379-a9bf-d8c752b217ff" acquired by "delete_volume" :: waited 0.016s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:29:19 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1f0970e-ee62-43ac-9873-1b291840443b]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:29:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-94be4820-7022-4f71-817b-8ee895224cc3 tempest-VolumesActionsTest-909266678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-4e73a949-4fa2-4379-a9bf-d8c752b217ff {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:29:19 devstack sudo[101285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-4e73a949-4fa2-4379-a9bf-d8c752b217ff Sep 15 16:29:19 devstack sudo[101285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:29:19 devstack sudo[101285]: pam_unix(sudo:session): session closed for user root Sep 15 16:29:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-94be4820-7022-4f71-817b-8ee895224cc3 tempest-VolumesActionsTest-909266678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-4e73a949-4fa2-4379-a9bf-d8c752b217ff" returned: 0 in 0.359s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:29:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-94be4820-7022-4f71-817b-8ee895224cc3 tempest-VolumesActionsTest-909266678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-4e73a949-4fa2-4379-a9bf-d8c752b217ff {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:29:19 devstack sudo[101290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-4e73a949-4fa2-4379-a9bf-d8c752b217ff Sep 15 16:29:19 devstack sudo[101290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:29:20 devstack sudo[101290]: pam_unix(sudo:session): session closed for user root Sep 15 16:29:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-94be4820-7022-4f71-817b-8ee895224cc3 tempest-VolumesActionsTest-909266678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-4e73a949-4fa2-4379-a9bf-d8c752b217ff" returned: 0 in 0.258s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:29:20 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-94be4820-7022-4f71-817b-8ee895224cc3 tempest-VolumesActionsTest-909266678 None] Lock "cinder-quobyte-4e73a949-4fa2-4379-a9bf-d8c752b217ff" released by "delete_volume" :: held 0.662s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:29:20 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-94be4820-7022-4f71-817b-8ee895224cc3 tempest-VolumesActionsTest-909266678 None] Created reservations ['ed83ba6e-6138-4e45-a537-3db0f28a5556', '023b0f51-8199-4376-acb7-0360cf5c3490', '32a53e1e-6926-467d-a48b-caceb12418a5', '4b860887-e2dd-4945-8fd4-6fff8b374cb1'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:29:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-94be4820-7022-4f71-817b-8ee895224cc3 tempest-VolumesActionsTest-909266678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:29:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-94be4820-7022-4f71-817b-8ee895224cc3 tempest-VolumesActionsTest-909266678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:29:20 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-94be4820-7022-4f71-817b-8ee895224cc3 tempest-VolumesActionsTest-909266678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:29:20 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-94be4820-7022-4f71-817b-8ee895224cc3 tempest-VolumesActionsTest-909266678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:29:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-94be4820-7022-4f71-817b-8ee895224cc3 tempest-VolumesActionsTest-909266678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:29:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-94be4820-7022-4f71-817b-8ee895224cc3 tempest-VolumesActionsTest-909266678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:29:20 devstack sudo[101293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:29:20 devstack sudo[101293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:29:20 devstack sudo[101293]: pam_unix(sudo:session): session closed for user root Sep 15 16:29:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-94be4820-7022-4f71-817b-8ee895224cc3 tempest-VolumesActionsTest-909266678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.265s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:29:20 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-94be4820-7022-4f71-817b-8ee895224cc3 tempest-VolumesActionsTest-909266678 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:29:20 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-94be4820-7022-4f71-817b-8ee895224cc3 tempest-VolumesActionsTest-909266678 None] Deleted volume successfully. Sep 15 16:29:20 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-94be4820-7022-4f71-817b-8ee895224cc3 tempest-VolumesActionsTest-909266678 None] Lock "cinder-4e73a949-4fa2-4379-a9bf-d8c752b217ff-delete_volume" released by "delete_volume" :: held 1.175s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:29:20 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-81f1c1c0-a569-41ba-b68c-199824b963f4 tempest-TestServerVolumeAttachmentScenario-1564993328 None] Acquiring lock "cinder-f1c51ebf-b0d2-4737-ac5c-e15b99e8db4b-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:29:20 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-81f1c1c0-a569-41ba-b68c-199824b963f4 tempest-TestServerVolumeAttachmentScenario-1564993328 None] Lock "cinder-f1c51ebf-b0d2-4737-ac5c-e15b99e8db4b-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:29:21 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-81f1c1c0-a569-41ba-b68c-199824b963f4 tempest-TestServerVolumeAttachmentScenario-1564993328 None] Acquiring lock "cinder-quobyte-f1c51ebf-b0d2-4737-ac5c-e15b99e8db4b" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:29:21 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-81f1c1c0-a569-41ba-b68c-199824b963f4 tempest-TestServerVolumeAttachmentScenario-1564993328 None] Lock "cinder-quobyte-f1c51ebf-b0d2-4737-ac5c-e15b99e8db4b" acquired by "delete_volume" :: waited 0.024s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:29:21 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[35dc9e16-ea62-4014-a35c-45a8e71668b5]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:29:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-81f1c1c0-a569-41ba-b68c-199824b963f4 tempest-TestServerVolumeAttachmentScenario-1564993328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-f1c51ebf-b0d2-4737-ac5c-e15b99e8db4b {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:29:21 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-212a50f1-722e-4756-b8dc-915ee19a73c6 tempest-VolumesActionsTest-120108262 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:29:21 devstack sudo[101296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-f1c51ebf-b0d2-4737-ac5c-e15b99e8db4b Sep 15 16:29:21 devstack sudo[101296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:29:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-212a50f1-722e-4756-b8dc-915ee19a73c6 tempest-VolumesActionsTest-120108262 None] Flow 'volume_create_manager' (93f6add4-a187-41f0-a387-af243f6a5800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:29:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-212a50f1-722e-4756-b8dc-915ee19a73c6 tempest-VolumesActionsTest-120108262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97997257-dac7-495d-b409-911a8fe3e39d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:29:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-212a50f1-722e-4756-b8dc-915ee19a73c6 tempest-VolumesActionsTest-120108262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97997257-dac7-495d-b409-911a8fe3e39d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:29:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1314151033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9f36745-7a96-4aa2-a86c-20ab318ac3aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf724d027de944b68cf4f9140c05fe12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:29:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:29:21Z,use_quota=True,user_id='c9a15206cb504c7bafaefa02ba291bd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:29:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-212a50f1-722e-4756-b8dc-915ee19a73c6 tempest-VolumesActionsTest-120108262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad205597-1d18-4615-960c-ebec77948f4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:29:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-212a50f1-722e-4756-b8dc-915ee19a73c6 tempest-VolumesActionsTest-120108262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ad205597-1d18-4615-960c-ebec77948f4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:29:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-212a50f1-722e-4756-b8dc-915ee19a73c6 tempest-VolumesActionsTest-120108262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1880a1f6-121e-44c3-a1cc-7219b9a1509a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:29:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-212a50f1-722e-4756-b8dc-915ee19a73c6 tempest-VolumesActionsTest-120108262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1880a1f6-121e-44c3-a1cc-7219b9a1509a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9f36745-7a96-4aa2-a86c-20ab318ac3aa', 'volume_name': 'volume-a9f36745-7a96-4aa2-a86c-20ab318ac3aa', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:29:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-212a50f1-722e-4756-b8dc-915ee19a73c6 tempest-VolumesActionsTest-120108262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6a83fce-26be-4a3b-8d23-dbeb6ced2b0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:29:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-212a50f1-722e-4756-b8dc-915ee19a73c6 tempest-VolumesActionsTest-120108262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6a83fce-26be-4a3b-8d23-dbeb6ced2b0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:29:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-212a50f1-722e-4756-b8dc-915ee19a73c6 tempest-VolumesActionsTest-120108262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c201ef4-25ef-4dfd-9368-f0314f5acbb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:29:21 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-212a50f1-722e-4756-b8dc-915ee19a73c6 tempest-VolumesActionsTest-120108262 None] Volume a9f36745-7a96-4aa2-a86c-20ab318ac3aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9f36745-7a96-4aa2-a86c-20ab318ac3aa', 'volume_size': 1} Sep 15 16:29:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-212a50f1-722e-4756-b8dc-915ee19a73c6 tempest-VolumesActionsTest-120108262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:29:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-212a50f1-722e-4756-b8dc-915ee19a73c6 tempest-VolumesActionsTest-120108262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:29:21 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-212a50f1-722e-4756-b8dc-915ee19a73c6 tempest-VolumesActionsTest-120108262 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:29:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1314151033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9f36745-7a96-4aa2-a86c-20ab318ac3aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf724d027de944b68cf4f9140c05fe12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:29:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:29:21Z,use_quota=True,user_id='c9a15206cb504c7bafaefa02ba291bd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:29:21 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-212a50f1-722e-4756-b8dc-915ee19a73c6 tempest-VolumesActionsTest-120108262 None] Creating volume a9f36745-7a96-4aa2-a86c-20ab318ac3aa {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:29:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-212a50f1-722e-4756-b8dc-915ee19a73c6 tempest-VolumesActionsTest-120108262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:29:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-212a50f1-722e-4756-b8dc-915ee19a73c6 tempest-VolumesActionsTest-120108262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:29:21 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-212a50f1-722e-4756-b8dc-915ee19a73c6 tempest-VolumesActionsTest-120108262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:29:21 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-212a50f1-722e-4756-b8dc-915ee19a73c6 tempest-VolumesActionsTest-120108262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:29:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-212a50f1-722e-4756-b8dc-915ee19a73c6 tempest-VolumesActionsTest-120108262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:29:21 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-212a50f1-722e-4756-b8dc-915ee19a73c6 tempest-VolumesActionsTest-120108262 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:29:21 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-212a50f1-722e-4756-b8dc-915ee19a73c6 tempest-VolumesActionsTest-120108262 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:29:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-212a50f1-722e-4756-b8dc-915ee19a73c6 tempest-VolumesActionsTest-120108262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a9f36745-7a96-4aa2-a86c-20ab318ac3aa 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:29:21 devstack sudo[101298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a9f36745-7a96-4aa2-a86c-20ab318ac3aa 1073741824 Sep 15 16:29:21 devstack sudo[101298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:29:21 devstack sudo[101296]: pam_unix(sudo:session): session closed for user root Sep 15 16:29:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-81f1c1c0-a569-41ba-b68c-199824b963f4 tempest-TestServerVolumeAttachmentScenario-1564993328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-f1c51ebf-b0d2-4737-ac5c-e15b99e8db4b" returned: 0 in 0.373s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:29:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-81f1c1c0-a569-41ba-b68c-199824b963f4 tempest-TestServerVolumeAttachmentScenario-1564993328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-f1c51ebf-b0d2-4737-ac5c-e15b99e8db4b {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:29:21 devstack sudo[101303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-f1c51ebf-b0d2-4737-ac5c-e15b99e8db4b Sep 15 16:29:21 devstack sudo[101303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:29:21 devstack sudo[101298]: pam_unix(sudo:session): session closed for user root Sep 15 16:29:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-212a50f1-722e-4756-b8dc-915ee19a73c6 tempest-VolumesActionsTest-120108262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a9f36745-7a96-4aa2-a86c-20ab318ac3aa 1073741824" returned: 0 in 0.460s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:29:21 devstack sudo[101303]: pam_unix(sudo:session): session closed for user root Sep 15 16:29:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-81f1c1c0-a569-41ba-b68c-199824b963f4 tempest-TestServerVolumeAttachmentScenario-1564993328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-f1c51ebf-b0d2-4737-ac5c-e15b99e8db4b" returned: 0 in 0.296s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:29:21 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-81f1c1c0-a569-41ba-b68c-199824b963f4 tempest-TestServerVolumeAttachmentScenario-1564993328 None] Lock "cinder-quobyte-f1c51ebf-b0d2-4737-ac5c-e15b99e8db4b" released by "delete_volume" :: held 0.714s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:29:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-212a50f1-722e-4756-b8dc-915ee19a73c6 tempest-VolumesActionsTest-120108262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a9f36745-7a96-4aa2-a86c-20ab318ac3aa {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:29:21 devstack sudo[101309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a9f36745-7a96-4aa2-a86c-20ab318ac3aa Sep 15 16:29:21 devstack sudo[101309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:29:21 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-81f1c1c0-a569-41ba-b68c-199824b963f4 tempest-TestServerVolumeAttachmentScenario-1564993328 None] Created reservations ['8143e2bc-a428-474c-96fa-40c010b8c8ed', 'e15141ad-d4c3-4d2c-933a-8b003ffce000', '895b02fb-c205-4bd7-a8a9-1c9a5dd12839', '29da8663-cab9-4098-976d-ae54e1b46e06'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:29:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-81f1c1c0-a569-41ba-b68c-199824b963f4 tempest-TestServerVolumeAttachmentScenario-1564993328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:29:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-81f1c1c0-a569-41ba-b68c-199824b963f4 tempest-TestServerVolumeAttachmentScenario-1564993328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:29:21 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-81f1c1c0-a569-41ba-b68c-199824b963f4 tempest-TestServerVolumeAttachmentScenario-1564993328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:29:21 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-81f1c1c0-a569-41ba-b68c-199824b963f4 tempest-TestServerVolumeAttachmentScenario-1564993328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:29:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-81f1c1c0-a569-41ba-b68c-199824b963f4 tempest-TestServerVolumeAttachmentScenario-1564993328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:29:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-81f1c1c0-a569-41ba-b68c-199824b963f4 tempest-TestServerVolumeAttachmentScenario-1564993328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:29:21 devstack sudo[101311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:29:21 devstack sudo[101311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:29:22 devstack sudo[101309]: pam_unix(sudo:session): session closed for user root Sep 15 16:29:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-212a50f1-722e-4756-b8dc-915ee19a73c6 tempest-VolumesActionsTest-120108262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a9f36745-7a96-4aa2-a86c-20ab318ac3aa" returned: 0 in 0.256s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:29:22 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-212a50f1-722e-4756-b8dc-915ee19a73c6 tempest-VolumesActionsTest-120108262 None] <== create_volume: return (773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:29:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-212a50f1-722e-4756-b8dc-915ee19a73c6 tempest-VolumesActionsTest-120108262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.775s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:29:22 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-212a50f1-722e-4756-b8dc-915ee19a73c6 tempest-VolumesActionsTest-120108262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c201ef4-25ef-4dfd-9368-f0314f5acbb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9f36745-7a96-4aa2-a86c-20ab318ac3aa', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:29:22 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-212a50f1-722e-4756-b8dc-915ee19a73c6 tempest-VolumesActionsTest-120108262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e06b1f9-c4bf-4627-85f2-9a9319789a83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:29:22 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-212a50f1-722e-4756-b8dc-915ee19a73c6 tempest-VolumesActionsTest-120108262 None] Volume volume-a9f36745-7a96-4aa2-a86c-20ab318ac3aa (a9f36745-7a96-4aa2-a86c-20ab318ac3aa): created successfully Sep 15 16:29:22 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-212a50f1-722e-4756-b8dc-915ee19a73c6 tempest-VolumesActionsTest-120108262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4e06b1f9-c4bf-4627-85f2-9a9319789a83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:29:22 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-212a50f1-722e-4756-b8dc-915ee19a73c6 tempest-VolumesActionsTest-120108262 None] Flow 'volume_create_manager' (93f6add4-a187-41f0-a387-af243f6a5800) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:29:22 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-212a50f1-722e-4756-b8dc-915ee19a73c6 tempest-VolumesActionsTest-120108262 None] Created volume successfully. Sep 15 16:29:22 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-19934174-995d-442e-b50a-a3db971b895b tempest-TestServerVolumeAttachmentScenario-1564993328 None] Acquiring lock "cinder-06f3fa68-94ee-4f9b-8a79-5dde93802350-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:29:22 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-19934174-995d-442e-b50a-a3db971b895b tempest-TestServerVolumeAttachmentScenario-1564993328 None] Lock "cinder-06f3fa68-94ee-4f9b-8a79-5dde93802350-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:29:22 devstack sudo[101311]: pam_unix(sudo:session): session closed for user root Sep 15 16:29:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-81f1c1c0-a569-41ba-b68c-199824b963f4 tempest-TestServerVolumeAttachmentScenario-1564993328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.282s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:29:22 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-81f1c1c0-a569-41ba-b68c-199824b963f4 tempest-TestServerVolumeAttachmentScenario-1564993328 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:29:22 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-81f1c1c0-a569-41ba-b68c-199824b963f4 tempest-TestServerVolumeAttachmentScenario-1564993328 None] Deleted volume successfully. Sep 15 16:29:22 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-81f1c1c0-a569-41ba-b68c-199824b963f4 tempest-TestServerVolumeAttachmentScenario-1564993328 None] Lock "cinder-f1c51ebf-b0d2-4737-ac5c-e15b99e8db4b-delete_volume" released by "delete_volume" :: held 1.236s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:29:22 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-19934174-995d-442e-b50a-a3db971b895b tempest-TestServerVolumeAttachmentScenario-1564993328 None] Acquiring lock "cinder-quobyte-06f3fa68-94ee-4f9b-8a79-5dde93802350" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:29:22 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-19934174-995d-442e-b50a-a3db971b895b tempest-TestServerVolumeAttachmentScenario-1564993328 None] Lock "cinder-quobyte-06f3fa68-94ee-4f9b-8a79-5dde93802350" acquired by "delete_volume" :: waited 0.016s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:29:22 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[f13682c9-1b1d-4b8a-80ab-fe2c03011e08]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:29:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-19934174-995d-442e-b50a-a3db971b895b tempest-TestServerVolumeAttachmentScenario-1564993328 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-06f3fa68-94ee-4f9b-8a79-5dde93802350 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:29:22 devstack sudo[101315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-06f3fa68-94ee-4f9b-8a79-5dde93802350 Sep 15 16:29:22 devstack sudo[101315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:29:22 devstack sudo[101315]: pam_unix(sudo:session): session closed for user root Sep 15 16:29:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-19934174-995d-442e-b50a-a3db971b895b tempest-TestServerVolumeAttachmentScenario-1564993328 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-06f3fa68-94ee-4f9b-8a79-5dde93802350" returned: 0 in 0.364s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:29:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-19934174-995d-442e-b50a-a3db971b895b tempest-TestServerVolumeAttachmentScenario-1564993328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-06f3fa68-94ee-4f9b-8a79-5dde93802350 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:29:22 devstack sudo[101320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-06f3fa68-94ee-4f9b-8a79-5dde93802350 Sep 15 16:29:22 devstack sudo[101320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:29:22 devstack sudo[101320]: pam_unix(sudo:session): session closed for user root Sep 15 16:29:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-19934174-995d-442e-b50a-a3db971b895b tempest-TestServerVolumeAttachmentScenario-1564993328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-06f3fa68-94ee-4f9b-8a79-5dde93802350" returned: 0 in 0.244s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:29:22 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-19934174-995d-442e-b50a-a3db971b895b tempest-TestServerVolumeAttachmentScenario-1564993328 None] Lock "cinder-quobyte-06f3fa68-94ee-4f9b-8a79-5dde93802350" released by "delete_volume" :: held 0.652s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:29:22 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-19934174-995d-442e-b50a-a3db971b895b tempest-TestServerVolumeAttachmentScenario-1564993328 None] Created reservations ['76f08daa-7b1a-4422-a2d0-35e3fec1b4fa', '39fc90dd-925d-427d-be24-5693064b7a4c', '1d22db75-1e9d-4831-84c9-3f56a0435bca', '3459ea3a-e9ae-4969-9bb6-ca42d660ee5a'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:29:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-19934174-995d-442e-b50a-a3db971b895b tempest-TestServerVolumeAttachmentScenario-1564993328 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:29:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-19934174-995d-442e-b50a-a3db971b895b tempest-TestServerVolumeAttachmentScenario-1564993328 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:29:22 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-19934174-995d-442e-b50a-a3db971b895b tempest-TestServerVolumeAttachmentScenario-1564993328 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:29:23 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-19934174-995d-442e-b50a-a3db971b895b tempest-TestServerVolumeAttachmentScenario-1564993328 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:29:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-19934174-995d-442e-b50a-a3db971b895b tempest-TestServerVolumeAttachmentScenario-1564993328 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:29:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-19934174-995d-442e-b50a-a3db971b895b tempest-TestServerVolumeAttachmentScenario-1564993328 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:29:23 devstack sudo[101323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:29:23 devstack sudo[101323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:29:23 devstack sudo[101323]: pam_unix(sudo:session): session closed for user root Sep 15 16:29:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-19934174-995d-442e-b50a-a3db971b895b tempest-TestServerVolumeAttachmentScenario-1564993328 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.256s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:29:23 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-19934174-995d-442e-b50a-a3db971b895b tempest-TestServerVolumeAttachmentScenario-1564993328 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:29:23 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-19934174-995d-442e-b50a-a3db971b895b tempest-TestServerVolumeAttachmentScenario-1564993328 None] Deleted volume successfully. Sep 15 16:29:23 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-19934174-995d-442e-b50a-a3db971b895b tempest-TestServerVolumeAttachmentScenario-1564993328 None] Lock "cinder-06f3fa68-94ee-4f9b-8a79-5dde93802350-delete_volume" released by "delete_volume" :: held 1.126s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:29:23 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-36b6820e-d4a9-4b62-9dcb-47dda423e806 tempest-VolumesActionsTest-909266678 None] Acquiring lock "cinder-a9f36745-7a96-4aa2-a86c-20ab318ac3aa-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:29:23 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-36b6820e-d4a9-4b62-9dcb-47dda423e806 tempest-VolumesActionsTest-909266678 None] Lock "cinder-a9f36745-7a96-4aa2-a86c-20ab318ac3aa-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:29:23 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-36b6820e-d4a9-4b62-9dcb-47dda423e806 tempest-VolumesActionsTest-909266678 None] Acquiring lock "cinder-quobyte-a9f36745-7a96-4aa2-a86c-20ab318ac3aa" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:29:23 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-36b6820e-d4a9-4b62-9dcb-47dda423e806 tempest-VolumesActionsTest-909266678 None] Lock "cinder-quobyte-a9f36745-7a96-4aa2-a86c-20ab318ac3aa" acquired by "delete_volume" :: waited 0.018s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:29:23 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[171e502a-1c9c-4d7b-a2be-8d82746b69f2]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:29:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-36b6820e-d4a9-4b62-9dcb-47dda423e806 tempest-VolumesActionsTest-909266678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a9f36745-7a96-4aa2-a86c-20ab318ac3aa {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:29:23 devstack sudo[101326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a9f36745-7a96-4aa2-a86c-20ab318ac3aa Sep 15 16:29:23 devstack sudo[101326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:29:23 devstack sudo[101326]: pam_unix(sudo:session): session closed for user root Sep 15 16:29:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-36b6820e-d4a9-4b62-9dcb-47dda423e806 tempest-VolumesActionsTest-909266678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a9f36745-7a96-4aa2-a86c-20ab318ac3aa" returned: 0 in 0.374s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:29:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-36b6820e-d4a9-4b62-9dcb-47dda423e806 tempest-VolumesActionsTest-909266678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a9f36745-7a96-4aa2-a86c-20ab318ac3aa {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:29:23 devstack sudo[101331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a9f36745-7a96-4aa2-a86c-20ab318ac3aa Sep 15 16:29:23 devstack sudo[101331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:29:24 devstack sudo[101331]: pam_unix(sudo:session): session closed for user root Sep 15 16:29:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-36b6820e-d4a9-4b62-9dcb-47dda423e806 tempest-VolumesActionsTest-909266678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a9f36745-7a96-4aa2-a86c-20ab318ac3aa" returned: 0 in 0.277s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:29:24 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-36b6820e-d4a9-4b62-9dcb-47dda423e806 tempest-VolumesActionsTest-909266678 None] Lock "cinder-quobyte-a9f36745-7a96-4aa2-a86c-20ab318ac3aa" released by "delete_volume" :: held 0.701s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:29:24 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-36b6820e-d4a9-4b62-9dcb-47dda423e806 tempest-VolumesActionsTest-909266678 None] Created reservations ['6be30f26-3f9d-4a06-a1ff-d393d059de9f', '1b583e47-603b-4c13-a43a-936dda8b0188', '5ba516fc-4958-4864-8b5d-54ac247c612d', '603a08b6-f5f7-42c7-88b6-66bb2d6b76f4'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:29:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-36b6820e-d4a9-4b62-9dcb-47dda423e806 tempest-VolumesActionsTest-909266678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:29:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-36b6820e-d4a9-4b62-9dcb-47dda423e806 tempest-VolumesActionsTest-909266678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:29:24 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-36b6820e-d4a9-4b62-9dcb-47dda423e806 tempest-VolumesActionsTest-909266678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:29:24 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-36b6820e-d4a9-4b62-9dcb-47dda423e806 tempest-VolumesActionsTest-909266678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:29:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-36b6820e-d4a9-4b62-9dcb-47dda423e806 tempest-VolumesActionsTest-909266678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:29:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-36b6820e-d4a9-4b62-9dcb-47dda423e806 tempest-VolumesActionsTest-909266678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:29:24 devstack sudo[101334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:29:24 devstack sudo[101334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:29:24 devstack sudo[101334]: pam_unix(sudo:session): session closed for user root Sep 15 16:29:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-36b6820e-d4a9-4b62-9dcb-47dda423e806 tempest-VolumesActionsTest-909266678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.264s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:29:24 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-36b6820e-d4a9-4b62-9dcb-47dda423e806 tempest-VolumesActionsTest-909266678 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:29:24 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-36b6820e-d4a9-4b62-9dcb-47dda423e806 tempest-VolumesActionsTest-909266678 None] Deleted volume successfully. Sep 15 16:29:24 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-36b6820e-d4a9-4b62-9dcb-47dda423e806 tempest-VolumesActionsTest-909266678 None] Lock "cinder-a9f36745-7a96-4aa2-a86c-20ab318ac3aa-delete_volume" released by "delete_volume" :: held 1.193s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:29:25 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad5232e3-8e78-443d-8133-1301e24f1b32 tempest-VolumesActionsTest-120108262 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:29:25 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ad5232e3-8e78-443d-8133-1301e24f1b32 tempest-VolumesActionsTest-120108262 None] Flow 'volume_create_manager' (44fee462-c8fc-4d9d-8e97-b259d8c75353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:29:25 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ad5232e3-8e78-443d-8133-1301e24f1b32 tempest-VolumesActionsTest-120108262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdd9fe89-e2e2-4861-b4da-6781ac56245c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:29:25 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ad5232e3-8e78-443d-8133-1301e24f1b32 tempest-VolumesActionsTest-120108262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdd9fe89-e2e2-4861-b4da-6781ac56245c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:29:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1150187884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a91c4b0-5afe-4cfb-be47-6314f449740a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf724d027de944b68cf4f9140c05fe12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:29:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:29:25Z,use_quota=True,user_id='c9a15206cb504c7bafaefa02ba291bd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:29:25 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ad5232e3-8e78-443d-8133-1301e24f1b32 tempest-VolumesActionsTest-120108262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b97487ac-fc60-4e44-bcf1-66fa3abdcc52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:29:25 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ad5232e3-8e78-443d-8133-1301e24f1b32 tempest-VolumesActionsTest-120108262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b97487ac-fc60-4e44-bcf1-66fa3abdcc52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:29:25 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ad5232e3-8e78-443d-8133-1301e24f1b32 tempest-VolumesActionsTest-120108262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a44d2e70-1f7f-440a-93f9-31dcfcff3612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:29:25 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ad5232e3-8e78-443d-8133-1301e24f1b32 tempest-VolumesActionsTest-120108262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a44d2e70-1f7f-440a-93f9-31dcfcff3612) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1a91c4b0-5afe-4cfb-be47-6314f449740a', 'volume_name': 'volume-1a91c4b0-5afe-4cfb-be47-6314f449740a', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:29:25 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ad5232e3-8e78-443d-8133-1301e24f1b32 tempest-VolumesActionsTest-120108262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22849859-9c31-4ebb-9e40-39a5740bf5df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:29:25 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ad5232e3-8e78-443d-8133-1301e24f1b32 tempest-VolumesActionsTest-120108262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22849859-9c31-4ebb-9e40-39a5740bf5df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:29:25 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ad5232e3-8e78-443d-8133-1301e24f1b32 tempest-VolumesActionsTest-120108262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3920074e-c4f0-432f-940f-93e7c0246ea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:29:25 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-ad5232e3-8e78-443d-8133-1301e24f1b32 tempest-VolumesActionsTest-120108262 None] Volume 1a91c4b0-5afe-4cfb-be47-6314f449740a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1a91c4b0-5afe-4cfb-be47-6314f449740a', 'volume_size': 1} Sep 15 16:29:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-ad5232e3-8e78-443d-8133-1301e24f1b32 tempest-VolumesActionsTest-120108262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:29:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-ad5232e3-8e78-443d-8133-1301e24f1b32 tempest-VolumesActionsTest-120108262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:29:25 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-ad5232e3-8e78-443d-8133-1301e24f1b32 tempest-VolumesActionsTest-120108262 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:29:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1150187884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a91c4b0-5afe-4cfb-be47-6314f449740a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf724d027de944b68cf4f9140c05fe12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:29:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:29:25Z,use_quota=True,user_id='c9a15206cb504c7bafaefa02ba291bd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:29:25 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-ad5232e3-8e78-443d-8133-1301e24f1b32 tempest-VolumesActionsTest-120108262 None] Creating volume 1a91c4b0-5afe-4cfb-be47-6314f449740a {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:29:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-ad5232e3-8e78-443d-8133-1301e24f1b32 tempest-VolumesActionsTest-120108262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:29:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-ad5232e3-8e78-443d-8133-1301e24f1b32 tempest-VolumesActionsTest-120108262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:29:25 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-ad5232e3-8e78-443d-8133-1301e24f1b32 tempest-VolumesActionsTest-120108262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:29:25 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-ad5232e3-8e78-443d-8133-1301e24f1b32 tempest-VolumesActionsTest-120108262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:29:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-ad5232e3-8e78-443d-8133-1301e24f1b32 tempest-VolumesActionsTest-120108262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:29:25 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-ad5232e3-8e78-443d-8133-1301e24f1b32 tempest-VolumesActionsTest-120108262 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:29:25 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-ad5232e3-8e78-443d-8133-1301e24f1b32 tempest-VolumesActionsTest-120108262 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:29:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ad5232e3-8e78-443d-8133-1301e24f1b32 tempest-VolumesActionsTest-120108262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1a91c4b0-5afe-4cfb-be47-6314f449740a 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:29:25 devstack sudo[101338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1a91c4b0-5afe-4cfb-be47-6314f449740a 1073741824 Sep 15 16:29:25 devstack sudo[101338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:29:25 devstack sudo[101338]: pam_unix(sudo:session): session closed for user root Sep 15 16:29:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ad5232e3-8e78-443d-8133-1301e24f1b32 tempest-VolumesActionsTest-120108262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1a91c4b0-5afe-4cfb-be47-6314f449740a 1073741824" returned: 0 in 0.488s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:29:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ad5232e3-8e78-443d-8133-1301e24f1b32 tempest-VolumesActionsTest-120108262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1a91c4b0-5afe-4cfb-be47-6314f449740a {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:29:25 devstack sudo[101344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1a91c4b0-5afe-4cfb-be47-6314f449740a Sep 15 16:29:25 devstack sudo[101344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:29:26 devstack sudo[101344]: pam_unix(sudo:session): session closed for user root Sep 15 16:29:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ad5232e3-8e78-443d-8133-1301e24f1b32 tempest-VolumesActionsTest-120108262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1a91c4b0-5afe-4cfb-be47-6314f449740a" returned: 0 in 0.246s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:29:26 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-ad5232e3-8e78-443d-8133-1301e24f1b32 tempest-VolumesActionsTest-120108262 None] <== create_volume: return (783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:29:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-ad5232e3-8e78-443d-8133-1301e24f1b32 tempest-VolumesActionsTest-120108262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.785s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:29:26 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ad5232e3-8e78-443d-8133-1301e24f1b32 tempest-VolumesActionsTest-120108262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3920074e-c4f0-432f-940f-93e7c0246ea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a91c4b0-5afe-4cfb-be47-6314f449740a', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:29:26 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ad5232e3-8e78-443d-8133-1301e24f1b32 tempest-VolumesActionsTest-120108262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (699c64a1-07ab-4a66-97b7-52314ec3d4e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:29:26 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-ad5232e3-8e78-443d-8133-1301e24f1b32 tempest-VolumesActionsTest-120108262 None] Volume volume-1a91c4b0-5afe-4cfb-be47-6314f449740a (1a91c4b0-5afe-4cfb-be47-6314f449740a): created successfully Sep 15 16:29:26 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ad5232e3-8e78-443d-8133-1301e24f1b32 tempest-VolumesActionsTest-120108262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (699c64a1-07ab-4a66-97b7-52314ec3d4e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:29:26 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ad5232e3-8e78-443d-8133-1301e24f1b32 tempest-VolumesActionsTest-120108262 None] Flow 'volume_create_manager' (44fee462-c8fc-4d9d-8e97-b259d8c75353) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:29:26 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-ad5232e3-8e78-443d-8133-1301e24f1b32 tempest-VolumesActionsTest-120108262 None] Created volume successfully. Sep 15 16:29:26 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-a58a953d-14ec-47ba-99a1-5b47837f74a4 tempest-VolumesActionsTest-909266678 None] Acquiring lock "cinder-1a91c4b0-5afe-4cfb-be47-6314f449740a-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:29:26 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-a58a953d-14ec-47ba-99a1-5b47837f74a4 tempest-VolumesActionsTest-909266678 None] Lock "cinder-1a91c4b0-5afe-4cfb-be47-6314f449740a-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:29:26 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-a58a953d-14ec-47ba-99a1-5b47837f74a4 tempest-VolumesActionsTest-909266678 None] Acquiring lock "cinder-quobyte-1a91c4b0-5afe-4cfb-be47-6314f449740a" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:29:26 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-a58a953d-14ec-47ba-99a1-5b47837f74a4 tempest-VolumesActionsTest-909266678 None] Lock "cinder-quobyte-1a91c4b0-5afe-4cfb-be47-6314f449740a" acquired by "delete_volume" :: waited 0.013s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:29:26 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[b33a5cf2-ad65-4508-a30d-02c9e14251c7]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:29:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a58a953d-14ec-47ba-99a1-5b47837f74a4 tempest-VolumesActionsTest-909266678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1a91c4b0-5afe-4cfb-be47-6314f449740a {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:29:26 devstack sudo[101347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1a91c4b0-5afe-4cfb-be47-6314f449740a Sep 15 16:29:26 devstack sudo[101347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:29:26 devstack sudo[101347]: pam_unix(sudo:session): session closed for user root Sep 15 16:29:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a58a953d-14ec-47ba-99a1-5b47837f74a4 tempest-VolumesActionsTest-909266678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1a91c4b0-5afe-4cfb-be47-6314f449740a" returned: 0 in 0.408s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:29:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a58a953d-14ec-47ba-99a1-5b47837f74a4 tempest-VolumesActionsTest-909266678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1a91c4b0-5afe-4cfb-be47-6314f449740a {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:29:26 devstack sudo[101353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1a91c4b0-5afe-4cfb-be47-6314f449740a Sep 15 16:29:26 devstack sudo[101353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:29:27 devstack sudo[101353]: pam_unix(sudo:session): session closed for user root Sep 15 16:29:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a58a953d-14ec-47ba-99a1-5b47837f74a4 tempest-VolumesActionsTest-909266678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1a91c4b0-5afe-4cfb-be47-6314f449740a" returned: 0 in 0.265s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:29:27 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-a58a953d-14ec-47ba-99a1-5b47837f74a4 tempest-VolumesActionsTest-909266678 None] Lock "cinder-quobyte-1a91c4b0-5afe-4cfb-be47-6314f449740a" released by "delete_volume" :: held 0.732s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:29:27 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-a58a953d-14ec-47ba-99a1-5b47837f74a4 tempest-VolumesActionsTest-909266678 None] Created reservations ['2312565b-db90-4f30-8d8e-57d55004bc95', '9e1bf3f4-2f89-46d3-ab23-76e003cc347d', '805ef1cb-513e-4232-9724-6e10169065c8', 'b8fe6065-a444-4ac6-af3b-a4d8ae034315'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:29:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-a58a953d-14ec-47ba-99a1-5b47837f74a4 tempest-VolumesActionsTest-909266678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:29:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-a58a953d-14ec-47ba-99a1-5b47837f74a4 tempest-VolumesActionsTest-909266678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:29:27 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-a58a953d-14ec-47ba-99a1-5b47837f74a4 tempest-VolumesActionsTest-909266678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:29:27 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-a58a953d-14ec-47ba-99a1-5b47837f74a4 tempest-VolumesActionsTest-909266678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:29:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-a58a953d-14ec-47ba-99a1-5b47837f74a4 tempest-VolumesActionsTest-909266678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:29:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a58a953d-14ec-47ba-99a1-5b47837f74a4 tempest-VolumesActionsTest-909266678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:29:27 devstack sudo[101356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:29:27 devstack sudo[101356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:29:27 devstack sudo[101356]: pam_unix(sudo:session): session closed for user root Sep 15 16:29:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a58a953d-14ec-47ba-99a1-5b47837f74a4 tempest-VolumesActionsTest-909266678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.293s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:29:27 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-a58a953d-14ec-47ba-99a1-5b47837f74a4 tempest-VolumesActionsTest-909266678 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:29:27 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-a58a953d-14ec-47ba-99a1-5b47837f74a4 tempest-VolumesActionsTest-909266678 None] Deleted volume successfully. Sep 15 16:29:27 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-a58a953d-14ec-47ba-99a1-5b47837f74a4 tempest-VolumesActionsTest-909266678 None] Lock "cinder-1a91c4b0-5afe-4cfb-be47-6314f449740a-delete_volume" released by "delete_volume" :: held 1.242s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:29:28 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-53b0979b-45f6-4e01-8ffc-07b0e9144c10 tempest-VolumesActionsTest-120108262 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:29:28 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-53b0979b-45f6-4e01-8ffc-07b0e9144c10 tempest-VolumesActionsTest-120108262 None] Flow 'volume_create_manager' (6c1e2d39-4e63-417d-9f9e-291328dd637a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:29:28 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-53b0979b-45f6-4e01-8ffc-07b0e9144c10 tempest-VolumesActionsTest-120108262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59e0f4fc-7d90-445c-ba3c-4ddac5b74714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:29:28 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-53b0979b-45f6-4e01-8ffc-07b0e9144c10 tempest-VolumesActionsTest-120108262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (59e0f4fc-7d90-445c-ba3c-4ddac5b74714) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:29:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1532671745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edb964bb-43c6-454d-8861-93c5aa393a2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf724d027de944b68cf4f9140c05fe12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:29:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:29:28Z,use_quota=True,user_id='c9a15206cb504c7bafaefa02ba291bd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:29:28 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-53b0979b-45f6-4e01-8ffc-07b0e9144c10 tempest-VolumesActionsTest-120108262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66ef13b1-4fa3-4ecd-a76a-e94f7074b132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:29:28 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-53b0979b-45f6-4e01-8ffc-07b0e9144c10 tempest-VolumesActionsTest-120108262 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66ef13b1-4fa3-4ecd-a76a-e94f7074b132) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:29:28 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-53b0979b-45f6-4e01-8ffc-07b0e9144c10 tempest-VolumesActionsTest-120108262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a535ee2b-ce7c-4215-a496-00a9c12d0a99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:29:28 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-53b0979b-45f6-4e01-8ffc-07b0e9144c10 tempest-VolumesActionsTest-120108262 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a535ee2b-ce7c-4215-a496-00a9c12d0a99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'edb964bb-43c6-454d-8861-93c5aa393a2b', 'volume_name': 'volume-edb964bb-43c6-454d-8861-93c5aa393a2b', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:29:28 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-53b0979b-45f6-4e01-8ffc-07b0e9144c10 tempest-VolumesActionsTest-120108262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1bf8d35-96b3-4b0f-94c4-1652fc6f785b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:29:28 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-53b0979b-45f6-4e01-8ffc-07b0e9144c10 tempest-VolumesActionsTest-120108262 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1bf8d35-96b3-4b0f-94c4-1652fc6f785b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:29:28 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-53b0979b-45f6-4e01-8ffc-07b0e9144c10 tempest-VolumesActionsTest-120108262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f188998-463f-4649-8a92-c7047ebdf3ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:29:28 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-53b0979b-45f6-4e01-8ffc-07b0e9144c10 tempest-VolumesActionsTest-120108262 None] Volume edb964bb-43c6-454d-8861-93c5aa393a2b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-edb964bb-43c6-454d-8861-93c5aa393a2b', 'volume_size': 1} Sep 15 16:29:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-53b0979b-45f6-4e01-8ffc-07b0e9144c10 tempest-VolumesActionsTest-120108262 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:29:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-53b0979b-45f6-4e01-8ffc-07b0e9144c10 tempest-VolumesActionsTest-120108262 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:29:28 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-53b0979b-45f6-4e01-8ffc-07b0e9144c10 tempest-VolumesActionsTest-120108262 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:29:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1532671745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=edb964bb-43c6-454d-8861-93c5aa393a2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cf724d027de944b68cf4f9140c05fe12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:29:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:29:28Z,use_quota=True,user_id='c9a15206cb504c7bafaefa02ba291bd3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:29:28 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-53b0979b-45f6-4e01-8ffc-07b0e9144c10 tempest-VolumesActionsTest-120108262 None] Creating volume edb964bb-43c6-454d-8861-93c5aa393a2b {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:29:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-53b0979b-45f6-4e01-8ffc-07b0e9144c10 tempest-VolumesActionsTest-120108262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:29:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-53b0979b-45f6-4e01-8ffc-07b0e9144c10 tempest-VolumesActionsTest-120108262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:29:28 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-53b0979b-45f6-4e01-8ffc-07b0e9144c10 tempest-VolumesActionsTest-120108262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:29:28 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-53b0979b-45f6-4e01-8ffc-07b0e9144c10 tempest-VolumesActionsTest-120108262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:29:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-53b0979b-45f6-4e01-8ffc-07b0e9144c10 tempest-VolumesActionsTest-120108262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:29:28 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-53b0979b-45f6-4e01-8ffc-07b0e9144c10 tempest-VolumesActionsTest-120108262 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:29:28 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-53b0979b-45f6-4e01-8ffc-07b0e9144c10 tempest-VolumesActionsTest-120108262 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:29:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-53b0979b-45f6-4e01-8ffc-07b0e9144c10 tempest-VolumesActionsTest-120108262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-edb964bb-43c6-454d-8861-93c5aa393a2b 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:29:28 devstack sudo[101360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-edb964bb-43c6-454d-8861-93c5aa393a2b 1073741824 Sep 15 16:29:28 devstack sudo[101360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:29:28 devstack sudo[101360]: pam_unix(sudo:session): session closed for user root Sep 15 16:29:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-53b0979b-45f6-4e01-8ffc-07b0e9144c10 tempest-VolumesActionsTest-120108262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-edb964bb-43c6-454d-8861-93c5aa393a2b 1073741824" returned: 0 in 0.481s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:29:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-53b0979b-45f6-4e01-8ffc-07b0e9144c10 tempest-VolumesActionsTest-120108262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-edb964bb-43c6-454d-8861-93c5aa393a2b {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:29:28 devstack sudo[101366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-edb964bb-43c6-454d-8861-93c5aa393a2b Sep 15 16:29:28 devstack sudo[101366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:29:28 devstack sudo[101366]: pam_unix(sudo:session): session closed for user root Sep 15 16:29:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-53b0979b-45f6-4e01-8ffc-07b0e9144c10 tempest-VolumesActionsTest-120108262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-edb964bb-43c6-454d-8861-93c5aa393a2b" returned: 0 in 0.247s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:29:28 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-53b0979b-45f6-4e01-8ffc-07b0e9144c10 tempest-VolumesActionsTest-120108262 None] <== create_volume: return (773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:29:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-53b0979b-45f6-4e01-8ffc-07b0e9144c10 tempest-VolumesActionsTest-120108262 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.775s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:29:28 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-53b0979b-45f6-4e01-8ffc-07b0e9144c10 tempest-VolumesActionsTest-120108262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f188998-463f-4649-8a92-c7047ebdf3ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-edb964bb-43c6-454d-8861-93c5aa393a2b', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:29:28 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-53b0979b-45f6-4e01-8ffc-07b0e9144c10 tempest-VolumesActionsTest-120108262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9547d524-575e-459d-8610-2f198a948ef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:29:28 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-53b0979b-45f6-4e01-8ffc-07b0e9144c10 tempest-VolumesActionsTest-120108262 None] Volume volume-edb964bb-43c6-454d-8861-93c5aa393a2b (edb964bb-43c6-454d-8861-93c5aa393a2b): created successfully Sep 15 16:29:28 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-53b0979b-45f6-4e01-8ffc-07b0e9144c10 tempest-VolumesActionsTest-120108262 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9547d524-575e-459d-8610-2f198a948ef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:29:28 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-53b0979b-45f6-4e01-8ffc-07b0e9144c10 tempest-VolumesActionsTest-120108262 None] Flow 'volume_create_manager' (6c1e2d39-4e63-417d-9f9e-291328dd637a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:29:28 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-53b0979b-45f6-4e01-8ffc-07b0e9144c10 tempest-VolumesActionsTest-120108262 None] Created volume successfully. Sep 15 16:29:30 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-719f8a50-f564-4ea3-9a23-3047b8194db9 tempest-VolumesActionsTest-120108262 None] Acquiring lock "cinder-edb964bb-43c6-454d-8861-93c5aa393a2b-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:29:30 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-719f8a50-f564-4ea3-9a23-3047b8194db9 tempest-VolumesActionsTest-120108262 None] Lock "cinder-edb964bb-43c6-454d-8861-93c5aa393a2b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:29:30 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-719f8a50-f564-4ea3-9a23-3047b8194db9 tempest-VolumesActionsTest-120108262 None] Acquiring lock "cinder-quobyte-edb964bb-43c6-454d-8861-93c5aa393a2b" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:29:30 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-719f8a50-f564-4ea3-9a23-3047b8194db9 tempest-VolumesActionsTest-120108262 None] Lock "cinder-quobyte-edb964bb-43c6-454d-8861-93c5aa393a2b" acquired by "delete_volume" :: waited 0.015s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:29:30 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[51f96c20-130f-426c-a3de-8b6a523128f8]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:29:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-719f8a50-f564-4ea3-9a23-3047b8194db9 tempest-VolumesActionsTest-120108262 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-edb964bb-43c6-454d-8861-93c5aa393a2b {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:29:30 devstack sudo[101370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-edb964bb-43c6-454d-8861-93c5aa393a2b Sep 15 16:29:30 devstack sudo[101370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:29:31 devstack sudo[101370]: pam_unix(sudo:session): session closed for user root Sep 15 16:29:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-719f8a50-f564-4ea3-9a23-3047b8194db9 tempest-VolumesActionsTest-120108262 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-edb964bb-43c6-454d-8861-93c5aa393a2b" returned: 0 in 0.361s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:29:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-719f8a50-f564-4ea3-9a23-3047b8194db9 tempest-VolumesActionsTest-120108262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-edb964bb-43c6-454d-8861-93c5aa393a2b {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:29:31 devstack sudo[101375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-edb964bb-43c6-454d-8861-93c5aa393a2b Sep 15 16:29:31 devstack sudo[101375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:29:31 devstack sudo[101375]: pam_unix(sudo:session): session closed for user root Sep 15 16:29:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-719f8a50-f564-4ea3-9a23-3047b8194db9 tempest-VolumesActionsTest-120108262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-edb964bb-43c6-454d-8861-93c5aa393a2b" returned: 0 in 0.274s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:29:31 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-719f8a50-f564-4ea3-9a23-3047b8194db9 tempest-VolumesActionsTest-120108262 None] Lock "cinder-quobyte-edb964bb-43c6-454d-8861-93c5aa393a2b" released by "delete_volume" :: held 0.678s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:29:31 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-719f8a50-f564-4ea3-9a23-3047b8194db9 tempest-VolumesActionsTest-120108262 None] Created reservations ['2e64dced-0b56-4ee6-b16b-efbd5adbbe19', 'f1df7b3a-36cd-4836-8124-8a475ec227dd', 'b7abdf9b-bfc9-4fc2-83eb-2097bd310008', 'f9a33c71-ba9a-485d-b6b0-fbda1d81ee86'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:29:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-719f8a50-f564-4ea3-9a23-3047b8194db9 tempest-VolumesActionsTest-120108262 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:29:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-719f8a50-f564-4ea3-9a23-3047b8194db9 tempest-VolumesActionsTest-120108262 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:29:31 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-719f8a50-f564-4ea3-9a23-3047b8194db9 tempest-VolumesActionsTest-120108262 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:29:31 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-719f8a50-f564-4ea3-9a23-3047b8194db9 tempest-VolumesActionsTest-120108262 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:29:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-719f8a50-f564-4ea3-9a23-3047b8194db9 tempest-VolumesActionsTest-120108262 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:29:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-719f8a50-f564-4ea3-9a23-3047b8194db9 tempest-VolumesActionsTest-120108262 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:29:31 devstack sudo[101384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:29:31 devstack sudo[101384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:29:31 devstack sudo[101384]: pam_unix(sudo:session): session closed for user root Sep 15 16:29:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-719f8a50-f564-4ea3-9a23-3047b8194db9 tempest-VolumesActionsTest-120108262 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.300s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:29:31 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-719f8a50-f564-4ea3-9a23-3047b8194db9 tempest-VolumesActionsTest-120108262 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:29:31 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-719f8a50-f564-4ea3-9a23-3047b8194db9 tempest-VolumesActionsTest-120108262 None] Deleted volume successfully. Sep 15 16:29:32 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-719f8a50-f564-4ea3-9a23-3047b8194db9 tempest-VolumesActionsTest-120108262 None] Lock "cinder-edb964bb-43c6-454d-8861-93c5aa393a2b-delete_volume" released by "delete_volume" :: held 1.261s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:29:39 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-c67fb0c2-9462-43e0-a172-65257d1cf683 tempest-VolumeAndVolumeTypeFromImageTest-804377883 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:29:39 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c67fb0c2-9462-43e0-a172-65257d1cf683 tempest-VolumeAndVolumeTypeFromImageTest-804377883 None] Flow 'volume_create_manager' (eae8a97b-ac94-436f-aefe-d5e9f594ac94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:29:39 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c67fb0c2-9462-43e0-a172-65257d1cf683 tempest-VolumeAndVolumeTypeFromImageTest-804377883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de607c8d-5025-4abd-922b-dc8499edb473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:29:39 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c67fb0c2-9462-43e0-a172-65257d1cf683 tempest-VolumeAndVolumeTypeFromImageTest-804377883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de607c8d-5025-4abd-922b-dc8499edb473) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:29:39Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3dedab4-6e16-49a8-a1bd-d2b30ac68c57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3346322bbd5460aba3ce4e3e4296b66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:29:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:29:40Z,use_quota=True,user_id='6204b62efb4c42f08484575fb4305116',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce4c930c-e7b6-4f6e-8ab4-02f7f5bec6fe),volume_type_id=ce4c930c-e7b6-4f6e-8ab4-02f7f5bec6fe)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:29:39 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c67fb0c2-9462-43e0-a172-65257d1cf683 tempest-VolumeAndVolumeTypeFromImageTest-804377883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6de0dfa5-848b-48b9-ad28-a2cfb6cdf0b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:29:39 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c67fb0c2-9462-43e0-a172-65257d1cf683 tempest-VolumeAndVolumeTypeFromImageTest-804377883 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6de0dfa5-848b-48b9-ad28-a2cfb6cdf0b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:29:39 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c67fb0c2-9462-43e0-a172-65257d1cf683 tempest-VolumeAndVolumeTypeFromImageTest-804377883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a38029d1-6810-4daa-82be-d4c64bf8f4e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:29:39 devstack cinder-volume[86082]: DEBUG cinder.image.glance [None req-c67fb0c2-9462-43e0-a172-65257d1cf683 tempest-VolumeAndVolumeTypeFromImageTest-804377883 None] Creating Keystone auth plugin from conf {{(pid=86082) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 15 16:29:39 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c67fb0c2-9462-43e0-a172-65257d1cf683 tempest-VolumeAndVolumeTypeFromImageTest-804377883 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a38029d1-6810-4daa-82be-d4c64bf8f4e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd3dedab4-6e16-49a8-a1bd-d2b30ac68c57', 'volume_name': 'volume-d3dedab4-6e16-49a8-a1bd-d2b30ac68c57', 'volume_size': 1, 'image_id': 'cb06b126-3d70-4441-b38f-6209f865851e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cb06b126-3d70-4441-b38f-6209f865851e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5ba5ad379274c50ba6e9a5bb78c00473', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e3346322bbd5460aba3ce4e3e4296b66', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6dd9eb822721b80f65770817df65393d676ee3d3ed6dc3dbcbb27a910438a1b05357ac8ca46846dcdb3d5e22131f606594a6916d949fea695af0ba9636793f14', 'id': 'cb06b126-3d70-4441-b38f-6209f865851e', 'created_at': datetime.datetime(2026, 9, 15, 14, 29, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 15, 14, 29, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cb06b126-3d70-4441-b38f-6209f865851e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:29:39 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c67fb0c2-9462-43e0-a172-65257d1cf683 tempest-VolumeAndVolumeTypeFromImageTest-804377883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5843848-7bc4-460c-9519-0d4f2800f3d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:29:39 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c67fb0c2-9462-43e0-a172-65257d1cf683 tempest-VolumeAndVolumeTypeFromImageTest-804377883 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5843848-7bc4-460c-9519-0d4f2800f3d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:29:39 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c67fb0c2-9462-43e0-a172-65257d1cf683 tempest-VolumeAndVolumeTypeFromImageTest-804377883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2af7770-8cf2-4f40-a737-abdd2af2e708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:29:39 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-c67fb0c2-9462-43e0-a172-65257d1cf683 tempest-VolumeAndVolumeTypeFromImageTest-804377883 None] Volume d3dedab4-6e16-49a8-a1bd-d2b30ac68c57: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d3dedab4-6e16-49a8-a1bd-d2b30ac68c57', 'volume_size': 1, 'image_id': 'cb06b126-3d70-4441-b38f-6209f865851e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cb06b126-3d70-4441-b38f-6209f865851e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5ba5ad379274c50ba6e9a5bb78c00473', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e3346322bbd5460aba3ce4e3e4296b66', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6dd9eb822721b80f65770817df65393d676ee3d3ed6dc3dbcbb27a910438a1b05357ac8ca46846dcdb3d5e22131f606594a6916d949fea695af0ba9636793f14', 'id': 'cb06b126-3d70-4441-b38f-6209f865851e', 'created_at': datetime.datetime(2026, 9, 15, 14, 29, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 15, 14, 29, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cb06b126-3d70-4441-b38f-6209f865851e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 15 16:29:39 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-c67fb0c2-9462-43e0-a172-65257d1cf683 tempest-VolumeAndVolumeTypeFromImageTest-804377883 None] Trying to clone d3dedab4-6e16-49a8-a1bd-d2b30ac68c57 from image cb06b126-3d70-4441-b38f-6209f865851e at location (None, [{'url': 'file:///opt/stack/data/glance/images/cb06b126-3d70-4441-b38f-6209f865851e', 'metadata': {}}]). {{(pid=86082) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 15 16:29:40 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-c67fb0c2-9462-43e0-a172-65257d1cf683 tempest-VolumeAndVolumeTypeFromImageTest-804377883 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_cb06b126-3d70-4441-b38f-6209f865851e_zsywymjidevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86082) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 15 16:29:40 devstack cinder-volume[86082]: INFO cinder.image.image_utils [None req-c67fb0c2-9462-43e0-a172-65257d1cf683 tempest-VolumeAndVolumeTypeFromImageTest-804377883 None] Image download 0.00 MB at 0.00 MB/s Sep 15 16:29:40 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[a586c2c8-77f6-4543-8f09-495ce97305a7]: (4, 'raw') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:29:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c67fb0c2-9462-43e0-a172-65257d1cf683 tempest-VolumeAndVolumeTypeFromImageTest-804377883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cb06b126-3d70-4441-b38f-6209f865851e_zsywymjidevstack@QuobyteHD {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:29:40 devstack sudo[101395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cb06b126-3d70-4441-b38f-6209f865851e_zsywymjidevstack@QuobyteHD Sep 15 16:29:40 devstack sudo[101395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:29:40 devstack sudo[101395]: pam_unix(sudo:session): session closed for user root Sep 15 16:29:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c67fb0c2-9462-43e0-a172-65257d1cf683 tempest-VolumeAndVolumeTypeFromImageTest-804377883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cb06b126-3d70-4441-b38f-6209f865851e_zsywymjidevstack@QuobyteHD" returned: 0 in 0.351s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:29:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c67fb0c2-9462-43e0-a172-65257d1cf683 tempest-VolumeAndVolumeTypeFromImageTest-804377883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cb06b126-3d70-4441-b38f-6209f865851e_zsywymjidevstack@QuobyteHD {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:29:40 devstack sudo[101399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cb06b126-3d70-4441-b38f-6209f865851e_zsywymjidevstack@QuobyteHD Sep 15 16:29:40 devstack sudo[101399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:29:40 devstack sudo[101399]: pam_unix(sudo:session): session closed for user root Sep 15 16:29:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c67fb0c2-9462-43e0-a172-65257d1cf683 tempest-VolumeAndVolumeTypeFromImageTest-804377883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cb06b126-3d70-4441-b38f-6209f865851e_zsywymjidevstack@QuobyteHD" returned: 1 in 0.365s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:29:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c67fb0c2-9462-43e0-a172-65257d1cf683 tempest-VolumeAndVolumeTypeFromImageTest-804377883 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cb06b126-3d70-4441-b38f-6209f865851e_zsywymjidevstack@QuobyteHD' failed. Not Retrying. {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 15 16:29:40 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-c67fb0c2-9462-43e0-a172-65257d1cf683 tempest-VolumeAndVolumeTypeFromImageTest-804377883 None] Temporary image cb06b126-3d70-4441-b38f-6209f865851e is fetched for user 6204b62efb4c42f08484575fb4305116. {{(pid=86082) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 15 16:29:40 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[28ca77a9-ba51-40b7-8c2e-f8422785c880]: (4, 'raw') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:29:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c67fb0c2-9462-43e0-a172-65257d1cf683 tempest-VolumeAndVolumeTypeFromImageTest-804377883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cb06b126-3d70-4441-b38f-6209f865851e_zsywymjidevstack@QuobyteHD {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:29:41 devstack sudo[101405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cb06b126-3d70-4441-b38f-6209f865851e_zsywymjidevstack@QuobyteHD Sep 15 16:29:41 devstack sudo[101405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:29:41 devstack sudo[101405]: pam_unix(sudo:session): session closed for user root Sep 15 16:29:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c67fb0c2-9462-43e0-a172-65257d1cf683 tempest-VolumeAndVolumeTypeFromImageTest-804377883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cb06b126-3d70-4441-b38f-6209f865851e_zsywymjidevstack@QuobyteHD" returned: 0 in 0.327s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:29:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c67fb0c2-9462-43e0-a172-65257d1cf683 tempest-VolumeAndVolumeTypeFromImageTest-804377883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cb06b126-3d70-4441-b38f-6209f865851e_zsywymjidevstack@QuobyteHD {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:29:41 devstack sudo[101409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cb06b126-3d70-4441-b38f-6209f865851e_zsywymjidevstack@QuobyteHD Sep 15 16:29:41 devstack sudo[101409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:29:41 devstack sudo[101409]: pam_unix(sudo:session): session closed for user root Sep 15 16:29:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c67fb0c2-9462-43e0-a172-65257d1cf683 tempest-VolumeAndVolumeTypeFromImageTest-804377883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cb06b126-3d70-4441-b38f-6209f865851e_zsywymjidevstack@QuobyteHD" returned: 1 in 0.335s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:29:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c67fb0c2-9462-43e0-a172-65257d1cf683 tempest-VolumeAndVolumeTypeFromImageTest-804377883 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cb06b126-3d70-4441-b38f-6209f865851e_zsywymjidevstack@QuobyteHD' failed. Not Retrying. {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 15 16:29:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c67fb0c2-9462-43e0-a172-65257d1cf683 tempest-VolumeAndVolumeTypeFromImageTest-804377883 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:29:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c67fb0c2-9462-43e0-a172-65257d1cf683 tempest-VolumeAndVolumeTypeFromImageTest-804377883 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:29:41 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c67fb0c2-9462-43e0-a172-65257d1cf683 tempest-VolumeAndVolumeTypeFromImageTest-804377883 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:29:39Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3dedab4-6e16-49a8-a1bd-d2b30ac68c57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3346322bbd5460aba3ce4e3e4296b66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:29:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:29:40Z,use_quota=True,user_id='6204b62efb4c42f08484575fb4305116',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ce4c930c-e7b6-4f6e-8ab4-02f7f5bec6fe),volume_type_id=ce4c930c-e7b6-4f6e-8ab4-02f7f5bec6fe)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:29:41 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-c67fb0c2-9462-43e0-a172-65257d1cf683 tempest-VolumeAndVolumeTypeFromImageTest-804377883 None] Creating volume d3dedab4-6e16-49a8-a1bd-d2b30ac68c57 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:29:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c67fb0c2-9462-43e0-a172-65257d1cf683 tempest-VolumeAndVolumeTypeFromImageTest-804377883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:29:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c67fb0c2-9462-43e0-a172-65257d1cf683 tempest-VolumeAndVolumeTypeFromImageTest-804377883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:29:41 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c67fb0c2-9462-43e0-a172-65257d1cf683 tempest-VolumeAndVolumeTypeFromImageTest-804377883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:29:41 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c67fb0c2-9462-43e0-a172-65257d1cf683 tempest-VolumeAndVolumeTypeFromImageTest-804377883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:29:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c67fb0c2-9462-43e0-a172-65257d1cf683 tempest-VolumeAndVolumeTypeFromImageTest-804377883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:29:41 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c67fb0c2-9462-43e0-a172-65257d1cf683 tempest-VolumeAndVolumeTypeFromImageTest-804377883 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:29:41 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-c67fb0c2-9462-43e0-a172-65257d1cf683 tempest-VolumeAndVolumeTypeFromImageTest-804377883 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:29:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c67fb0c2-9462-43e0-a172-65257d1cf683 tempest-VolumeAndVolumeTypeFromImageTest-804377883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-d3dedab4-6e16-49a8-a1bd-d2b30ac68c57 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:29:41 devstack sudo[101414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-d3dedab4-6e16-49a8-a1bd-d2b30ac68c57 1073741824 Sep 15 16:29:41 devstack sudo[101414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:29:42 devstack sudo[101414]: pam_unix(sudo:session): session closed for user root Sep 15 16:29:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c67fb0c2-9462-43e0-a172-65257d1cf683 tempest-VolumeAndVolumeTypeFromImageTest-804377883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-d3dedab4-6e16-49a8-a1bd-d2b30ac68c57 1073741824" returned: 0 in 0.480s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:29:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c67fb0c2-9462-43e0-a172-65257d1cf683 tempest-VolumeAndVolumeTypeFromImageTest-804377883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-d3dedab4-6e16-49a8-a1bd-d2b30ac68c57 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:29:42 devstack sudo[101420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-d3dedab4-6e16-49a8-a1bd-d2b30ac68c57 Sep 15 16:29:42 devstack sudo[101420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:29:42 devstack sudo[101420]: pam_unix(sudo:session): session closed for user root Sep 15 16:29:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c67fb0c2-9462-43e0-a172-65257d1cf683 tempest-VolumeAndVolumeTypeFromImageTest-804377883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-d3dedab4-6e16-49a8-a1bd-d2b30ac68c57" returned: 0 in 0.258s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:29:42 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c67fb0c2-9462-43e0-a172-65257d1cf683 tempest-VolumeAndVolumeTypeFromImageTest-804377883 None] <== create_volume: return (783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:29:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c67fb0c2-9462-43e0-a172-65257d1cf683 tempest-VolumeAndVolumeTypeFromImageTest-804377883 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.786s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:29:42 devstack cinder-volume[86082]: DEBUG cinder.volume.volume_utils [None req-c67fb0c2-9462-43e0-a172-65257d1cf683 tempest-VolumeAndVolumeTypeFromImageTest-804377883 None] Attempting download of cb06b126-3d70-4441-b38f-6209f865851e ((None, [{'url': 'file:///opt/stack/data/glance/images/cb06b126-3d70-4441-b38f-6209f865851e', 'metadata': {}}])) to volume d3dedab4-6e16-49a8-a1bd-d2b30ac68c57. {{(pid=86082) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 15 16:29:42 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdf2f384-5f47-4b40-a89c-34592792be10]: (4, 'raw') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:29:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c67fb0c2-9462-43e0-a172-65257d1cf683 tempest-VolumeAndVolumeTypeFromImageTest-804377883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cb06b126-3d70-4441-b38f-6209f865851e_1nskgiu8 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:29:42 devstack sudo[101423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cb06b126-3d70-4441-b38f-6209f865851e_1nskgiu8 Sep 15 16:29:42 devstack sudo[101423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:29:42 devstack sudo[101423]: pam_unix(sudo:session): session closed for user root Sep 15 16:29:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c67fb0c2-9462-43e0-a172-65257d1cf683 tempest-VolumeAndVolumeTypeFromImageTest-804377883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cb06b126-3d70-4441-b38f-6209f865851e_1nskgiu8" returned: 0 in 0.329s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:29:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c67fb0c2-9462-43e0-a172-65257d1cf683 tempest-VolumeAndVolumeTypeFromImageTest-804377883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cb06b126-3d70-4441-b38f-6209f865851e_1nskgiu8 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:29:42 devstack sudo[101427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cb06b126-3d70-4441-b38f-6209f865851e_1nskgiu8 Sep 15 16:29:42 devstack sudo[101427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:29:43 devstack sudo[101427]: pam_unix(sudo:session): session closed for user root Sep 15 16:29:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c67fb0c2-9462-43e0-a172-65257d1cf683 tempest-VolumeAndVolumeTypeFromImageTest-804377883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cb06b126-3d70-4441-b38f-6209f865851e_1nskgiu8" returned: 1 in 0.339s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:29:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c67fb0c2-9462-43e0-a172-65257d1cf683 tempest-VolumeAndVolumeTypeFromImageTest-804377883 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cb06b126-3d70-4441-b38f-6209f865851e_1nskgiu8' failed. Not Retrying. {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 15 16:29:43 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[c540e371-b5cc-4e20-9979-7c1e5f11dda8]: (4, 'raw') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:29:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c67fb0c2-9462-43e0-a172-65257d1cf683 tempest-VolumeAndVolumeTypeFromImageTest-804377883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cb06b126-3d70-4441-b38f-6209f865851e_zsywymjidevstack@QuobyteHD {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:29:43 devstack sudo[101431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cb06b126-3d70-4441-b38f-6209f865851e_zsywymjidevstack@QuobyteHD Sep 15 16:29:43 devstack sudo[101431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:29:43 devstack sudo[101431]: pam_unix(sudo:session): session closed for user root Sep 15 16:29:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c67fb0c2-9462-43e0-a172-65257d1cf683 tempest-VolumeAndVolumeTypeFromImageTest-804377883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cb06b126-3d70-4441-b38f-6209f865851e_zsywymjidevstack@QuobyteHD" returned: 0 in 0.328s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:29:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c67fb0c2-9462-43e0-a172-65257d1cf683 tempest-VolumeAndVolumeTypeFromImageTest-804377883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cb06b126-3d70-4441-b38f-6209f865851e_zsywymjidevstack@QuobyteHD {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:29:43 devstack sudo[101435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cb06b126-3d70-4441-b38f-6209f865851e_zsywymjidevstack@QuobyteHD Sep 15 16:29:43 devstack sudo[101435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:29:43 devstack sudo[101435]: pam_unix(sudo:session): session closed for user root Sep 15 16:29:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c67fb0c2-9462-43e0-a172-65257d1cf683 tempest-VolumeAndVolumeTypeFromImageTest-804377883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cb06b126-3d70-4441-b38f-6209f865851e_zsywymjidevstack@QuobyteHD" returned: 1 in 0.351s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:29:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c67fb0c2-9462-43e0-a172-65257d1cf683 tempest-VolumeAndVolumeTypeFromImageTest-804377883 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cb06b126-3d70-4441-b38f-6209f865851e_zsywymjidevstack@QuobyteHD' failed. Not Retrying. {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 15 16:29:43 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-c67fb0c2-9462-43e0-a172-65257d1cf683 tempest-VolumeAndVolumeTypeFromImageTest-804377883 None] cb06b126-3d70-4441-b38f-6209f865851e was raw, converting to qcow2 {{(pid=86082) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 15 16:29:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c67fb0c2-9462-43e0-a172-65257d1cf683 tempest-VolumeAndVolumeTypeFromImageTest-804377883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_cb06b126-3d70-4441-b38f-6209f865851e_zsywymjidevstack@QuobyteHD /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-d3dedab4-6e16-49a8-a1bd-d2b30ac68c57 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:29:43 devstack sudo[101440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_cb06b126-3d70-4441-b38f-6209f865851e_zsywymjidevstack@QuobyteHD /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-d3dedab4-6e16-49a8-a1bd-d2b30ac68c57 Sep 15 16:29:43 devstack sudo[101440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:29:44 devstack sudo[101440]: pam_unix(sudo:session): session closed for user root Sep 15 16:29:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c67fb0c2-9462-43e0-a172-65257d1cf683 tempest-VolumeAndVolumeTypeFromImageTest-804377883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_cb06b126-3d70-4441-b38f-6209f865851e_zsywymjidevstack@QuobyteHD /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-d3dedab4-6e16-49a8-a1bd-d2b30ac68c57" returned: 0 in 0.539s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:29:44 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-c67fb0c2-9462-43e0-a172-65257d1cf683 tempest-VolumeAndVolumeTypeFromImageTest-804377883 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_cb06b126-3d70-4441-b38f-6209f865851e_zsywymjidevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-d3dedab4-6e16-49a8-a1bd-d2b30ac68c57 {{(pid=86082) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 15 16:29:44 devstack cinder-volume[86082]: INFO cinder.image.image_utils [None req-c67fb0c2-9462-43e0-a172-65257d1cf683 tempest-VolumeAndVolumeTypeFromImageTest-804377883 None] Converted 0.00 MB image at 0.00 MB/s Sep 15 16:29:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c67fb0c2-9462-43e0-a172-65257d1cf683 tempest-VolumeAndVolumeTypeFromImageTest-804377883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-d3dedab4-6e16-49a8-a1bd-d2b30ac68c57 1G {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:29:44 devstack sudo[101448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-d3dedab4-6e16-49a8-a1bd-d2b30ac68c57 1G Sep 15 16:29:44 devstack sudo[101448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:29:44 devstack sudo[101448]: pam_unix(sudo:session): session closed for user root Sep 15 16:29:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c67fb0c2-9462-43e0-a172-65257d1cf683 tempest-VolumeAndVolumeTypeFromImageTest-804377883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-d3dedab4-6e16-49a8-a1bd-d2b30ac68c57 1G" returned: 0 in 0.338s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:29:44 devstack cinder-volume[86082]: DEBUG cinder.volume.volume_utils [None req-c67fb0c2-9462-43e0-a172-65257d1cf683 tempest-VolumeAndVolumeTypeFromImageTest-804377883 None] Downloaded image cb06b126-3d70-4441-b38f-6209f865851e ((None, [{'url': 'file:///opt/stack/data/glance/images/cb06b126-3d70-4441-b38f-6209f865851e', 'metadata': {}}])) to volume d3dedab4-6e16-49a8-a1bd-d2b30ac68c57 successfully. {{(pid=86082) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 15 16:29:44 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-c67fb0c2-9462-43e0-a172-65257d1cf683 tempest-VolumeAndVolumeTypeFromImageTest-804377883 None] Temporary image cb06b126-3d70-4441-b38f-6209f865851e for user 6204b62efb4c42f08484575fb4305116 is deleted. {{(pid=86082) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 15 16:29:44 devstack cinder-volume[86082]: DEBUG cinder.volume.volume_utils [None req-c67fb0c2-9462-43e0-a172-65257d1cf683 tempest-VolumeAndVolumeTypeFromImageTest-804377883 None] Marking volume d3dedab4-6e16-49a8-a1bd-d2b30ac68c57 as bootable. {{(pid=86082) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 15 16:29:44 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-c67fb0c2-9462-43e0-a172-65257d1cf683 tempest-VolumeAndVolumeTypeFromImageTest-804377883 None] Copying metadata from image cb06b126-3d70-4441-b38f-6209f865851e to d3dedab4-6e16-49a8-a1bd-d2b30ac68c57. {{(pid=86082) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 15 16:29:44 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-c67fb0c2-9462-43e0-a172-65257d1cf683 tempest-VolumeAndVolumeTypeFromImageTest-804377883 None] Creating volume glance metadata for volume d3dedab4-6e16-49a8-a1bd-d2b30ac68c57 backed by image cb06b126-3d70-4441-b38f-6209f865851e with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'cb06b126-3d70-4441-b38f-6209f865851e', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '5ba5ad379274c50ba6e9a5bb78c00473', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86082) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 15 16:29:44 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c67fb0c2-9462-43e0-a172-65257d1cf683 tempest-VolumeAndVolumeTypeFromImageTest-804377883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2af7770-8cf2-4f40-a737-abdd2af2e708) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3dedab4-6e16-49a8-a1bd-d2b30ac68c57', 'volume_size': 1, 'image_id': 'cb06b126-3d70-4441-b38f-6209f865851e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cb06b126-3d70-4441-b38f-6209f865851e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5ba5ad379274c50ba6e9a5bb78c00473', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e3346322bbd5460aba3ce4e3e4296b66', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6dd9eb822721b80f65770817df65393d676ee3d3ed6dc3dbcbb27a910438a1b05357ac8ca46846dcdb3d5e22131f606594a6916d949fea695af0ba9636793f14', 'id': 'cb06b126-3d70-4441-b38f-6209f865851e', 'created_at': datetime.datetime(2026, 9, 15, 14, 29, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 15, 14, 29, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cb06b126-3d70-4441-b38f-6209f865851e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:29:44 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c67fb0c2-9462-43e0-a172-65257d1cf683 tempest-VolumeAndVolumeTypeFromImageTest-804377883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a223432b-3cd9-4433-a075-20fce57729e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:29:44 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-c67fb0c2-9462-43e0-a172-65257d1cf683 tempest-VolumeAndVolumeTypeFromImageTest-804377883 None] Volume volume-d3dedab4-6e16-49a8-a1bd-d2b30ac68c57 (d3dedab4-6e16-49a8-a1bd-d2b30ac68c57): created successfully Sep 15 16:29:44 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c67fb0c2-9462-43e0-a172-65257d1cf683 tempest-VolumeAndVolumeTypeFromImageTest-804377883 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a223432b-3cd9-4433-a075-20fce57729e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:29:44 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c67fb0c2-9462-43e0-a172-65257d1cf683 tempest-VolumeAndVolumeTypeFromImageTest-804377883 None] Flow 'volume_create_manager' (eae8a97b-ac94-436f-aefe-d5e9f594ac94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:29:44 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-c67fb0c2-9462-43e0-a172-65257d1cf683 tempest-VolumeAndVolumeTypeFromImageTest-804377883 None] Created volume successfully. Sep 15 16:29:44 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-18eddcf8-83af-43da-8c5b-3864124ca4d9 tempest-VolumeAndVolumeTypeFromImageTest-804377883 None] Acquiring lock "cinder-d3dedab4-6e16-49a8-a1bd-d2b30ac68c57-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:29:44 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-18eddcf8-83af-43da-8c5b-3864124ca4d9 tempest-VolumeAndVolumeTypeFromImageTest-804377883 None] Lock "cinder-d3dedab4-6e16-49a8-a1bd-d2b30ac68c57-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:29:44 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-18eddcf8-83af-43da-8c5b-3864124ca4d9 tempest-VolumeAndVolumeTypeFromImageTest-804377883 None] Acquiring lock "cinder-quobyte-d3dedab4-6e16-49a8-a1bd-d2b30ac68c57" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:29:45 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-18eddcf8-83af-43da-8c5b-3864124ca4d9 tempest-VolumeAndVolumeTypeFromImageTest-804377883 None] Lock "cinder-quobyte-d3dedab4-6e16-49a8-a1bd-d2b30ac68c57" acquired by "delete_volume" :: waited 0.017s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:29:45 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b97058d-d029-475c-b9bc-4a78417ffaf1]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:29:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-18eddcf8-83af-43da-8c5b-3864124ca4d9 tempest-VolumeAndVolumeTypeFromImageTest-804377883 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-d3dedab4-6e16-49a8-a1bd-d2b30ac68c57 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:29:45 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-a410175c-111f-4f9f-8ec6-5db79e699959 tempest-VolumesImageMetadata-1361349044 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:29:45 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-a410175c-111f-4f9f-8ec6-5db79e699959 tempest-VolumesImageMetadata-1361349044 None] Flow 'volume_create_manager' (6a13eedc-ff5a-450e-9ff6-008acc015fd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:29:45 devstack sudo[101453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-d3dedab4-6e16-49a8-a1bd-d2b30ac68c57 Sep 15 16:29:45 devstack sudo[101453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:29:45 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-a410175c-111f-4f9f-8ec6-5db79e699959 tempest-VolumesImageMetadata-1361349044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (550e9781-a6e9-4d49-b27b-d55908d9435c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:29:45 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-a410175c-111f-4f9f-8ec6-5db79e699959 tempest-VolumesImageMetadata-1361349044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (550e9781-a6e9-4d49-b27b-d55908d9435c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:29:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-480317682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed959408-c602-4ab8-b837-6c68b017571e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca5e5f52e5f94bd7a774d432309fafb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:29:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:29:45Z,use_quota=True,user_id='4641398bebf648ff94d3648e5967372a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:29:45 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-a410175c-111f-4f9f-8ec6-5db79e699959 tempest-VolumesImageMetadata-1361349044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00b2df19-37ab-4a76-bd12-a705174642c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:29:45 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-a410175c-111f-4f9f-8ec6-5db79e699959 tempest-VolumesImageMetadata-1361349044 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00b2df19-37ab-4a76-bd12-a705174642c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:29:45 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-a410175c-111f-4f9f-8ec6-5db79e699959 tempest-VolumesImageMetadata-1361349044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76206bcd-57fa-4605-a936-f4d64b194ba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:29:45 devstack cinder-volume[86082]: DEBUG cinder.image.glance [None req-a410175c-111f-4f9f-8ec6-5db79e699959 tempest-VolumesImageMetadata-1361349044 None] Creating Keystone auth plugin from conf {{(pid=86082) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 15 16:29:45 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-a410175c-111f-4f9f-8ec6-5db79e699959 tempest-VolumesImageMetadata-1361349044 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76206bcd-57fa-4605-a936-f4d64b194ba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ed959408-c602-4ab8-b837-6c68b017571e', 'volume_name': 'volume-ed959408-c602-4ab8-b837-6c68b017571e', 'volume_size': 1, 'image_id': '0ea392d9-2af0-468e-bdc1-5e3f34bc52e6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0ea392d9-2af0-468e-bdc1-5e3f34bc52e6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e57b859e1a41428083b6d86ce51f5184', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0ea392d9-2af0-468e-bdc1-5e3f34bc52e6', 'created_at': datetime.datetime(2026, 9, 15, 14, 11, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 15, 14, 11, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0ea392d9-2af0-468e-bdc1-5e3f34bc52e6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:29:45 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-a410175c-111f-4f9f-8ec6-5db79e699959 tempest-VolumesImageMetadata-1361349044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fe01ebe-3243-4ad6-ade1-52e7d13baec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:29:45 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-a410175c-111f-4f9f-8ec6-5db79e699959 tempest-VolumesImageMetadata-1361349044 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7fe01ebe-3243-4ad6-ade1-52e7d13baec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:29:45 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-a410175c-111f-4f9f-8ec6-5db79e699959 tempest-VolumesImageMetadata-1361349044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e9fab40-1ec0-4bcf-bba5-5edac7beb016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:29:45 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-a410175c-111f-4f9f-8ec6-5db79e699959 tempest-VolumesImageMetadata-1361349044 None] Volume ed959408-c602-4ab8-b837-6c68b017571e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ed959408-c602-4ab8-b837-6c68b017571e', 'volume_size': 1, 'image_id': '0ea392d9-2af0-468e-bdc1-5e3f34bc52e6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0ea392d9-2af0-468e-bdc1-5e3f34bc52e6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e57b859e1a41428083b6d86ce51f5184', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0ea392d9-2af0-468e-bdc1-5e3f34bc52e6', 'created_at': datetime.datetime(2026, 9, 15, 14, 11, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 15, 14, 11, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0ea392d9-2af0-468e-bdc1-5e3f34bc52e6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 15 16:29:45 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-a410175c-111f-4f9f-8ec6-5db79e699959 tempest-VolumesImageMetadata-1361349044 None] Trying to clone ed959408-c602-4ab8-b837-6c68b017571e from image 0ea392d9-2af0-468e-bdc1-5e3f34bc52e6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/0ea392d9-2af0-468e-bdc1-5e3f34bc52e6', 'metadata': {}}]). {{(pid=86082) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 15 16:29:45 devstack sudo[101453]: pam_unix(sudo:session): session closed for user root Sep 15 16:29:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-18eddcf8-83af-43da-8c5b-3864124ca4d9 tempest-VolumeAndVolumeTypeFromImageTest-804377883 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-d3dedab4-6e16-49a8-a1bd-d2b30ac68c57" returned: 0 in 0.380s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:29:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-18eddcf8-83af-43da-8c5b-3864124ca4d9 tempest-VolumeAndVolumeTypeFromImageTest-804377883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-d3dedab4-6e16-49a8-a1bd-d2b30ac68c57 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:29:45 devstack sudo[101458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-d3dedab4-6e16-49a8-a1bd-d2b30ac68c57 Sep 15 16:29:45 devstack sudo[101458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:29:45 devstack sudo[101458]: pam_unix(sudo:session): session closed for user root Sep 15 16:29:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-18eddcf8-83af-43da-8c5b-3864124ca4d9 tempest-VolumeAndVolumeTypeFromImageTest-804377883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-d3dedab4-6e16-49a8-a1bd-d2b30ac68c57" returned: 0 in 0.259s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:29:45 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-18eddcf8-83af-43da-8c5b-3864124ca4d9 tempest-VolumeAndVolumeTypeFromImageTest-804377883 None] Lock "cinder-quobyte-d3dedab4-6e16-49a8-a1bd-d2b30ac68c57" released by "delete_volume" :: held 0.690s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:29:45 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-a410175c-111f-4f9f-8ec6-5db79e699959 tempest-VolumesImageMetadata-1361349044 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0ea392d9-2af0-468e-bdc1-5e3f34bc52e6_ya3_2wlgdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86082) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 15 16:29:45 devstack cinder-volume[86082]: INFO cinder.image.image_utils [None req-a410175c-111f-4f9f-8ec6-5db79e699959 tempest-VolumesImageMetadata-1361349044 None] Image download 20.69 MB at 20.69 MB/s Sep 15 16:29:45 devstack cinder-volume[86082]: WARNING cinder.quota [None req-18eddcf8-83af-43da-8c5b-3864124ca4d9 tempest-VolumeAndVolumeTypeFromImageTest-804377883 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 15 16:29:45 devstack cinder-volume[86082]: WARNING cinder.quota [None req-18eddcf8-83af-43da-8c5b-3864124ca4d9 tempest-VolumeAndVolumeTypeFromImageTest-804377883 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 15 16:29:45 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f440bd3-3568-4068-a407-695986ad4291]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:29:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a410175c-111f-4f9f-8ec6-5db79e699959 tempest-VolumesImageMetadata-1361349044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ea392d9-2af0-468e-bdc1-5e3f34bc52e6_ya3_2wlgdevstack@QuobyteHD {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:29:45 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-18eddcf8-83af-43da-8c5b-3864124ca4d9 tempest-VolumeAndVolumeTypeFromImageTest-804377883 None] Created reservations ['9b06702e-e941-4145-90f9-1798eb5c65da', '2dae8d18-9b39-4188-8bc0-735e13efebb2', 'af91b21a-0677-4afe-8666-0c078ee49911', 'd5fdf540-39f9-4e3f-a483-a607fc5df5d8'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:29:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-18eddcf8-83af-43da-8c5b-3864124ca4d9 tempest-VolumeAndVolumeTypeFromImageTest-804377883 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:29:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-18eddcf8-83af-43da-8c5b-3864124ca4d9 tempest-VolumeAndVolumeTypeFromImageTest-804377883 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:29:45 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-18eddcf8-83af-43da-8c5b-3864124ca4d9 tempest-VolumeAndVolumeTypeFromImageTest-804377883 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:29:45 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-18eddcf8-83af-43da-8c5b-3864124ca4d9 tempest-VolumeAndVolumeTypeFromImageTest-804377883 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:29:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-18eddcf8-83af-43da-8c5b-3864124ca4d9 tempest-VolumeAndVolumeTypeFromImageTest-804377883 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:29:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-18eddcf8-83af-43da-8c5b-3864124ca4d9 tempest-VolumeAndVolumeTypeFromImageTest-804377883 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:29:45 devstack sudo[101462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ea392d9-2af0-468e-bdc1-5e3f34bc52e6_ya3_2wlgdevstack@QuobyteHD Sep 15 16:29:45 devstack sudo[101462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:29:45 devstack sudo[101463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:29:45 devstack sudo[101463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:29:46 devstack sudo[101463]: pam_unix(sudo:session): session closed for user root Sep 15 16:29:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-18eddcf8-83af-43da-8c5b-3864124ca4d9 tempest-VolumeAndVolumeTypeFromImageTest-804377883 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.255s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:29:46 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-18eddcf8-83af-43da-8c5b-3864124ca4d9 tempest-VolumeAndVolumeTypeFromImageTest-804377883 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:29:46 devstack sudo[101462]: pam_unix(sudo:session): session closed for user root Sep 15 16:29:46 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-18eddcf8-83af-43da-8c5b-3864124ca4d9 tempest-VolumeAndVolumeTypeFromImageTest-804377883 None] Deleted volume successfully. Sep 15 16:29:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a410175c-111f-4f9f-8ec6-5db79e699959 tempest-VolumesImageMetadata-1361349044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ea392d9-2af0-468e-bdc1-5e3f34bc52e6_ya3_2wlgdevstack@QuobyteHD" returned: 0 in 0.366s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:29:46 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-a410175c-111f-4f9f-8ec6-5db79e699959 tempest-VolumesImageMetadata-1361349044 None] Temporary image 0ea392d9-2af0-468e-bdc1-5e3f34bc52e6 is fetched for user 4641398bebf648ff94d3648e5967372a. {{(pid=86082) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 15 16:29:46 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-18eddcf8-83af-43da-8c5b-3864124ca4d9 tempest-VolumeAndVolumeTypeFromImageTest-804377883 None] Lock "cinder-d3dedab4-6e16-49a8-a1bd-d2b30ac68c57-delete_volume" released by "delete_volume" :: held 1.216s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:29:46 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcc8f268-a26a-4f04-950a-2e1e64543eb9]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:29:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a410175c-111f-4f9f-8ec6-5db79e699959 tempest-VolumesImageMetadata-1361349044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ea392d9-2af0-468e-bdc1-5e3f34bc52e6_ya3_2wlgdevstack@QuobyteHD {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:29:46 devstack sudo[101470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ea392d9-2af0-468e-bdc1-5e3f34bc52e6_ya3_2wlgdevstack@QuobyteHD Sep 15 16:29:46 devstack sudo[101470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:29:46 devstack sudo[101470]: pam_unix(sudo:session): session closed for user root Sep 15 16:29:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a410175c-111f-4f9f-8ec6-5db79e699959 tempest-VolumesImageMetadata-1361349044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ea392d9-2af0-468e-bdc1-5e3f34bc52e6_ya3_2wlgdevstack@QuobyteHD" returned: 0 in 0.328s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:29:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-a410175c-111f-4f9f-8ec6-5db79e699959 tempest-VolumesImageMetadata-1361349044 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:29:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-a410175c-111f-4f9f-8ec6-5db79e699959 tempest-VolumesImageMetadata-1361349044 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:29:46 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-a410175c-111f-4f9f-8ec6-5db79e699959 tempest-VolumesImageMetadata-1361349044 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:29:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-480317682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed959408-c602-4ab8-b837-6c68b017571e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca5e5f52e5f94bd7a774d432309fafb0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:29:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:29:45Z,use_quota=True,user_id='4641398bebf648ff94d3648e5967372a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:29:46 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-a410175c-111f-4f9f-8ec6-5db79e699959 tempest-VolumesImageMetadata-1361349044 None] Creating volume ed959408-c602-4ab8-b837-6c68b017571e {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:29:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-a410175c-111f-4f9f-8ec6-5db79e699959 tempest-VolumesImageMetadata-1361349044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:29:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-a410175c-111f-4f9f-8ec6-5db79e699959 tempest-VolumesImageMetadata-1361349044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:29:46 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-a410175c-111f-4f9f-8ec6-5db79e699959 tempest-VolumesImageMetadata-1361349044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:29:46 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-a410175c-111f-4f9f-8ec6-5db79e699959 tempest-VolumesImageMetadata-1361349044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:29:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-a410175c-111f-4f9f-8ec6-5db79e699959 tempest-VolumesImageMetadata-1361349044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:29:46 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-a410175c-111f-4f9f-8ec6-5db79e699959 tempest-VolumesImageMetadata-1361349044 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:29:46 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-a410175c-111f-4f9f-8ec6-5db79e699959 tempest-VolumesImageMetadata-1361349044 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:29:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a410175c-111f-4f9f-8ec6-5db79e699959 tempest-VolumesImageMetadata-1361349044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ed959408-c602-4ab8-b837-6c68b017571e 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:29:46 devstack sudo[101475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ed959408-c602-4ab8-b837-6c68b017571e 1073741824 Sep 15 16:29:46 devstack sudo[101475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:29:46 devstack sudo[101475]: pam_unix(sudo:session): session closed for user root Sep 15 16:29:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a410175c-111f-4f9f-8ec6-5db79e699959 tempest-VolumesImageMetadata-1361349044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ed959408-c602-4ab8-b837-6c68b017571e 1073741824" returned: 0 in 0.430s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:29:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a410175c-111f-4f9f-8ec6-5db79e699959 tempest-VolumesImageMetadata-1361349044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ed959408-c602-4ab8-b837-6c68b017571e {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:29:47 devstack sudo[101482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ed959408-c602-4ab8-b837-6c68b017571e Sep 15 16:29:47 devstack sudo[101482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:29:47 devstack sudo[101482]: pam_unix(sudo:session): session closed for user root Sep 15 16:29:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a410175c-111f-4f9f-8ec6-5db79e699959 tempest-VolumesImageMetadata-1361349044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ed959408-c602-4ab8-b837-6c68b017571e" returned: 0 in 0.251s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:29:47 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-a410175c-111f-4f9f-8ec6-5db79e699959 tempest-VolumesImageMetadata-1361349044 None] <== create_volume: return (727ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:29:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-a410175c-111f-4f9f-8ec6-5db79e699959 tempest-VolumesImageMetadata-1361349044 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.731s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:29:47 devstack cinder-volume[86082]: DEBUG cinder.volume.volume_utils [None req-a410175c-111f-4f9f-8ec6-5db79e699959 tempest-VolumesImageMetadata-1361349044 None] Attempting download of 0ea392d9-2af0-468e-bdc1-5e3f34bc52e6 ((None, [{'url': 'file:///opt/stack/data/glance/images/0ea392d9-2af0-468e-bdc1-5e3f34bc52e6', 'metadata': {}}])) to volume ed959408-c602-4ab8-b837-6c68b017571e. {{(pid=86082) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 15 16:29:47 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbcc91cf-8407-4aca-8684-19de000252f2]: (4, 'raw') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:29:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a410175c-111f-4f9f-8ec6-5db79e699959 tempest-VolumesImageMetadata-1361349044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0ea392d9-2af0-468e-bdc1-5e3f34bc52e6_urh1m41h {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:29:47 devstack sudo[101485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0ea392d9-2af0-468e-bdc1-5e3f34bc52e6_urh1m41h Sep 15 16:29:47 devstack sudo[101485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:29:47 devstack sudo[101485]: pam_unix(sudo:session): session closed for user root Sep 15 16:29:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a410175c-111f-4f9f-8ec6-5db79e699959 tempest-VolumesImageMetadata-1361349044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0ea392d9-2af0-468e-bdc1-5e3f34bc52e6_urh1m41h" returned: 0 in 0.332s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:29:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a410175c-111f-4f9f-8ec6-5db79e699959 tempest-VolumesImageMetadata-1361349044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0ea392d9-2af0-468e-bdc1-5e3f34bc52e6_urh1m41h {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:29:47 devstack sudo[101489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0ea392d9-2af0-468e-bdc1-5e3f34bc52e6_urh1m41h Sep 15 16:29:47 devstack sudo[101489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:29:48 devstack sudo[101489]: pam_unix(sudo:session): session closed for user root Sep 15 16:29:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a410175c-111f-4f9f-8ec6-5db79e699959 tempest-VolumesImageMetadata-1361349044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0ea392d9-2af0-468e-bdc1-5e3f34bc52e6_urh1m41h" returned: 1 in 0.366s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:29:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a410175c-111f-4f9f-8ec6-5db79e699959 tempest-VolumesImageMetadata-1361349044 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0ea392d9-2af0-468e-bdc1-5e3f34bc52e6_urh1m41h' failed. Not Retrying. {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 15 16:29:48 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[17432e2b-69f5-4c62-8c3c-69eef44f1e55]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:29:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a410175c-111f-4f9f-8ec6-5db79e699959 tempest-VolumesImageMetadata-1361349044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ea392d9-2af0-468e-bdc1-5e3f34bc52e6_ya3_2wlgdevstack@QuobyteHD {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:29:48 devstack sudo[101493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ea392d9-2af0-468e-bdc1-5e3f34bc52e6_ya3_2wlgdevstack@QuobyteHD Sep 15 16:29:48 devstack sudo[101493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:29:48 devstack sudo[101493]: pam_unix(sudo:session): session closed for user root Sep 15 16:29:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a410175c-111f-4f9f-8ec6-5db79e699959 tempest-VolumesImageMetadata-1361349044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ea392d9-2af0-468e-bdc1-5e3f34bc52e6_ya3_2wlgdevstack@QuobyteHD" returned: 0 in 0.366s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:29:48 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-a410175c-111f-4f9f-8ec6-5db79e699959 tempest-VolumesImageMetadata-1361349044 None] 0ea392d9-2af0-468e-bdc1-5e3f34bc52e6 was qcow2, converting to qcow2 {{(pid=86082) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 15 16:29:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a410175c-111f-4f9f-8ec6-5db79e699959 tempest-VolumesImageMetadata-1361349044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0ea392d9-2af0-468e-bdc1-5e3f34bc52e6_ya3_2wlgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ed959408-c602-4ab8-b837-6c68b017571e {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:29:48 devstack sudo[101498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0ea392d9-2af0-468e-bdc1-5e3f34bc52e6_ya3_2wlgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ed959408-c602-4ab8-b837-6c68b017571e Sep 15 16:29:48 devstack sudo[101498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:29:50 devstack sudo[101498]: pam_unix(sudo:session): session closed for user root Sep 15 16:29:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a410175c-111f-4f9f-8ec6-5db79e699959 tempest-VolumesImageMetadata-1361349044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0ea392d9-2af0-468e-bdc1-5e3f34bc52e6_ya3_2wlgdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ed959408-c602-4ab8-b837-6c68b017571e" returned: 0 in 2.071s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:29:50 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-a410175c-111f-4f9f-8ec6-5db79e699959 tempest-VolumesImageMetadata-1361349044 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0ea392d9-2af0-468e-bdc1-5e3f34bc52e6_ya3_2wlgdevstack@QuobyteHD, size 112.00 MB, duration 2.07 sec, destination /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ed959408-c602-4ab8-b837-6c68b017571e {{(pid=86082) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 15 16:29:50 devstack cinder-volume[86082]: INFO cinder.image.image_utils [None req-a410175c-111f-4f9f-8ec6-5db79e699959 tempest-VolumesImageMetadata-1361349044 None] Converted 112.00 MB image at 54.06 MB/s Sep 15 16:29:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a410175c-111f-4f9f-8ec6-5db79e699959 tempest-VolumesImageMetadata-1361349044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ed959408-c602-4ab8-b837-6c68b017571e 1G {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:29:50 devstack sudo[101507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ed959408-c602-4ab8-b837-6c68b017571e 1G Sep 15 16:29:50 devstack sudo[101507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:29:50 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-29e7eb18-ee16-4791-bbc9-0fe280691a1f tempest-CreateVolumesFromImageTest-1130093192 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:29:50 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-29e7eb18-ee16-4791-bbc9-0fe280691a1f tempest-CreateVolumesFromImageTest-1130093192 None] Flow 'volume_create_manager' (18845a27-c88d-48ae-bd4b-e09802c15446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:29:50 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-29e7eb18-ee16-4791-bbc9-0fe280691a1f tempest-CreateVolumesFromImageTest-1130093192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b0a3713-dea6-49e6-bc3a-6bc21c7fca43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:29:50 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-29e7eb18-ee16-4791-bbc9-0fe280691a1f tempest-CreateVolumesFromImageTest-1130093192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b0a3713-dea6-49e6-bc3a-6bc21c7fca43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:29:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1726433054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ea13f9f-7608-4cd5-80ef-450b8d31e6cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d17e31674042422586fad30c994415e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:29:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:29:50Z,use_quota=True,user_id='579c3f2fb69742469690d961de7b78b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:29:50 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-29e7eb18-ee16-4791-bbc9-0fe280691a1f tempest-CreateVolumesFromImageTest-1130093192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16317498-0c17-4f89-8e22-8077327ac243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:29:50 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-29e7eb18-ee16-4791-bbc9-0fe280691a1f tempest-CreateVolumesFromImageTest-1130093192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16317498-0c17-4f89-8e22-8077327ac243) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:29:50 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-29e7eb18-ee16-4791-bbc9-0fe280691a1f tempest-CreateVolumesFromImageTest-1130093192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ed171c4-d780-43e2-97a0-b63abea97df8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:29:50 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-29e7eb18-ee16-4791-bbc9-0fe280691a1f tempest-CreateVolumesFromImageTest-1130093192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ed171c4-d780-43e2-97a0-b63abea97df8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ea13f9f-7608-4cd5-80ef-450b8d31e6cd', 'volume_name': 'volume-8ea13f9f-7608-4cd5-80ef-450b8d31e6cd', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:29:50 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-29e7eb18-ee16-4791-bbc9-0fe280691a1f tempest-CreateVolumesFromImageTest-1130093192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eea4ab99-4437-487e-bd9f-388f56e72661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:29:50 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-29e7eb18-ee16-4791-bbc9-0fe280691a1f tempest-CreateVolumesFromImageTest-1130093192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eea4ab99-4437-487e-bd9f-388f56e72661) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:29:50 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-29e7eb18-ee16-4791-bbc9-0fe280691a1f tempest-CreateVolumesFromImageTest-1130093192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b787fc2-24a6-4b2e-911c-2ca0ff084d37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:29:50 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-29e7eb18-ee16-4791-bbc9-0fe280691a1f tempest-CreateVolumesFromImageTest-1130093192 None] Volume 8ea13f9f-7608-4cd5-80ef-450b8d31e6cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ea13f9f-7608-4cd5-80ef-450b8d31e6cd', 'volume_size': 1} Sep 15 16:29:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-29e7eb18-ee16-4791-bbc9-0fe280691a1f tempest-CreateVolumesFromImageTest-1130093192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:29:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-29e7eb18-ee16-4791-bbc9-0fe280691a1f tempest-CreateVolumesFromImageTest-1130093192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:29:50 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-29e7eb18-ee16-4791-bbc9-0fe280691a1f tempest-CreateVolumesFromImageTest-1130093192 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:29:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1726433054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ea13f9f-7608-4cd5-80ef-450b8d31e6cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d17e31674042422586fad30c994415e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:29:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:29:50Z,use_quota=True,user_id='579c3f2fb69742469690d961de7b78b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:29:50 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-29e7eb18-ee16-4791-bbc9-0fe280691a1f tempest-CreateVolumesFromImageTest-1130093192 None] Creating volume 8ea13f9f-7608-4cd5-80ef-450b8d31e6cd {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:29:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-29e7eb18-ee16-4791-bbc9-0fe280691a1f tempest-CreateVolumesFromImageTest-1130093192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:29:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-29e7eb18-ee16-4791-bbc9-0fe280691a1f tempest-CreateVolumesFromImageTest-1130093192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:29:50 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-29e7eb18-ee16-4791-bbc9-0fe280691a1f tempest-CreateVolumesFromImageTest-1130093192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:29:50 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-29e7eb18-ee16-4791-bbc9-0fe280691a1f tempest-CreateVolumesFromImageTest-1130093192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:29:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-29e7eb18-ee16-4791-bbc9-0fe280691a1f tempest-CreateVolumesFromImageTest-1130093192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:29:50 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-29e7eb18-ee16-4791-bbc9-0fe280691a1f tempest-CreateVolumesFromImageTest-1130093192 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:29:50 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-29e7eb18-ee16-4791-bbc9-0fe280691a1f tempest-CreateVolumesFromImageTest-1130093192 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:29:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-29e7eb18-ee16-4791-bbc9-0fe280691a1f tempest-CreateVolumesFromImageTest-1130093192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-8ea13f9f-7608-4cd5-80ef-450b8d31e6cd 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:29:50 devstack sudo[101509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-8ea13f9f-7608-4cd5-80ef-450b8d31e6cd 1073741824 Sep 15 16:29:50 devstack sudo[101509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:29:50 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-268a6519-e781-47b9-8675-f23a6c72e43b tempest-CreateVolumesFromImageTest-1130093192 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:29:50 devstack sudo[101507]: pam_unix(sudo:session): session closed for user root Sep 15 16:29:50 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-268a6519-e781-47b9-8675-f23a6c72e43b tempest-CreateVolumesFromImageTest-1130093192 None] Flow 'volume_create_manager' (a006b119-33e3-4829-a465-cf9a84f71ba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:29:50 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-268a6519-e781-47b9-8675-f23a6c72e43b tempest-CreateVolumesFromImageTest-1130093192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f33d4f99-9d30-43f1-a670-99746d09d25d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:29:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a410175c-111f-4f9f-8ec6-5db79e699959 tempest-VolumesImageMetadata-1361349044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ed959408-c602-4ab8-b837-6c68b017571e 1G" returned: 0 in 0.461s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:29:50 devstack cinder-volume[86082]: DEBUG cinder.volume.volume_utils [None req-a410175c-111f-4f9f-8ec6-5db79e699959 tempest-VolumesImageMetadata-1361349044 None] Downloaded image 0ea392d9-2af0-468e-bdc1-5e3f34bc52e6 ((None, [{'url': 'file:///opt/stack/data/glance/images/0ea392d9-2af0-468e-bdc1-5e3f34bc52e6', 'metadata': {}}])) to volume ed959408-c602-4ab8-b837-6c68b017571e successfully. {{(pid=86082) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 15 16:29:50 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-a410175c-111f-4f9f-8ec6-5db79e699959 tempest-VolumesImageMetadata-1361349044 None] Temporary image 0ea392d9-2af0-468e-bdc1-5e3f34bc52e6 for user 4641398bebf648ff94d3648e5967372a is deleted. {{(pid=86082) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 15 16:29:50 devstack cinder-volume[86082]: DEBUG cinder.volume.volume_utils [None req-a410175c-111f-4f9f-8ec6-5db79e699959 tempest-VolumesImageMetadata-1361349044 None] Marking volume ed959408-c602-4ab8-b837-6c68b017571e as bootable. {{(pid=86082) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 15 16:29:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-268a6519-e781-47b9-8675-f23a6c72e43b tempest-CreateVolumesFromImageTest-1130093192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f33d4f99-9d30-43f1-a670-99746d09d25d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:29:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-159172676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82e241a9-e3c9-4522-9a2b-9d9ca166b5cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d17e31674042422586fad30c994415e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:29:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:29:51Z,use_quota=True,user_id='579c3f2fb69742469690d961de7b78b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:29:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-268a6519-e781-47b9-8675-f23a6c72e43b tempest-CreateVolumesFromImageTest-1130093192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32b45c00-ff3e-4616-b0cc-d74cfca34d02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:29:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-268a6519-e781-47b9-8675-f23a6c72e43b tempest-CreateVolumesFromImageTest-1130093192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32b45c00-ff3e-4616-b0cc-d74cfca34d02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:29:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-268a6519-e781-47b9-8675-f23a6c72e43b tempest-CreateVolumesFromImageTest-1130093192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (402b3903-0527-4c4a-b5fd-4755a2b487ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:29:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-268a6519-e781-47b9-8675-f23a6c72e43b tempest-CreateVolumesFromImageTest-1130093192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (402b3903-0527-4c4a-b5fd-4755a2b487ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82e241a9-e3c9-4522-9a2b-9d9ca166b5cb', 'volume_name': 'volume-82e241a9-e3c9-4522-9a2b-9d9ca166b5cb', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:29:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-268a6519-e781-47b9-8675-f23a6c72e43b tempest-CreateVolumesFromImageTest-1130093192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00823de0-0dfd-4acb-aced-e269fe4e987c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:29:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-268a6519-e781-47b9-8675-f23a6c72e43b tempest-CreateVolumesFromImageTest-1130093192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00823de0-0dfd-4acb-aced-e269fe4e987c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:29:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-268a6519-e781-47b9-8675-f23a6c72e43b tempest-CreateVolumesFromImageTest-1130093192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9401e58d-e45e-4803-9e52-a8355cd67607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:29:51 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-268a6519-e781-47b9-8675-f23a6c72e43b tempest-CreateVolumesFromImageTest-1130093192 None] Volume 82e241a9-e3c9-4522-9a2b-9d9ca166b5cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82e241a9-e3c9-4522-9a2b-9d9ca166b5cb', 'volume_size': 1} Sep 15 16:29:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-268a6519-e781-47b9-8675-f23a6c72e43b tempest-CreateVolumesFromImageTest-1130093192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:29:51 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-a410175c-111f-4f9f-8ec6-5db79e699959 tempest-VolumesImageMetadata-1361349044 None] Copying metadata from image 0ea392d9-2af0-468e-bdc1-5e3f34bc52e6 to ed959408-c602-4ab8-b837-6c68b017571e. {{(pid=86082) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 15 16:29:51 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-a410175c-111f-4f9f-8ec6-5db79e699959 tempest-VolumesImageMetadata-1361349044 None] Creating volume glance metadata for volume ed959408-c602-4ab8-b837-6c68b017571e backed by image 0ea392d9-2af0-468e-bdc1-5e3f34bc52e6 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '0ea392d9-2af0-468e-bdc1-5e3f34bc52e6', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86082) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 15 16:29:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-a410175c-111f-4f9f-8ec6-5db79e699959 tempest-VolumesImageMetadata-1361349044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e9fab40-1ec0-4bcf-bba5-5edac7beb016) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed959408-c602-4ab8-b837-6c68b017571e', 'volume_size': 1, 'image_id': '0ea392d9-2af0-468e-bdc1-5e3f34bc52e6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0ea392d9-2af0-468e-bdc1-5e3f34bc52e6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e57b859e1a41428083b6d86ce51f5184', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0ea392d9-2af0-468e-bdc1-5e3f34bc52e6', 'created_at': datetime.datetime(2026, 9, 15, 14, 11, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 15, 14, 11, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0ea392d9-2af0-468e-bdc1-5e3f34bc52e6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:29:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-a410175c-111f-4f9f-8ec6-5db79e699959 tempest-VolumesImageMetadata-1361349044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fb3eb28-46c1-4658-ad25-852422f00140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:29:51 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-a410175c-111f-4f9f-8ec6-5db79e699959 tempest-VolumesImageMetadata-1361349044 None] Volume volume-ed959408-c602-4ab8-b837-6c68b017571e (ed959408-c602-4ab8-b837-6c68b017571e): created successfully Sep 15 16:29:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-a410175c-111f-4f9f-8ec6-5db79e699959 tempest-VolumesImageMetadata-1361349044 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fb3eb28-46c1-4658-ad25-852422f00140) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:29:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-a410175c-111f-4f9f-8ec6-5db79e699959 tempest-VolumesImageMetadata-1361349044 None] Flow 'volume_create_manager' (6a13eedc-ff5a-450e-9ff6-008acc015fd7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:29:51 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-a410175c-111f-4f9f-8ec6-5db79e699959 tempest-VolumesImageMetadata-1361349044 None] Created volume successfully. Sep 15 16:29:51 devstack sudo[101509]: pam_unix(sudo:session): session closed for user root Sep 15 16:29:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-29e7eb18-ee16-4791-bbc9-0fe280691a1f tempest-CreateVolumesFromImageTest-1130093192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-8ea13f9f-7608-4cd5-80ef-450b8d31e6cd 1073741824" returned: 0 in 0.617s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:29:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-29e7eb18-ee16-4791-bbc9-0fe280691a1f tempest-CreateVolumesFromImageTest-1130093192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-8ea13f9f-7608-4cd5-80ef-450b8d31e6cd {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:29:51 devstack sudo[101519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-8ea13f9f-7608-4cd5-80ef-450b8d31e6cd Sep 15 16:29:51 devstack sudo[101519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:29:51 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e74ddef-0db7-4fe0-a89f-b7f88bc0e4a8 tempest-CreateVolumesFromImageTest-1130093192 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:29:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0e74ddef-0db7-4fe0-a89f-b7f88bc0e4a8 tempest-CreateVolumesFromImageTest-1130093192 None] Flow 'volume_create_manager' (5736b06d-e512-4328-a8fc-685bd2dc255d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:29:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0e74ddef-0db7-4fe0-a89f-b7f88bc0e4a8 tempest-CreateVolumesFromImageTest-1130093192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d16fb03-9879-4326-be4e-f877144adeb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:29:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0e74ddef-0db7-4fe0-a89f-b7f88bc0e4a8 tempest-CreateVolumesFromImageTest-1130093192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d16fb03-9879-4326-be4e-f877144adeb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:29:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1393175068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=106421ec-ac6a-494d-9953-ea3a8bf11ce1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d17e31674042422586fad30c994415e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:29:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:29:51Z,use_quota=True,user_id='579c3f2fb69742469690d961de7b78b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:29:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0e74ddef-0db7-4fe0-a89f-b7f88bc0e4a8 tempest-CreateVolumesFromImageTest-1130093192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fb5e765-b69a-4dcc-b270-6fc4075151cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:29:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0e74ddef-0db7-4fe0-a89f-b7f88bc0e4a8 tempest-CreateVolumesFromImageTest-1130093192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4fb5e765-b69a-4dcc-b270-6fc4075151cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:29:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0e74ddef-0db7-4fe0-a89f-b7f88bc0e4a8 tempest-CreateVolumesFromImageTest-1130093192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5167621f-a0f2-4d37-b96e-14b9e67c3421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:29:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0e74ddef-0db7-4fe0-a89f-b7f88bc0e4a8 tempest-CreateVolumesFromImageTest-1130093192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5167621f-a0f2-4d37-b96e-14b9e67c3421) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '106421ec-ac6a-494d-9953-ea3a8bf11ce1', 'volume_name': 'volume-106421ec-ac6a-494d-9953-ea3a8bf11ce1', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:29:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0e74ddef-0db7-4fe0-a89f-b7f88bc0e4a8 tempest-CreateVolumesFromImageTest-1130093192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (beef4d9a-43f8-4304-95c2-ea54196d0a8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:29:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0e74ddef-0db7-4fe0-a89f-b7f88bc0e4a8 tempest-CreateVolumesFromImageTest-1130093192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (beef4d9a-43f8-4304-95c2-ea54196d0a8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:29:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0e74ddef-0db7-4fe0-a89f-b7f88bc0e4a8 tempest-CreateVolumesFromImageTest-1130093192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02a9e8f5-de01-43e9-a9df-a345a89ed312) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:29:51 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-0e74ddef-0db7-4fe0-a89f-b7f88bc0e4a8 tempest-CreateVolumesFromImageTest-1130093192 None] Volume 106421ec-ac6a-494d-9953-ea3a8bf11ce1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-106421ec-ac6a-494d-9953-ea3a8bf11ce1', 'volume_size': 1} Sep 15 16:29:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-0e74ddef-0db7-4fe0-a89f-b7f88bc0e4a8 tempest-CreateVolumesFromImageTest-1130093192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:29:51 devstack sudo[101519]: pam_unix(sudo:session): session closed for user root Sep 15 16:29:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-29e7eb18-ee16-4791-bbc9-0fe280691a1f tempest-CreateVolumesFromImageTest-1130093192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-8ea13f9f-7608-4cd5-80ef-450b8d31e6cd" returned: 0 in 0.350s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:29:51 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-29e7eb18-ee16-4791-bbc9-0fe280691a1f tempest-CreateVolumesFromImageTest-1130093192 None] <== create_volume: return (1011ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:29:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-29e7eb18-ee16-4791-bbc9-0fe280691a1f tempest-CreateVolumesFromImageTest-1130093192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.015s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:29:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-268a6519-e781-47b9-8675-f23a6c72e43b tempest-CreateVolumesFromImageTest-1130093192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.625s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:29:51 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-268a6519-e781-47b9-8675-f23a6c72e43b tempest-CreateVolumesFromImageTest-1130093192 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:29:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-159172676',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82e241a9-e3c9-4522-9a2b-9d9ca166b5cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d17e31674042422586fad30c994415e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:29:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:29:51Z,use_quota=True,user_id='579c3f2fb69742469690d961de7b78b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:29:51 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-268a6519-e781-47b9-8675-f23a6c72e43b tempest-CreateVolumesFromImageTest-1130093192 None] Creating volume 82e241a9-e3c9-4522-9a2b-9d9ca166b5cb {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:29:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-268a6519-e781-47b9-8675-f23a6c72e43b tempest-CreateVolumesFromImageTest-1130093192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:29:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-268a6519-e781-47b9-8675-f23a6c72e43b tempest-CreateVolumesFromImageTest-1130093192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:29:51 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-268a6519-e781-47b9-8675-f23a6c72e43b tempest-CreateVolumesFromImageTest-1130093192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:29:51 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-268a6519-e781-47b9-8675-f23a6c72e43b tempest-CreateVolumesFromImageTest-1130093192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:29:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-268a6519-e781-47b9-8675-f23a6c72e43b tempest-CreateVolumesFromImageTest-1130093192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:29:51 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-268a6519-e781-47b9-8675-f23a6c72e43b tempest-CreateVolumesFromImageTest-1130093192 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:29:51 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-268a6519-e781-47b9-8675-f23a6c72e43b tempest-CreateVolumesFromImageTest-1130093192 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:29:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-268a6519-e781-47b9-8675-f23a6c72e43b tempest-CreateVolumesFromImageTest-1130093192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-82e241a9-e3c9-4522-9a2b-9d9ca166b5cb 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:29:51 devstack sudo[101522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-82e241a9-e3c9-4522-9a2b-9d9ca166b5cb 1073741824 Sep 15 16:29:51 devstack sudo[101522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:29:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-29e7eb18-ee16-4791-bbc9-0fe280691a1f tempest-CreateVolumesFromImageTest-1130093192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b787fc2-24a6-4b2e-911c-2ca0ff084d37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ea13f9f-7608-4cd5-80ef-450b8d31e6cd', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:29:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-29e7eb18-ee16-4791-bbc9-0fe280691a1f tempest-CreateVolumesFromImageTest-1130093192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26c25e4e-e945-42f1-88b6-c13d8c98e7fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:29:51 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-29e7eb18-ee16-4791-bbc9-0fe280691a1f tempest-CreateVolumesFromImageTest-1130093192 None] Volume volume-8ea13f9f-7608-4cd5-80ef-450b8d31e6cd (8ea13f9f-7608-4cd5-80ef-450b8d31e6cd): created successfully Sep 15 16:29:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-29e7eb18-ee16-4791-bbc9-0fe280691a1f tempest-CreateVolumesFromImageTest-1130093192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26c25e4e-e945-42f1-88b6-c13d8c98e7fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:29:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-29e7eb18-ee16-4791-bbc9-0fe280691a1f tempest-CreateVolumesFromImageTest-1130093192 None] Flow 'volume_create_manager' (18845a27-c88d-48ae-bd4b-e09802c15446) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:29:51 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b3fc115-021f-49fe-8781-43868ac41ed1 tempest-CreateVolumesFromImageTest-1130093192 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:29:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0b3fc115-021f-49fe-8781-43868ac41ed1 tempest-CreateVolumesFromImageTest-1130093192 None] Flow 'volume_create_manager' (acc991fc-90a1-4e4e-bb28-0d95dc0af7bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:29:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0b3fc115-021f-49fe-8781-43868ac41ed1 tempest-CreateVolumesFromImageTest-1130093192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d25b916-4e4b-4316-975d-e2b0eadf72f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:29:51 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-29e7eb18-ee16-4791-bbc9-0fe280691a1f tempest-CreateVolumesFromImageTest-1130093192 None] Created volume successfully. Sep 15 16:29:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0b3fc115-021f-49fe-8781-43868ac41ed1 tempest-CreateVolumesFromImageTest-1130093192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d25b916-4e4b-4316-975d-e2b0eadf72f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:29:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-355468992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db4af04c-240c-4be5-96ed-80035cadf8d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d17e31674042422586fad30c994415e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:29:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:29:52Z,use_quota=True,user_id='579c3f2fb69742469690d961de7b78b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:29:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0b3fc115-021f-49fe-8781-43868ac41ed1 tempest-CreateVolumesFromImageTest-1130093192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (155c2661-5577-4ae5-90ee-ed772379a5a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:29:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0b3fc115-021f-49fe-8781-43868ac41ed1 tempest-CreateVolumesFromImageTest-1130093192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (155c2661-5577-4ae5-90ee-ed772379a5a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:29:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0b3fc115-021f-49fe-8781-43868ac41ed1 tempest-CreateVolumesFromImageTest-1130093192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1924f66f-758e-4c35-805a-04608ba488f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:29:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0b3fc115-021f-49fe-8781-43868ac41ed1 tempest-CreateVolumesFromImageTest-1130093192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1924f66f-758e-4c35-805a-04608ba488f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db4af04c-240c-4be5-96ed-80035cadf8d0', 'volume_name': 'volume-db4af04c-240c-4be5-96ed-80035cadf8d0', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:29:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0b3fc115-021f-49fe-8781-43868ac41ed1 tempest-CreateVolumesFromImageTest-1130093192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83eb2b5b-93fa-47e1-aaaa-e7153cc2b8f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:29:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0b3fc115-021f-49fe-8781-43868ac41ed1 tempest-CreateVolumesFromImageTest-1130093192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83eb2b5b-93fa-47e1-aaaa-e7153cc2b8f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:29:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0b3fc115-021f-49fe-8781-43868ac41ed1 tempest-CreateVolumesFromImageTest-1130093192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c4dab10-7b20-4a04-a622-67b70fa3cc7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:29:51 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-0b3fc115-021f-49fe-8781-43868ac41ed1 tempest-CreateVolumesFromImageTest-1130093192 None] Volume db4af04c-240c-4be5-96ed-80035cadf8d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db4af04c-240c-4be5-96ed-80035cadf8d0', 'volume_size': 1} Sep 15 16:29:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-0b3fc115-021f-49fe-8781-43868ac41ed1 tempest-CreateVolumesFromImageTest-1130093192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:29:52 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-03d814a1-5947-4cce-be08-1c9eaca8a7b5 tempest-VolumesImageMetadata-1361349044 None] Acquiring lock "cinder-ed959408-c602-4ab8-b837-6c68b017571e-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:29:52 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf7ee5d9-295a-4f1c-90e5-6b3a917bcf2c tempest-CreateVolumesFromImageTest-1130093192 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:29:52 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-cf7ee5d9-295a-4f1c-90e5-6b3a917bcf2c tempest-CreateVolumesFromImageTest-1130093192 None] Flow 'volume_create_manager' (930f7ac5-1de1-4b67-93c2-19fd20072c64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:29:52 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-cf7ee5d9-295a-4f1c-90e5-6b3a917bcf2c tempest-CreateVolumesFromImageTest-1130093192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2119aa93-740e-465e-a5e6-c4ef396280b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:29:52 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-cf7ee5d9-295a-4f1c-90e5-6b3a917bcf2c tempest-CreateVolumesFromImageTest-1130093192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2119aa93-740e-465e-a5e6-c4ef396280b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:29:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-634586470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac73af4d-4a0a-4ac1-938b-7a79063a487b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d17e31674042422586fad30c994415e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:29:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:29:52Z,use_quota=True,user_id='579c3f2fb69742469690d961de7b78b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:29:52 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-cf7ee5d9-295a-4f1c-90e5-6b3a917bcf2c tempest-CreateVolumesFromImageTest-1130093192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a039bb2-f220-44c2-9cda-a2186b3675f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:29:52 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-cf7ee5d9-295a-4f1c-90e5-6b3a917bcf2c tempest-CreateVolumesFromImageTest-1130093192 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a039bb2-f220-44c2-9cda-a2186b3675f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:29:52 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-cf7ee5d9-295a-4f1c-90e5-6b3a917bcf2c tempest-CreateVolumesFromImageTest-1130093192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (325d9b32-8ef0-4988-9b16-2b4a30cab49e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:29:52 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-cf7ee5d9-295a-4f1c-90e5-6b3a917bcf2c tempest-CreateVolumesFromImageTest-1130093192 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (325d9b32-8ef0-4988-9b16-2b4a30cab49e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac73af4d-4a0a-4ac1-938b-7a79063a487b', 'volume_name': 'volume-ac73af4d-4a0a-4ac1-938b-7a79063a487b', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:29:52 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-cf7ee5d9-295a-4f1c-90e5-6b3a917bcf2c tempest-CreateVolumesFromImageTest-1130093192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7693785d-a799-4dfa-9bfd-98f30776639b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:29:52 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-cf7ee5d9-295a-4f1c-90e5-6b3a917bcf2c tempest-CreateVolumesFromImageTest-1130093192 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7693785d-a799-4dfa-9bfd-98f30776639b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:29:52 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-cf7ee5d9-295a-4f1c-90e5-6b3a917bcf2c tempest-CreateVolumesFromImageTest-1130093192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62ebe363-21b2-48d6-9576-1470cf28e3e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:29:52 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-cf7ee5d9-295a-4f1c-90e5-6b3a917bcf2c tempest-CreateVolumesFromImageTest-1130093192 None] Volume ac73af4d-4a0a-4ac1-938b-7a79063a487b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac73af4d-4a0a-4ac1-938b-7a79063a487b', 'volume_size': 1} Sep 15 16:29:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-cf7ee5d9-295a-4f1c-90e5-6b3a917bcf2c tempest-CreateVolumesFromImageTest-1130093192 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:29:52 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-03d814a1-5947-4cce-be08-1c9eaca8a7b5 tempest-VolumesImageMetadata-1361349044 None] Lock "cinder-ed959408-c602-4ab8-b837-6c68b017571e-delete_volume" acquired by "delete_volume" :: waited 0.121s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:29:52 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-03d814a1-5947-4cce-be08-1c9eaca8a7b5 tempest-VolumesImageMetadata-1361349044 None] Acquiring lock "cinder-quobyte-ed959408-c602-4ab8-b837-6c68b017571e" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:29:52 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-03d814a1-5947-4cce-be08-1c9eaca8a7b5 tempest-VolumesImageMetadata-1361349044 None] Lock "cinder-quobyte-ed959408-c602-4ab8-b837-6c68b017571e" acquired by "delete_volume" :: waited 0.013s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:29:52 devstack sudo[101522]: pam_unix(sudo:session): session closed for user root Sep 15 16:29:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-268a6519-e781-47b9-8675-f23a6c72e43b tempest-CreateVolumesFromImageTest-1130093192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-82e241a9-e3c9-4522-9a2b-9d9ca166b5cb 1073741824" returned: 0 in 0.672s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:29:52 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f18f354-bbb9-45a9-844a-4e059bd8d4bd]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:29:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-03d814a1-5947-4cce-be08-1c9eaca8a7b5 tempest-VolumesImageMetadata-1361349044 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ed959408-c602-4ab8-b837-6c68b017571e {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:29:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-268a6519-e781-47b9-8675-f23a6c72e43b tempest-CreateVolumesFromImageTest-1130093192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-82e241a9-e3c9-4522-9a2b-9d9ca166b5cb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:29:52 devstack sudo[101530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-82e241a9-e3c9-4522-9a2b-9d9ca166b5cb Sep 15 16:29:52 devstack sudo[101530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:29:52 devstack sudo[101529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ed959408-c602-4ab8-b837-6c68b017571e Sep 15 16:29:52 devstack sudo[101529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:29:52 devstack sudo[101530]: pam_unix(sudo:session): session closed for user root Sep 15 16:29:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-268a6519-e781-47b9-8675-f23a6c72e43b tempest-CreateVolumesFromImageTest-1130093192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-82e241a9-e3c9-4522-9a2b-9d9ca166b5cb" returned: 0 in 0.264s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:29:52 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-268a6519-e781-47b9-8675-f23a6c72e43b tempest-CreateVolumesFromImageTest-1130093192 None] <== create_volume: return (1000ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:29:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-268a6519-e781-47b9-8675-f23a6c72e43b tempest-CreateVolumesFromImageTest-1130093192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.006s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:29:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-0e74ddef-0db7-4fe0-a89f-b7f88bc0e4a8 tempest-CreateVolumesFromImageTest-1130093192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.203s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:29:52 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-0e74ddef-0db7-4fe0-a89f-b7f88bc0e4a8 tempest-CreateVolumesFromImageTest-1130093192 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:29:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1393175068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=106421ec-ac6a-494d-9953-ea3a8bf11ce1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d17e31674042422586fad30c994415e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:29:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:29:51Z,use_quota=True,user_id='579c3f2fb69742469690d961de7b78b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:29:52 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-0e74ddef-0db7-4fe0-a89f-b7f88bc0e4a8 tempest-CreateVolumesFromImageTest-1130093192 None] Creating volume 106421ec-ac6a-494d-9953-ea3a8bf11ce1 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:29:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-0e74ddef-0db7-4fe0-a89f-b7f88bc0e4a8 tempest-CreateVolumesFromImageTest-1130093192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:29:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-0e74ddef-0db7-4fe0-a89f-b7f88bc0e4a8 tempest-CreateVolumesFromImageTest-1130093192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:29:52 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-0e74ddef-0db7-4fe0-a89f-b7f88bc0e4a8 tempest-CreateVolumesFromImageTest-1130093192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:29:52 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-0e74ddef-0db7-4fe0-a89f-b7f88bc0e4a8 tempest-CreateVolumesFromImageTest-1130093192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:29:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-0e74ddef-0db7-4fe0-a89f-b7f88bc0e4a8 tempest-CreateVolumesFromImageTest-1130093192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:29:52 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-0e74ddef-0db7-4fe0-a89f-b7f88bc0e4a8 tempest-CreateVolumesFromImageTest-1130093192 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:29:52 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-0e74ddef-0db7-4fe0-a89f-b7f88bc0e4a8 tempest-CreateVolumesFromImageTest-1130093192 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:29:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0e74ddef-0db7-4fe0-a89f-b7f88bc0e4a8 tempest-CreateVolumesFromImageTest-1130093192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-106421ec-ac6a-494d-9953-ea3a8bf11ce1 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:29:52 devstack sudo[101537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-106421ec-ac6a-494d-9953-ea3a8bf11ce1 1073741824 Sep 15 16:29:52 devstack sudo[101537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:29:52 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-268a6519-e781-47b9-8675-f23a6c72e43b tempest-CreateVolumesFromImageTest-1130093192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9401e58d-e45e-4803-9e52-a8355cd67607) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82e241a9-e3c9-4522-9a2b-9d9ca166b5cb', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:29:52 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-268a6519-e781-47b9-8675-f23a6c72e43b tempest-CreateVolumesFromImageTest-1130093192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d51cf524-ac51-40da-b54d-a9e5ef60768c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:29:52 devstack sudo[101529]: pam_unix(sudo:session): session closed for user root Sep 15 16:29:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-03d814a1-5947-4cce-be08-1c9eaca8a7b5 tempest-VolumesImageMetadata-1361349044 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ed959408-c602-4ab8-b837-6c68b017571e" returned: 0 in 0.370s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:29:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-03d814a1-5947-4cce-be08-1c9eaca8a7b5 tempest-VolumesImageMetadata-1361349044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ed959408-c602-4ab8-b837-6c68b017571e {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:29:52 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-268a6519-e781-47b9-8675-f23a6c72e43b tempest-CreateVolumesFromImageTest-1130093192 None] Volume volume-82e241a9-e3c9-4522-9a2b-9d9ca166b5cb (82e241a9-e3c9-4522-9a2b-9d9ca166b5cb): created successfully Sep 15 16:29:52 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-268a6519-e781-47b9-8675-f23a6c72e43b tempest-CreateVolumesFromImageTest-1130093192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d51cf524-ac51-40da-b54d-a9e5ef60768c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:29:52 devstack sudo[101539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ed959408-c602-4ab8-b837-6c68b017571e Sep 15 16:29:52 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-268a6519-e781-47b9-8675-f23a6c72e43b tempest-CreateVolumesFromImageTest-1130093192 None] Flow 'volume_create_manager' (a006b119-33e3-4829-a465-cf9a84f71ba2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:29:52 devstack sudo[101539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:29:52 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-268a6519-e781-47b9-8675-f23a6c72e43b tempest-CreateVolumesFromImageTest-1130093192 None] Created volume successfully. Sep 15 16:29:52 devstack sudo[101539]: pam_unix(sudo:session): session closed for user root Sep 15 16:29:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-03d814a1-5947-4cce-be08-1c9eaca8a7b5 tempest-VolumesImageMetadata-1361349044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ed959408-c602-4ab8-b837-6c68b017571e" returned: 0 in 0.242s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:29:53 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-03d814a1-5947-4cce-be08-1c9eaca8a7b5 tempest-VolumesImageMetadata-1361349044 None] Lock "cinder-quobyte-ed959408-c602-4ab8-b837-6c68b017571e" released by "delete_volume" :: held 0.652s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:29:53 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-03d814a1-5947-4cce-be08-1c9eaca8a7b5 tempest-VolumesImageMetadata-1361349044 None] Created reservations ['83661bb6-0de1-4176-a9d2-32a7e80ead66', 'cf4f2663-8589-42c6-a564-0f58c67a56f0', '4a913e5f-80f8-49f7-a816-34cef2c67f1a', '85c7b112-eda4-4a24-800f-5ea4ed56cdc0'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:29:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-03d814a1-5947-4cce-be08-1c9eaca8a7b5 tempest-VolumesImageMetadata-1361349044 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:29:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-03d814a1-5947-4cce-be08-1c9eaca8a7b5 tempest-VolumesImageMetadata-1361349044 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:29:53 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-03d814a1-5947-4cce-be08-1c9eaca8a7b5 tempest-VolumesImageMetadata-1361349044 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:29:53 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-03d814a1-5947-4cce-be08-1c9eaca8a7b5 tempest-VolumesImageMetadata-1361349044 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:29:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-03d814a1-5947-4cce-be08-1c9eaca8a7b5 tempest-VolumesImageMetadata-1361349044 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:29:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-03d814a1-5947-4cce-be08-1c9eaca8a7b5 tempest-VolumesImageMetadata-1361349044 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:29:53 devstack sudo[101546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:29:53 devstack sudo[101546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:29:53 devstack sudo[101537]: pam_unix(sudo:session): session closed for user root Sep 15 16:29:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0e74ddef-0db7-4fe0-a89f-b7f88bc0e4a8 tempest-CreateVolumesFromImageTest-1130093192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-106421ec-ac6a-494d-9953-ea3a8bf11ce1 1073741824" returned: 0 in 0.480s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:29:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0e74ddef-0db7-4fe0-a89f-b7f88bc0e4a8 tempest-CreateVolumesFromImageTest-1130093192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-106421ec-ac6a-494d-9953-ea3a8bf11ce1 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:29:53 devstack sudo[101548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-106421ec-ac6a-494d-9953-ea3a8bf11ce1 Sep 15 16:29:53 devstack sudo[101548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:29:53 devstack sudo[101546]: pam_unix(sudo:session): session closed for user root Sep 15 16:29:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-03d814a1-5947-4cce-be08-1c9eaca8a7b5 tempest-VolumesImageMetadata-1361349044 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.262s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:29:53 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-03d814a1-5947-4cce-be08-1c9eaca8a7b5 tempest-VolumesImageMetadata-1361349044 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:29:53 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-03d814a1-5947-4cce-be08-1c9eaca8a7b5 tempest-VolumesImageMetadata-1361349044 None] Deleted volume successfully. Sep 15 16:29:53 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-03d814a1-5947-4cce-be08-1c9eaca8a7b5 tempest-VolumesImageMetadata-1361349044 None] Lock "cinder-ed959408-c602-4ab8-b837-6c68b017571e-delete_volume" released by "delete_volume" :: held 1.121s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:29:53 devstack sudo[101548]: pam_unix(sudo:session): session closed for user root Sep 15 16:29:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0e74ddef-0db7-4fe0-a89f-b7f88bc0e4a8 tempest-CreateVolumesFromImageTest-1130093192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-106421ec-ac6a-494d-9953-ea3a8bf11ce1" returned: 0 in 0.271s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:29:53 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-0e74ddef-0db7-4fe0-a89f-b7f88bc0e4a8 tempest-CreateVolumesFromImageTest-1130093192 None] <== create_volume: return (793ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:29:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-0e74ddef-0db7-4fe0-a89f-b7f88bc0e4a8 tempest-CreateVolumesFromImageTest-1130093192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.797s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:29:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-0b3fc115-021f-49fe-8781-43868ac41ed1 tempest-CreateVolumesFromImageTest-1130093192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.571s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:29:53 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-0b3fc115-021f-49fe-8781-43868ac41ed1 tempest-CreateVolumesFromImageTest-1130093192 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:29:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-355468992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db4af04c-240c-4be5-96ed-80035cadf8d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d17e31674042422586fad30c994415e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:29:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:29:52Z,use_quota=True,user_id='579c3f2fb69742469690d961de7b78b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:29:53 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-0b3fc115-021f-49fe-8781-43868ac41ed1 tempest-CreateVolumesFromImageTest-1130093192 None] Creating volume db4af04c-240c-4be5-96ed-80035cadf8d0 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:29:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-0b3fc115-021f-49fe-8781-43868ac41ed1 tempest-CreateVolumesFromImageTest-1130093192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:29:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-0b3fc115-021f-49fe-8781-43868ac41ed1 tempest-CreateVolumesFromImageTest-1130093192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:29:53 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-0b3fc115-021f-49fe-8781-43868ac41ed1 tempest-CreateVolumesFromImageTest-1130093192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:29:53 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-0b3fc115-021f-49fe-8781-43868ac41ed1 tempest-CreateVolumesFromImageTest-1130093192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:29:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-0b3fc115-021f-49fe-8781-43868ac41ed1 tempest-CreateVolumesFromImageTest-1130093192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:29:53 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-0b3fc115-021f-49fe-8781-43868ac41ed1 tempest-CreateVolumesFromImageTest-1130093192 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:29:53 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-0b3fc115-021f-49fe-8781-43868ac41ed1 tempest-CreateVolumesFromImageTest-1130093192 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:29:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0b3fc115-021f-49fe-8781-43868ac41ed1 tempest-CreateVolumesFromImageTest-1130093192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-db4af04c-240c-4be5-96ed-80035cadf8d0 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:29:53 devstack sudo[101552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-db4af04c-240c-4be5-96ed-80035cadf8d0 1073741824 Sep 15 16:29:53 devstack sudo[101552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:29:53 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0e74ddef-0db7-4fe0-a89f-b7f88bc0e4a8 tempest-CreateVolumesFromImageTest-1130093192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02a9e8f5-de01-43e9-a9df-a345a89ed312) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-106421ec-ac6a-494d-9953-ea3a8bf11ce1', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:29:53 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0e74ddef-0db7-4fe0-a89f-b7f88bc0e4a8 tempest-CreateVolumesFromImageTest-1130093192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70b56871-9196-44da-97e7-91de67c646ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:29:53 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-0e74ddef-0db7-4fe0-a89f-b7f88bc0e4a8 tempest-CreateVolumesFromImageTest-1130093192 None] Volume volume-106421ec-ac6a-494d-9953-ea3a8bf11ce1 (106421ec-ac6a-494d-9953-ea3a8bf11ce1): created successfully Sep 15 16:29:53 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0e74ddef-0db7-4fe0-a89f-b7f88bc0e4a8 tempest-CreateVolumesFromImageTest-1130093192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70b56871-9196-44da-97e7-91de67c646ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:29:53 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0e74ddef-0db7-4fe0-a89f-b7f88bc0e4a8 tempest-CreateVolumesFromImageTest-1130093192 None] Flow 'volume_create_manager' (5736b06d-e512-4328-a8fc-685bd2dc255d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:29:53 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-0e74ddef-0db7-4fe0-a89f-b7f88bc0e4a8 tempest-CreateVolumesFromImageTest-1130093192 None] Created volume successfully. Sep 15 16:29:53 devstack sudo[101552]: pam_unix(sudo:session): session closed for user root Sep 15 16:29:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0b3fc115-021f-49fe-8781-43868ac41ed1 tempest-CreateVolumesFromImageTest-1130093192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-db4af04c-240c-4be5-96ed-80035cadf8d0 1073741824" returned: 0 in 0.492s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:29:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0b3fc115-021f-49fe-8781-43868ac41ed1 tempest-CreateVolumesFromImageTest-1130093192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-db4af04c-240c-4be5-96ed-80035cadf8d0 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:29:54 devstack sudo[101558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-db4af04c-240c-4be5-96ed-80035cadf8d0 Sep 15 16:29:54 devstack sudo[101558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:29:54 devstack sudo[101558]: pam_unix(sudo:session): session closed for user root Sep 15 16:29:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0b3fc115-021f-49fe-8781-43868ac41ed1 tempest-CreateVolumesFromImageTest-1130093192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-db4af04c-240c-4be5-96ed-80035cadf8d0" returned: 0 in 0.275s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:29:54 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-0b3fc115-021f-49fe-8781-43868ac41ed1 tempest-CreateVolumesFromImageTest-1130093192 None] <== create_volume: return (806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:29:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-0b3fc115-021f-49fe-8781-43868ac41ed1 tempest-CreateVolumesFromImageTest-1130093192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.810s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:29:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-cf7ee5d9-295a-4f1c-90e5-6b3a917bcf2c tempest-CreateVolumesFromImageTest-1130093192 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:29:54 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-cf7ee5d9-295a-4f1c-90e5-6b3a917bcf2c tempest-CreateVolumesFromImageTest-1130093192 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:29:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-634586470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac73af4d-4a0a-4ac1-938b-7a79063a487b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d17e31674042422586fad30c994415e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:29:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:29:52Z,use_quota=True,user_id='579c3f2fb69742469690d961de7b78b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:29:54 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-cf7ee5d9-295a-4f1c-90e5-6b3a917bcf2c tempest-CreateVolumesFromImageTest-1130093192 None] Creating volume ac73af4d-4a0a-4ac1-938b-7a79063a487b {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:29:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-cf7ee5d9-295a-4f1c-90e5-6b3a917bcf2c tempest-CreateVolumesFromImageTest-1130093192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:29:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-cf7ee5d9-295a-4f1c-90e5-6b3a917bcf2c tempest-CreateVolumesFromImageTest-1130093192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:29:54 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-cf7ee5d9-295a-4f1c-90e5-6b3a917bcf2c tempest-CreateVolumesFromImageTest-1130093192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:29:54 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-cf7ee5d9-295a-4f1c-90e5-6b3a917bcf2c tempest-CreateVolumesFromImageTest-1130093192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:29:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-cf7ee5d9-295a-4f1c-90e5-6b3a917bcf2c tempest-CreateVolumesFromImageTest-1130093192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:29:54 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-cf7ee5d9-295a-4f1c-90e5-6b3a917bcf2c tempest-CreateVolumesFromImageTest-1130093192 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:29:54 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-cf7ee5d9-295a-4f1c-90e5-6b3a917bcf2c tempest-CreateVolumesFromImageTest-1130093192 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:29:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-cf7ee5d9-295a-4f1c-90e5-6b3a917bcf2c tempest-CreateVolumesFromImageTest-1130093192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ac73af4d-4a0a-4ac1-938b-7a79063a487b 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:29:54 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0b3fc115-021f-49fe-8781-43868ac41ed1 tempest-CreateVolumesFromImageTest-1130093192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c4dab10-7b20-4a04-a622-67b70fa3cc7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db4af04c-240c-4be5-96ed-80035cadf8d0', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:29:54 devstack sudo[101561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ac73af4d-4a0a-4ac1-938b-7a79063a487b 1073741824 Sep 15 16:29:54 devstack sudo[101561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:29:54 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0b3fc115-021f-49fe-8781-43868ac41ed1 tempest-CreateVolumesFromImageTest-1130093192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68b857e2-e52b-4d3b-8949-f1691b493a05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:29:54 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-0b3fc115-021f-49fe-8781-43868ac41ed1 tempest-CreateVolumesFromImageTest-1130093192 None] Volume volume-db4af04c-240c-4be5-96ed-80035cadf8d0 (db4af04c-240c-4be5-96ed-80035cadf8d0): created successfully Sep 15 16:29:54 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0b3fc115-021f-49fe-8781-43868ac41ed1 tempest-CreateVolumesFromImageTest-1130093192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68b857e2-e52b-4d3b-8949-f1691b493a05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:29:54 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0b3fc115-021f-49fe-8781-43868ac41ed1 tempest-CreateVolumesFromImageTest-1130093192 None] Flow 'volume_create_manager' (acc991fc-90a1-4e4e-bb28-0d95dc0af7bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:29:54 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-0b3fc115-021f-49fe-8781-43868ac41ed1 tempest-CreateVolumesFromImageTest-1130093192 None] Created volume successfully. Sep 15 16:29:54 devstack sudo[101561]: pam_unix(sudo:session): session closed for user root Sep 15 16:29:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-cf7ee5d9-295a-4f1c-90e5-6b3a917bcf2c tempest-CreateVolumesFromImageTest-1130093192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ac73af4d-4a0a-4ac1-938b-7a79063a487b 1073741824" returned: 0 in 0.524s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:29:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-cf7ee5d9-295a-4f1c-90e5-6b3a917bcf2c tempest-CreateVolumesFromImageTest-1130093192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ac73af4d-4a0a-4ac1-938b-7a79063a487b {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:29:54 devstack sudo[101567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ac73af4d-4a0a-4ac1-938b-7a79063a487b Sep 15 16:29:54 devstack sudo[101567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:29:55 devstack sudo[101567]: pam_unix(sudo:session): session closed for user root Sep 15 16:29:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-cf7ee5d9-295a-4f1c-90e5-6b3a917bcf2c tempest-CreateVolumesFromImageTest-1130093192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ac73af4d-4a0a-4ac1-938b-7a79063a487b" returned: 0 in 0.255s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:29:55 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-cf7ee5d9-295a-4f1c-90e5-6b3a917bcf2c tempest-CreateVolumesFromImageTest-1130093192 None] <== create_volume: return (831ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:29:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-cf7ee5d9-295a-4f1c-90e5-6b3a917bcf2c tempest-CreateVolumesFromImageTest-1130093192 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.833s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:29:55 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-cf7ee5d9-295a-4f1c-90e5-6b3a917bcf2c tempest-CreateVolumesFromImageTest-1130093192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (62ebe363-21b2-48d6-9576-1470cf28e3e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac73af4d-4a0a-4ac1-938b-7a79063a487b', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:29:55 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-cf7ee5d9-295a-4f1c-90e5-6b3a917bcf2c tempest-CreateVolumesFromImageTest-1130093192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf69ecd4-6998-4b2f-bc23-bab2989f575d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:29:55 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-cf7ee5d9-295a-4f1c-90e5-6b3a917bcf2c tempest-CreateVolumesFromImageTest-1130093192 None] Volume volume-ac73af4d-4a0a-4ac1-938b-7a79063a487b (ac73af4d-4a0a-4ac1-938b-7a79063a487b): created successfully Sep 15 16:29:55 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-cf7ee5d9-295a-4f1c-90e5-6b3a917bcf2c tempest-CreateVolumesFromImageTest-1130093192 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf69ecd4-6998-4b2f-bc23-bab2989f575d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:29:55 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-cf7ee5d9-295a-4f1c-90e5-6b3a917bcf2c tempest-CreateVolumesFromImageTest-1130093192 None] Flow 'volume_create_manager' (930f7ac5-1de1-4b67-93c2-19fd20072c64) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:29:55 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-cf7ee5d9-295a-4f1c-90e5-6b3a917bcf2c tempest-CreateVolumesFromImageTest-1130093192 None] Created volume successfully. Sep 15 16:29:55 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-5f203053-f5ca-474d-92b4-177965760d4c tempest-CreateVolumesFromImageTest-1130093192 None] Acquiring lock "cinder-ac73af4d-4a0a-4ac1-938b-7a79063a487b-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:29:55 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-5f203053-f5ca-474d-92b4-177965760d4c tempest-CreateVolumesFromImageTest-1130093192 None] Lock "cinder-ac73af4d-4a0a-4ac1-938b-7a79063a487b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:29:55 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-5f203053-f5ca-474d-92b4-177965760d4c tempest-CreateVolumesFromImageTest-1130093192 None] Acquiring lock "cinder-quobyte-ac73af4d-4a0a-4ac1-938b-7a79063a487b" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:29:55 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-5f203053-f5ca-474d-92b4-177965760d4c tempest-CreateVolumesFromImageTest-1130093192 None] Lock "cinder-quobyte-ac73af4d-4a0a-4ac1-938b-7a79063a487b" acquired by "delete_volume" :: waited 0.019s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:29:55 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[d461ddcb-e32a-4e0c-9b81-fd800e7d99eb]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:29:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5f203053-f5ca-474d-92b4-177965760d4c tempest-CreateVolumesFromImageTest-1130093192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ac73af4d-4a0a-4ac1-938b-7a79063a487b {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:29:55 devstack sudo[101570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ac73af4d-4a0a-4ac1-938b-7a79063a487b Sep 15 16:29:55 devstack sudo[101570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:29:56 devstack sudo[101570]: pam_unix(sudo:session): session closed for user root Sep 15 16:29:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5f203053-f5ca-474d-92b4-177965760d4c tempest-CreateVolumesFromImageTest-1130093192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ac73af4d-4a0a-4ac1-938b-7a79063a487b" returned: 0 in 0.376s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:29:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5f203053-f5ca-474d-92b4-177965760d4c tempest-CreateVolumesFromImageTest-1130093192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ac73af4d-4a0a-4ac1-938b-7a79063a487b {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:29:56 devstack sudo[101575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ac73af4d-4a0a-4ac1-938b-7a79063a487b Sep 15 16:29:56 devstack sudo[101575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:29:56 devstack sudo[101575]: pam_unix(sudo:session): session closed for user root Sep 15 16:29:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5f203053-f5ca-474d-92b4-177965760d4c tempest-CreateVolumesFromImageTest-1130093192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ac73af4d-4a0a-4ac1-938b-7a79063a487b" returned: 0 in 0.255s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:29:56 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-5f203053-f5ca-474d-92b4-177965760d4c tempest-CreateVolumesFromImageTest-1130093192 None] Lock "cinder-quobyte-ac73af4d-4a0a-4ac1-938b-7a79063a487b" released by "delete_volume" :: held 0.682s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:29:56 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-5f203053-f5ca-474d-92b4-177965760d4c tempest-CreateVolumesFromImageTest-1130093192 None] Created reservations ['4c1cb823-6cd2-4c7d-ad84-215c0843356e', '0fd3f16e-ac5b-4a22-90e7-b56b863264fe', '2e0aa618-8df0-4c3f-aafe-3d6e6a9fa7d8', '3076a7d6-695c-46bf-9e85-da83b38a1185'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:29:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-5f203053-f5ca-474d-92b4-177965760d4c tempest-CreateVolumesFromImageTest-1130093192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:29:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-5f203053-f5ca-474d-92b4-177965760d4c tempest-CreateVolumesFromImageTest-1130093192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:29:56 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-5f203053-f5ca-474d-92b4-177965760d4c tempest-CreateVolumesFromImageTest-1130093192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:29:56 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-5f203053-f5ca-474d-92b4-177965760d4c tempest-CreateVolumesFromImageTest-1130093192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:29:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-5f203053-f5ca-474d-92b4-177965760d4c tempest-CreateVolumesFromImageTest-1130093192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:29:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5f203053-f5ca-474d-92b4-177965760d4c tempest-CreateVolumesFromImageTest-1130093192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:29:56 devstack sudo[101578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:29:56 devstack sudo[101578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:29:56 devstack sudo[101578]: pam_unix(sudo:session): session closed for user root Sep 15 16:29:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5f203053-f5ca-474d-92b4-177965760d4c tempest-CreateVolumesFromImageTest-1130093192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.250s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:29:56 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-5f203053-f5ca-474d-92b4-177965760d4c tempest-CreateVolumesFromImageTest-1130093192 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:29:56 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-5f203053-f5ca-474d-92b4-177965760d4c tempest-CreateVolumesFromImageTest-1130093192 None] Deleted volume successfully. Sep 15 16:29:56 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-8ea4a8de-4cd5-4731-ba37-fe8e87a817b6 tempest-CreateVolumesFromImageTest-1130093192 None] Acquiring lock "cinder-db4af04c-240c-4be5-96ed-80035cadf8d0-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:29:56 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-5f203053-f5ca-474d-92b4-177965760d4c tempest-CreateVolumesFromImageTest-1130093192 None] Lock "cinder-ac73af4d-4a0a-4ac1-938b-7a79063a487b-delete_volume" released by "delete_volume" :: held 1.176s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:29:56 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-8ea4a8de-4cd5-4731-ba37-fe8e87a817b6 tempest-CreateVolumesFromImageTest-1130093192 None] Lock "cinder-db4af04c-240c-4be5-96ed-80035cadf8d0-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:29:56 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-8ea4a8de-4cd5-4731-ba37-fe8e87a817b6 tempest-CreateVolumesFromImageTest-1130093192 None] Acquiring lock "cinder-quobyte-db4af04c-240c-4be5-96ed-80035cadf8d0" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:29:56 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-8ea4a8de-4cd5-4731-ba37-fe8e87a817b6 tempest-CreateVolumesFromImageTest-1130093192 None] Lock "cinder-quobyte-db4af04c-240c-4be5-96ed-80035cadf8d0" acquired by "delete_volume" :: waited 0.021s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:29:56 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3fa17a9-c6d3-420f-ba52-36a5abb55852]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:29:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8ea4a8de-4cd5-4731-ba37-fe8e87a817b6 tempest-CreateVolumesFromImageTest-1130093192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-db4af04c-240c-4be5-96ed-80035cadf8d0 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:29:57 devstack sudo[101582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-db4af04c-240c-4be5-96ed-80035cadf8d0 Sep 15 16:29:57 devstack sudo[101582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:29:57 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-6678c770-8ad3-4853-bf61-a9e382ae94df tempest-SnapshotMetadataTestJSON-83532776 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:29:57 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-6678c770-8ad3-4853-bf61-a9e382ae94df tempest-SnapshotMetadataTestJSON-83532776 None] Flow 'volume_create_manager' (e35c3892-597a-4d61-aef0-0a1105009320) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:29:57 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-6678c770-8ad3-4853-bf61-a9e382ae94df tempest-SnapshotMetadataTestJSON-83532776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8eeafd58-ece7-48d7-913c-ecf06a34279c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:29:57 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-6678c770-8ad3-4853-bf61-a9e382ae94df tempest-SnapshotMetadataTestJSON-83532776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8eeafd58-ece7-48d7-913c-ecf06a34279c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:29:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-555535251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4556bc0-72b7-43c5-8196-0694f424f317,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7356e6bb037247d1bfc03e7433bf5f67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:29:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:29:57Z,use_quota=True,user_id='eda9a920fa464046bb60971146ad00ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:29:57 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-6678c770-8ad3-4853-bf61-a9e382ae94df tempest-SnapshotMetadataTestJSON-83532776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (287fcda6-fa22-4ab6-a652-aa403aa3e789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:29:57 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-6678c770-8ad3-4853-bf61-a9e382ae94df tempest-SnapshotMetadataTestJSON-83532776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (287fcda6-fa22-4ab6-a652-aa403aa3e789) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:29:57 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-6678c770-8ad3-4853-bf61-a9e382ae94df tempest-SnapshotMetadataTestJSON-83532776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba3ad219-103d-4a7e-95e1-0612be5de407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:29:57 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-6678c770-8ad3-4853-bf61-a9e382ae94df tempest-SnapshotMetadataTestJSON-83532776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba3ad219-103d-4a7e-95e1-0612be5de407) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4556bc0-72b7-43c5-8196-0694f424f317', 'volume_name': 'volume-a4556bc0-72b7-43c5-8196-0694f424f317', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:29:57 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-6678c770-8ad3-4853-bf61-a9e382ae94df tempest-SnapshotMetadataTestJSON-83532776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (028509ba-6a41-4dc7-8d10-b664824c8a38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:29:57 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-6678c770-8ad3-4853-bf61-a9e382ae94df tempest-SnapshotMetadataTestJSON-83532776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (028509ba-6a41-4dc7-8d10-b664824c8a38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:29:57 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-6678c770-8ad3-4853-bf61-a9e382ae94df tempest-SnapshotMetadataTestJSON-83532776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5b050c2-647a-4d6d-9418-b1297c11f707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:29:57 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-6678c770-8ad3-4853-bf61-a9e382ae94df tempest-SnapshotMetadataTestJSON-83532776 None] Volume a4556bc0-72b7-43c5-8196-0694f424f317: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4556bc0-72b7-43c5-8196-0694f424f317', 'volume_size': 1} Sep 15 16:29:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-6678c770-8ad3-4853-bf61-a9e382ae94df tempest-SnapshotMetadataTestJSON-83532776 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:29:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-6678c770-8ad3-4853-bf61-a9e382ae94df tempest-SnapshotMetadataTestJSON-83532776 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:29:57 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-6678c770-8ad3-4853-bf61-a9e382ae94df tempest-SnapshotMetadataTestJSON-83532776 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:29:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-555535251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4556bc0-72b7-43c5-8196-0694f424f317,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7356e6bb037247d1bfc03e7433bf5f67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:29:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:29:57Z,use_quota=True,user_id='eda9a920fa464046bb60971146ad00ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:29:57 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-6678c770-8ad3-4853-bf61-a9e382ae94df tempest-SnapshotMetadataTestJSON-83532776 None] Creating volume a4556bc0-72b7-43c5-8196-0694f424f317 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:29:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-6678c770-8ad3-4853-bf61-a9e382ae94df tempest-SnapshotMetadataTestJSON-83532776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:29:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-6678c770-8ad3-4853-bf61-a9e382ae94df tempest-SnapshotMetadataTestJSON-83532776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:29:57 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-6678c770-8ad3-4853-bf61-a9e382ae94df tempest-SnapshotMetadataTestJSON-83532776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:29:57 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-6678c770-8ad3-4853-bf61-a9e382ae94df tempest-SnapshotMetadataTestJSON-83532776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:29:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-6678c770-8ad3-4853-bf61-a9e382ae94df tempest-SnapshotMetadataTestJSON-83532776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:29:57 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-6678c770-8ad3-4853-bf61-a9e382ae94df tempest-SnapshotMetadataTestJSON-83532776 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:29:57 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-6678c770-8ad3-4853-bf61-a9e382ae94df tempest-SnapshotMetadataTestJSON-83532776 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:29:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-6678c770-8ad3-4853-bf61-a9e382ae94df tempest-SnapshotMetadataTestJSON-83532776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a4556bc0-72b7-43c5-8196-0694f424f317 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:29:57 devstack sudo[101584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a4556bc0-72b7-43c5-8196-0694f424f317 1073741824 Sep 15 16:29:57 devstack sudo[101584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:29:57 devstack sudo[101582]: pam_unix(sudo:session): session closed for user root Sep 15 16:29:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8ea4a8de-4cd5-4731-ba37-fe8e87a817b6 tempest-CreateVolumesFromImageTest-1130093192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-db4af04c-240c-4be5-96ed-80035cadf8d0" returned: 0 in 0.367s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:29:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8ea4a8de-4cd5-4731-ba37-fe8e87a817b6 tempest-CreateVolumesFromImageTest-1130093192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-db4af04c-240c-4be5-96ed-80035cadf8d0 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:29:57 devstack sudo[101589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-db4af04c-240c-4be5-96ed-80035cadf8d0 Sep 15 16:29:57 devstack sudo[101589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:29:57 devstack sudo[101589]: pam_unix(sudo:session): session closed for user root Sep 15 16:29:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8ea4a8de-4cd5-4731-ba37-fe8e87a817b6 tempest-CreateVolumesFromImageTest-1130093192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-db4af04c-240c-4be5-96ed-80035cadf8d0" returned: 0 in 0.260s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:29:57 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-8ea4a8de-4cd5-4731-ba37-fe8e87a817b6 tempest-CreateVolumesFromImageTest-1130093192 None] Lock "cinder-quobyte-db4af04c-240c-4be5-96ed-80035cadf8d0" released by "delete_volume" :: held 0.685s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:29:57 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-8ea4a8de-4cd5-4731-ba37-fe8e87a817b6 tempest-CreateVolumesFromImageTest-1130093192 None] Created reservations ['fa476a7f-70d1-4e8a-8c5b-d3aded2f0f36', '5ef00c07-8368-4c1d-a5ee-4f8cfbfcdcd9', '23b9acfa-39d7-4bf0-bdc1-71330d0d8308', '5e1486f1-b699-44f9-a0f6-ce54056623b3'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:29:57 devstack sudo[101584]: pam_unix(sudo:session): session closed for user root Sep 15 16:29:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-6678c770-8ad3-4853-bf61-a9e382ae94df tempest-SnapshotMetadataTestJSON-83532776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a4556bc0-72b7-43c5-8196-0694f424f317 1073741824" returned: 0 in 0.443s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:29:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-6678c770-8ad3-4853-bf61-a9e382ae94df tempest-SnapshotMetadataTestJSON-83532776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a4556bc0-72b7-43c5-8196-0694f424f317 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:29:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-8ea4a8de-4cd5-4731-ba37-fe8e87a817b6 tempest-CreateVolumesFromImageTest-1130093192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:29:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-8ea4a8de-4cd5-4731-ba37-fe8e87a817b6 tempest-CreateVolumesFromImageTest-1130093192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:29:57 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-8ea4a8de-4cd5-4731-ba37-fe8e87a817b6 tempest-CreateVolumesFromImageTest-1130093192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:29:57 devstack sudo[101596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a4556bc0-72b7-43c5-8196-0694f424f317 Sep 15 16:29:57 devstack sudo[101596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:29:57 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-8ea4a8de-4cd5-4731-ba37-fe8e87a817b6 tempest-CreateVolumesFromImageTest-1130093192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:29:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-8ea4a8de-4cd5-4731-ba37-fe8e87a817b6 tempest-CreateVolumesFromImageTest-1130093192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:29:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8ea4a8de-4cd5-4731-ba37-fe8e87a817b6 tempest-CreateVolumesFromImageTest-1130093192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:29:57 devstack sudo[101598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:29:57 devstack sudo[101598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:29:57 devstack sudo[101596]: pam_unix(sudo:session): session closed for user root Sep 15 16:29:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-6678c770-8ad3-4853-bf61-a9e382ae94df tempest-SnapshotMetadataTestJSON-83532776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a4556bc0-72b7-43c5-8196-0694f424f317" returned: 0 in 0.257s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:29:57 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-6678c770-8ad3-4853-bf61-a9e382ae94df tempest-SnapshotMetadataTestJSON-83532776 None] <== create_volume: return (748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:29:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-6678c770-8ad3-4853-bf61-a9e382ae94df tempest-SnapshotMetadataTestJSON-83532776 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.751s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:29:57 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-6678c770-8ad3-4853-bf61-a9e382ae94df tempest-SnapshotMetadataTestJSON-83532776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5b050c2-647a-4d6d-9418-b1297c11f707) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4556bc0-72b7-43c5-8196-0694f424f317', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:29:57 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-6678c770-8ad3-4853-bf61-a9e382ae94df tempest-SnapshotMetadataTestJSON-83532776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82a53469-ea7a-4a2d-b119-0c73b965781a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:29:57 devstack sudo[101598]: pam_unix(sudo:session): session closed for user root Sep 15 16:29:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8ea4a8de-4cd5-4731-ba37-fe8e87a817b6 tempest-CreateVolumesFromImageTest-1130093192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.254s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:29:57 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-8ea4a8de-4cd5-4731-ba37-fe8e87a817b6 tempest-CreateVolumesFromImageTest-1130093192 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:29:57 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-8ea4a8de-4cd5-4731-ba37-fe8e87a817b6 tempest-CreateVolumesFromImageTest-1130093192 None] Deleted volume successfully. Sep 15 16:29:57 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-6678c770-8ad3-4853-bf61-a9e382ae94df tempest-SnapshotMetadataTestJSON-83532776 None] Volume volume-a4556bc0-72b7-43c5-8196-0694f424f317 (a4556bc0-72b7-43c5-8196-0694f424f317): created successfully Sep 15 16:29:57 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-6678c770-8ad3-4853-bf61-a9e382ae94df tempest-SnapshotMetadataTestJSON-83532776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82a53469-ea7a-4a2d-b119-0c73b965781a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:29:57 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-6678c770-8ad3-4853-bf61-a9e382ae94df tempest-SnapshotMetadataTestJSON-83532776 None] Flow 'volume_create_manager' (e35c3892-597a-4d61-aef0-0a1105009320) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:29:58 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-be20ce21-52e5-4d29-9a83-100ace36ff5b tempest-CreateVolumesFromImageTest-1130093192 None] Acquiring lock "cinder-106421ec-ac6a-494d-9953-ea3a8bf11ce1-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:29:58 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-6678c770-8ad3-4853-bf61-a9e382ae94df tempest-SnapshotMetadataTestJSON-83532776 None] Created volume successfully. Sep 15 16:29:58 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-8ea4a8de-4cd5-4731-ba37-fe8e87a817b6 tempest-CreateVolumesFromImageTest-1130093192 None] Lock "cinder-db4af04c-240c-4be5-96ed-80035cadf8d0-delete_volume" released by "delete_volume" :: held 1.182s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:29:58 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-be20ce21-52e5-4d29-9a83-100ace36ff5b tempest-CreateVolumesFromImageTest-1130093192 None] Lock "cinder-106421ec-ac6a-494d-9953-ea3a8bf11ce1-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:29:58 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-be20ce21-52e5-4d29-9a83-100ace36ff5b tempest-CreateVolumesFromImageTest-1130093192 None] Acquiring lock "cinder-quobyte-106421ec-ac6a-494d-9953-ea3a8bf11ce1" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:29:58 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-be20ce21-52e5-4d29-9a83-100ace36ff5b tempest-CreateVolumesFromImageTest-1130093192 None] Lock "cinder-quobyte-106421ec-ac6a-494d-9953-ea3a8bf11ce1" acquired by "delete_volume" :: waited 0.019s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:29:58 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ec89543-fdf2-4ec8-b36a-f1e8361f6418]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:29:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-be20ce21-52e5-4d29-9a83-100ace36ff5b tempest-CreateVolumesFromImageTest-1130093192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-106421ec-ac6a-494d-9953-ea3a8bf11ce1 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:29:58 devstack sudo[101602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-106421ec-ac6a-494d-9953-ea3a8bf11ce1 Sep 15 16:29:58 devstack sudo[101602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:29:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-15b69f0e-16f1-4005-8d86-ba9db2ae682a tempest-SnapshotMetadataTestJSON-83532776 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:29:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-15b69f0e-16f1-4005-8d86-ba9db2ae682a tempest-SnapshotMetadataTestJSON-83532776 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:29:58 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-15b69f0e-16f1-4005-8d86-ba9db2ae682a tempest-SnapshotMetadataTestJSON-83532776 None] Creating offline snapshot 318da0eb-2ab9-4112-a9b8-c1198cb35b8a of volume a4556bc0-72b7-43c5-8196-0694f424f317 {{(pid=86082) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 15 16:29:58 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb3ca408-c222-4072-b9be-421ca6ba2001]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:29:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-15b69f0e-16f1-4005-8d86-ba9db2ae682a tempest-SnapshotMetadataTestJSON-83532776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a4556bc0-72b7-43c5-8196-0694f424f317 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:29:58 devstack sudo[101604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a4556bc0-72b7-43c5-8196-0694f424f317 Sep 15 16:29:58 devstack sudo[101604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:29:58 devstack sudo[101602]: pam_unix(sudo:session): session closed for user root Sep 15 16:29:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-be20ce21-52e5-4d29-9a83-100ace36ff5b tempest-CreateVolumesFromImageTest-1130093192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-106421ec-ac6a-494d-9953-ea3a8bf11ce1" returned: 0 in 0.388s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:29:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-be20ce21-52e5-4d29-9a83-100ace36ff5b tempest-CreateVolumesFromImageTest-1130093192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-106421ec-ac6a-494d-9953-ea3a8bf11ce1 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:29:58 devstack sudo[101610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-106421ec-ac6a-494d-9953-ea3a8bf11ce1 Sep 15 16:29:58 devstack sudo[101610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:29:58 devstack sudo[101604]: pam_unix(sudo:session): session closed for user root Sep 15 16:29:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-15b69f0e-16f1-4005-8d86-ba9db2ae682a tempest-SnapshotMetadataTestJSON-83532776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a4556bc0-72b7-43c5-8196-0694f424f317" returned: 0 in 0.385s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:29:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-15b69f0e-16f1-4005-8d86-ba9db2ae682a tempest-SnapshotMetadataTestJSON-83532776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a4556bc0-72b7-43c5-8196-0694f424f317,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a4556bc0-72b7-43c5-8196-0694f424f317.318da0eb-2ab9-4112-a9b8-c1198cb35b8a 1G {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:29:58 devstack sudo[101610]: pam_unix(sudo:session): session closed for user root Sep 15 16:29:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-be20ce21-52e5-4d29-9a83-100ace36ff5b tempest-CreateVolumesFromImageTest-1130093192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-106421ec-ac6a-494d-9953-ea3a8bf11ce1" returned: 0 in 0.245s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:29:58 devstack sudo[101616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a4556bc0-72b7-43c5-8196-0694f424f317,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a4556bc0-72b7-43c5-8196-0694f424f317.318da0eb-2ab9-4112-a9b8-c1198cb35b8a 1G Sep 15 16:29:58 devstack sudo[101616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:29:58 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-be20ce21-52e5-4d29-9a83-100ace36ff5b tempest-CreateVolumesFromImageTest-1130093192 None] Lock "cinder-quobyte-106421ec-ac6a-494d-9953-ea3a8bf11ce1" released by "delete_volume" :: held 0.678s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:29:58 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-be20ce21-52e5-4d29-9a83-100ace36ff5b tempest-CreateVolumesFromImageTest-1130093192 None] Created reservations ['50458226-0f3f-4a78-bbcc-ed14960304b5', '1239b330-1b93-4dea-a5cd-a996373bea85', 'a84c3e65-1bd4-460f-9f87-c7004a2abe3f', '0aad5c70-df3a-45e5-a0be-2f87139af1fa'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:29:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-be20ce21-52e5-4d29-9a83-100ace36ff5b tempest-CreateVolumesFromImageTest-1130093192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:29:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-be20ce21-52e5-4d29-9a83-100ace36ff5b tempest-CreateVolumesFromImageTest-1130093192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:29:58 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-be20ce21-52e5-4d29-9a83-100ace36ff5b tempest-CreateVolumesFromImageTest-1130093192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:29:58 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-be20ce21-52e5-4d29-9a83-100ace36ff5b tempest-CreateVolumesFromImageTest-1130093192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:29:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-be20ce21-52e5-4d29-9a83-100ace36ff5b tempest-CreateVolumesFromImageTest-1130093192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:29:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-be20ce21-52e5-4d29-9a83-100ace36ff5b tempest-CreateVolumesFromImageTest-1130093192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:29:58 devstack sudo[101618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:29:58 devstack sudo[101618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:29:59 devstack sudo[101616]: pam_unix(sudo:session): session closed for user root Sep 15 16:29:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-15b69f0e-16f1-4005-8d86-ba9db2ae682a tempest-SnapshotMetadataTestJSON-83532776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a4556bc0-72b7-43c5-8196-0694f424f317,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a4556bc0-72b7-43c5-8196-0694f424f317.318da0eb-2ab9-4112-a9b8-c1198cb35b8a 1G" returned: 0 in 0.410s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:29:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-15b69f0e-16f1-4005-8d86-ba9db2ae682a tempest-SnapshotMetadataTestJSON-83532776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4556bc0-72b7-43c5-8196-0694f424f317 -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a4556bc0-72b7-43c5-8196-0694f424f317.318da0eb-2ab9-4112-a9b8-c1198cb35b8a {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:29:59 devstack sudo[101618]: pam_unix(sudo:session): session closed for user root Sep 15 16:29:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-be20ce21-52e5-4d29-9a83-100ace36ff5b tempest-CreateVolumesFromImageTest-1130093192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.278s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:29:59 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-be20ce21-52e5-4d29-9a83-100ace36ff5b tempest-CreateVolumesFromImageTest-1130093192 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:29:59 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-be20ce21-52e5-4d29-9a83-100ace36ff5b tempest-CreateVolumesFromImageTest-1130093192 None] Deleted volume successfully. Sep 15 16:29:59 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f1b4b1d1-8b8b-406e-82f3-2682d064a8b9 tempest-CreateVolumesFromImageTest-1130093192 None] Acquiring lock "cinder-82e241a9-e3c9-4522-9a2b-9d9ca166b5cb-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:29:59 devstack sudo[101624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4556bc0-72b7-43c5-8196-0694f424f317 -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a4556bc0-72b7-43c5-8196-0694f424f317.318da0eb-2ab9-4112-a9b8-c1198cb35b8a Sep 15 16:29:59 devstack sudo[101624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:29:59 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f1b4b1d1-8b8b-406e-82f3-2682d064a8b9 tempest-CreateVolumesFromImageTest-1130093192 None] Lock "cinder-82e241a9-e3c9-4522-9a2b-9d9ca166b5cb-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:29:59 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-be20ce21-52e5-4d29-9a83-100ace36ff5b tempest-CreateVolumesFromImageTest-1130093192 None] Lock "cinder-106421ec-ac6a-494d-9953-ea3a8bf11ce1-delete_volume" released by "delete_volume" :: held 1.177s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:29:59 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f1b4b1d1-8b8b-406e-82f3-2682d064a8b9 tempest-CreateVolumesFromImageTest-1130093192 None] Acquiring lock "cinder-quobyte-82e241a9-e3c9-4522-9a2b-9d9ca166b5cb" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:29:59 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f1b4b1d1-8b8b-406e-82f3-2682d064a8b9 tempest-CreateVolumesFromImageTest-1130093192 None] Lock "cinder-quobyte-82e241a9-e3c9-4522-9a2b-9d9ca166b5cb" acquired by "delete_volume" :: waited 0.016s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:29:59 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1fe025d-9b1a-4a7e-95d9-f47efd145b7b]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:29:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f1b4b1d1-8b8b-406e-82f3-2682d064a8b9 tempest-CreateVolumesFromImageTest-1130093192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-82e241a9-e3c9-4522-9a2b-9d9ca166b5cb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:29:59 devstack sudo[101626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-82e241a9-e3c9-4522-9a2b-9d9ca166b5cb Sep 15 16:29:59 devstack sudo[101626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:29:59 devstack sudo[101624]: pam_unix(sudo:session): session closed for user root Sep 15 16:29:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-15b69f0e-16f1-4005-8d86-ba9db2ae682a tempest-SnapshotMetadataTestJSON-83532776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a4556bc0-72b7-43c5-8196-0694f424f317 -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a4556bc0-72b7-43c5-8196-0694f424f317.318da0eb-2ab9-4112-a9b8-c1198cb35b8a" returned: 0 in 0.323s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:29:59 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-15b69f0e-16f1-4005-8d86-ba9db2ae682a tempest-SnapshotMetadataTestJSON-83532776 None] /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a4556bc0-72b7-43c5-8196-0694f424f317.318da0eb-2ab9-4112-a9b8-c1198cb35b8a is being set with open permissions: ugo+rw Sep 15 16:29:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-15b69f0e-16f1-4005-8d86-ba9db2ae682a tempest-SnapshotMetadataTestJSON-83532776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a4556bc0-72b7-43c5-8196-0694f424f317.318da0eb-2ab9-4112-a9b8-c1198cb35b8a {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:29:59 devstack sudo[101631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a4556bc0-72b7-43c5-8196-0694f424f317.318da0eb-2ab9-4112-a9b8-c1198cb35b8a Sep 15 16:29:59 devstack sudo[101631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:29:59 devstack sudo[101626]: pam_unix(sudo:session): session closed for user root Sep 15 16:29:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f1b4b1d1-8b8b-406e-82f3-2682d064a8b9 tempest-CreateVolumesFromImageTest-1130093192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-82e241a9-e3c9-4522-9a2b-9d9ca166b5cb" returned: 0 in 0.369s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:29:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f1b4b1d1-8b8b-406e-82f3-2682d064a8b9 tempest-CreateVolumesFromImageTest-1130093192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-82e241a9-e3c9-4522-9a2b-9d9ca166b5cb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:29:59 devstack sudo[101636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-82e241a9-e3c9-4522-9a2b-9d9ca166b5cb Sep 15 16:29:59 devstack sudo[101636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:29:59 devstack sudo[101631]: pam_unix(sudo:session): session closed for user root Sep 15 16:29:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-15b69f0e-16f1-4005-8d86-ba9db2ae682a tempest-SnapshotMetadataTestJSON-83532776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a4556bc0-72b7-43c5-8196-0694f424f317.318da0eb-2ab9-4112-a9b8-c1198cb35b8a" returned: 0 in 0.252s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:29:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-15b69f0e-16f1-4005-8d86-ba9db2ae682a tempest-SnapshotMetadataTestJSON-83532776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a4556bc0-72b7-43c5-8196-0694f424f317.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:29:59 devstack sudo[101639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a4556bc0-72b7-43c5-8196-0694f424f317.info Sep 15 16:29:59 devstack sudo[101639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:29:59 devstack cinder-volume[86082]: DEBUG oslo_service.periodic_task [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86082) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 15 16:29:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:29:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:29:59 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:29:59 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:29:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:29:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:29:59 devstack sudo[101641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:29:59 devstack sudo[101641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:29:59 devstack sudo[101636]: pam_unix(sudo:session): session closed for user root Sep 15 16:29:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f1b4b1d1-8b8b-406e-82f3-2682d064a8b9 tempest-CreateVolumesFromImageTest-1130093192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-82e241a9-e3c9-4522-9a2b-9d9ca166b5cb" returned: 0 in 0.244s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:29:59 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f1b4b1d1-8b8b-406e-82f3-2682d064a8b9 tempest-CreateVolumesFromImageTest-1130093192 None] Lock "cinder-quobyte-82e241a9-e3c9-4522-9a2b-9d9ca166b5cb" released by "delete_volume" :: held 0.663s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:29:59 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-f1b4b1d1-8b8b-406e-82f3-2682d064a8b9 tempest-CreateVolumesFromImageTest-1130093192 None] Created reservations ['ea45e477-95d5-44c6-999e-8ae6e58cbe18', '780f8cf2-d568-4559-abc7-878bb9b99df9', '620070be-faa4-4fc6-b6ee-68163f6d0ca1', 'e674375f-ad7d-4b99-a02c-6ac3bc39e513'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:30:00 devstack sudo[101639]: pam_unix(sudo:session): session closed for user root Sep 15 16:30:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-15b69f0e-16f1-4005-8d86-ba9db2ae682a tempest-SnapshotMetadataTestJSON-83532776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a4556bc0-72b7-43c5-8196-0694f424f317.info" returned: 0 in 0.270s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:30:00 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-15b69f0e-16f1-4005-8d86-ba9db2ae682a tempest-SnapshotMetadataTestJSON-83532776 None] /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a4556bc0-72b7-43c5-8196-0694f424f317.info is being set with open permissions: ugo+rw Sep 15 16:30:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-15b69f0e-16f1-4005-8d86-ba9db2ae682a tempest-SnapshotMetadataTestJSON-83532776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a4556bc0-72b7-43c5-8196-0694f424f317.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:30:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f1b4b1d1-8b8b-406e-82f3-2682d064a8b9 tempest-CreateVolumesFromImageTest-1130093192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:30:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f1b4b1d1-8b8b-406e-82f3-2682d064a8b9 tempest-CreateVolumesFromImageTest-1130093192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:30:00 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-f1b4b1d1-8b8b-406e-82f3-2682d064a8b9 tempest-CreateVolumesFromImageTest-1130093192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:30:00 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-f1b4b1d1-8b8b-406e-82f3-2682d064a8b9 tempest-CreateVolumesFromImageTest-1130093192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:30:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f1b4b1d1-8b8b-406e-82f3-2682d064a8b9 tempest-CreateVolumesFromImageTest-1130093192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:30:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f1b4b1d1-8b8b-406e-82f3-2682d064a8b9 tempest-CreateVolumesFromImageTest-1130093192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:30:00 devstack sudo[101645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a4556bc0-72b7-43c5-8196-0694f424f317.info Sep 15 16:30:00 devstack sudo[101645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:30:00 devstack sudo[101647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:30:00 devstack sudo[101647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:30:00 devstack sudo[101641]: pam_unix(sudo:session): session closed for user root Sep 15 16:30:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.279s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:30:00 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:30:00 devstack cinder-volume[86082]: DEBUG oslo_service.periodic_task [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Running periodic task VolumeManager._thread_info {{(pid=86082) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 15 16:30:00 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] thread count: 28 {{(pid=86082) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 15 16:30:00 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] thread info: [<_MainThread(MainThread, started 124875935469696)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86082) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 15 16:30:00 devstack sudo[101645]: pam_unix(sudo:session): session closed for user root Sep 15 16:30:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-15b69f0e-16f1-4005-8d86-ba9db2ae682a tempest-SnapshotMetadataTestJSON-83532776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a4556bc0-72b7-43c5-8196-0694f424f317.info" returned: 0 in 0.248s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:30:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-15b69f0e-16f1-4005-8d86-ba9db2ae682a tempest-SnapshotMetadataTestJSON-83532776 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.996s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:30:00 devstack sudo[101647]: pam_unix(sudo:session): session closed for user root Sep 15 16:30:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f1b4b1d1-8b8b-406e-82f3-2682d064a8b9 tempest-CreateVolumesFromImageTest-1130093192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.273s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:30:00 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-f1b4b1d1-8b8b-406e-82f3-2682d064a8b9 tempest-CreateVolumesFromImageTest-1130093192 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:30:00 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-f1b4b1d1-8b8b-406e-82f3-2682d064a8b9 tempest-CreateVolumesFromImageTest-1130093192 None] Deleted volume successfully. Sep 15 16:30:00 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-15b69f0e-16f1-4005-8d86-ba9db2ae682a tempest-SnapshotMetadataTestJSON-83532776 None] Create snapshot completed successfully Sep 15 16:30:00 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f1b4b1d1-8b8b-406e-82f3-2682d064a8b9 tempest-CreateVolumesFromImageTest-1130093192 None] Lock "cinder-82e241a9-e3c9-4522-9a2b-9d9ca166b5cb-delete_volume" released by "delete_volume" :: held 1.151s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:30:00 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-18db9129-43b5-4d49-8389-4586ea052955 tempest-CreateVolumesFromImageTest-1130093192 None] Acquiring lock "cinder-8ea13f9f-7608-4cd5-80ef-450b8d31e6cd-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:30:00 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-18db9129-43b5-4d49-8389-4586ea052955 tempest-CreateVolumesFromImageTest-1130093192 None] Lock "cinder-8ea13f9f-7608-4cd5-80ef-450b8d31e6cd-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:30:00 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-18db9129-43b5-4d49-8389-4586ea052955 tempest-CreateVolumesFromImageTest-1130093192 None] Acquiring lock "cinder-quobyte-8ea13f9f-7608-4cd5-80ef-450b8d31e6cd" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:30:00 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-18db9129-43b5-4d49-8389-4586ea052955 tempest-CreateVolumesFromImageTest-1130093192 None] Lock "cinder-quobyte-8ea13f9f-7608-4cd5-80ef-450b8d31e6cd" acquired by "delete_volume" :: waited 0.014s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:30:00 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec598e21-6845-4707-8b55-79013a3a9665]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:30:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-18db9129-43b5-4d49-8389-4586ea052955 tempest-CreateVolumesFromImageTest-1130093192 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-8ea13f9f-7608-4cd5-80ef-450b8d31e6cd {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:30:00 devstack sudo[101652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-8ea13f9f-7608-4cd5-80ef-450b8d31e6cd Sep 15 16:30:00 devstack sudo[101652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:30:00 devstack sudo[101652]: pam_unix(sudo:session): session closed for user root Sep 15 16:30:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-18db9129-43b5-4d49-8389-4586ea052955 tempest-CreateVolumesFromImageTest-1130093192 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-8ea13f9f-7608-4cd5-80ef-450b8d31e6cd" returned: 0 in 0.346s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:30:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-18db9129-43b5-4d49-8389-4586ea052955 tempest-CreateVolumesFromImageTest-1130093192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-8ea13f9f-7608-4cd5-80ef-450b8d31e6cd {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:30:00 devstack sudo[101657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-8ea13f9f-7608-4cd5-80ef-450b8d31e6cd Sep 15 16:30:00 devstack sudo[101657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:30:01 devstack sudo[101657]: pam_unix(sudo:session): session closed for user root Sep 15 16:30:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-18db9129-43b5-4d49-8389-4586ea052955 tempest-CreateVolumesFromImageTest-1130093192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-8ea13f9f-7608-4cd5-80ef-450b8d31e6cd" returned: 0 in 0.245s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:30:01 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-18db9129-43b5-4d49-8389-4586ea052955 tempest-CreateVolumesFromImageTest-1130093192 None] Lock "cinder-quobyte-8ea13f9f-7608-4cd5-80ef-450b8d31e6cd" released by "delete_volume" :: held 0.629s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:30:01 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-18db9129-43b5-4d49-8389-4586ea052955 tempest-CreateVolumesFromImageTest-1130093192 None] Created reservations ['52da52b3-111f-4771-83a2-fccd01cb9635', '4dc0659f-0bfb-4d3e-a238-8c0e8f495259', '97f55967-1ad2-4269-8563-4b41214c5650', '3ff4209b-bf1f-4add-bbe1-0f4d54457d98'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:30:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-18db9129-43b5-4d49-8389-4586ea052955 tempest-CreateVolumesFromImageTest-1130093192 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:30:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-18db9129-43b5-4d49-8389-4586ea052955 tempest-CreateVolumesFromImageTest-1130093192 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:30:01 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-18db9129-43b5-4d49-8389-4586ea052955 tempest-CreateVolumesFromImageTest-1130093192 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:30:01 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-18db9129-43b5-4d49-8389-4586ea052955 tempest-CreateVolumesFromImageTest-1130093192 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:30:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-18db9129-43b5-4d49-8389-4586ea052955 tempest-CreateVolumesFromImageTest-1130093192 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:30:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-18db9129-43b5-4d49-8389-4586ea052955 tempest-CreateVolumesFromImageTest-1130093192 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:30:01 devstack sudo[101660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:30:01 devstack sudo[101660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:30:01 devstack sudo[101660]: pam_unix(sudo:session): session closed for user root Sep 15 16:30:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-18db9129-43b5-4d49-8389-4586ea052955 tempest-CreateVolumesFromImageTest-1130093192 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.242s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:30:01 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-18db9129-43b5-4d49-8389-4586ea052955 tempest-CreateVolumesFromImageTest-1130093192 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:30:01 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-18db9129-43b5-4d49-8389-4586ea052955 tempest-CreateVolumesFromImageTest-1130093192 None] Deleted volume successfully. Sep 15 16:30:01 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-18db9129-43b5-4d49-8389-4586ea052955 tempest-CreateVolumesFromImageTest-1130093192 None] Lock "cinder-8ea13f9f-7608-4cd5-80ef-450b8d31e6cd-delete_volume" released by "delete_volume" :: held 1.051s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:30:02 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f30e4def-8c70-475a-92b4-27486cf23199 tempest-SnapshotMetadataTestJSON-83532776 None] Acquiring lock "cinder-318da0eb-2ab9-4112-a9b8-c1198cb35b8a-delete_snapshot" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:30:02 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f30e4def-8c70-475a-92b4-27486cf23199 tempest-SnapshotMetadataTestJSON-83532776 None] Lock "cinder-318da0eb-2ab9-4112-a9b8-c1198cb35b8a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:30:02 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f30e4def-8c70-475a-92b4-27486cf23199 tempest-SnapshotMetadataTestJSON-83532776 None] Acquiring lock "cinder-quobyte-a4556bc0-72b7-43c5-8196-0694f424f317" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:30:02 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f30e4def-8c70-475a-92b4-27486cf23199 tempest-SnapshotMetadataTestJSON-83532776 None] Lock "cinder-quobyte-a4556bc0-72b7-43c5-8196-0694f424f317" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:30:02 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f30e4def-8c70-475a-92b4-27486cf23199 tempest-SnapshotMetadataTestJSON-83532776 None] Acquiring lock "cinder-quobyte-318da0eb-2ab9-4112-a9b8-c1198cb35b8a" by "_delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:30:02 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f30e4def-8c70-475a-92b4-27486cf23199 tempest-SnapshotMetadataTestJSON-83532776 None] Lock "cinder-quobyte-318da0eb-2ab9-4112-a9b8-c1198cb35b8a" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:30:02 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-f30e4def-8c70-475a-92b4-27486cf23199 tempest-SnapshotMetadataTestJSON-83532776 None] Deleting offline snapshot 318da0eb-2ab9-4112-a9b8-c1198cb35b8a of volume a4556bc0-72b7-43c5-8196-0694f424f317 {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 15 16:30:02 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-f30e4def-8c70-475a-92b4-27486cf23199 tempest-SnapshotMetadataTestJSON-83532776 None] snapshot_file for this snap is: volume-a4556bc0-72b7-43c5-8196-0694f424f317.318da0eb-2ab9-4112-a9b8-c1198cb35b8a {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 15 16:30:02 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc038e16-48db-4789-b8c1-b2ec763a977b]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:30:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f30e4def-8c70-475a-92b4-27486cf23199 tempest-SnapshotMetadataTestJSON-83532776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a4556bc0-72b7-43c5-8196-0694f424f317.318da0eb-2ab9-4112-a9b8-c1198cb35b8a {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:30:02 devstack sudo[101663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a4556bc0-72b7-43c5-8196-0694f424f317.318da0eb-2ab9-4112-a9b8-c1198cb35b8a Sep 15 16:30:02 devstack sudo[101663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:30:02 devstack sudo[101663]: pam_unix(sudo:session): session closed for user root Sep 15 16:30:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f30e4def-8c70-475a-92b4-27486cf23199 tempest-SnapshotMetadataTestJSON-83532776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a4556bc0-72b7-43c5-8196-0694f424f317.318da0eb-2ab9-4112-a9b8-c1198cb35b8a" returned: 0 in 0.395s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:30:02 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-f30e4def-8c70-475a-92b4-27486cf23199 tempest-SnapshotMetadataTestJSON-83532776 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a4556bc0-72b7-43c5-8196-0694f424f317(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 16:30:02 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[61734e4e-8a04-4172-be39-6e9db2ad3c0d]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:30:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f30e4def-8c70-475a-92b4-27486cf23199 tempest-SnapshotMetadataTestJSON-83532776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a4556bc0-72b7-43c5-8196-0694f424f317 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:30:02 devstack sudo[101668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a4556bc0-72b7-43c5-8196-0694f424f317 Sep 15 16:30:02 devstack sudo[101668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:30:03 devstack sudo[101668]: pam_unix(sudo:session): session closed for user root Sep 15 16:30:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f30e4def-8c70-475a-92b4-27486cf23199 tempest-SnapshotMetadataTestJSON-83532776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a4556bc0-72b7-43c5-8196-0694f424f317" returned: 0 in 0.382s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:30:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f30e4def-8c70-475a-92b4-27486cf23199 tempest-SnapshotMetadataTestJSON-83532776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a4556bc0-72b7-43c5-8196-0694f424f317.318da0eb-2ab9-4112-a9b8-c1198cb35b8a {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:30:03 devstack sudo[101673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a4556bc0-72b7-43c5-8196-0694f424f317.318da0eb-2ab9-4112-a9b8-c1198cb35b8a Sep 15 16:30:03 devstack sudo[101673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:30:03 devstack sudo[101673]: pam_unix(sudo:session): session closed for user root Sep 15 16:30:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f30e4def-8c70-475a-92b4-27486cf23199 tempest-SnapshotMetadataTestJSON-83532776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a4556bc0-72b7-43c5-8196-0694f424f317.318da0eb-2ab9-4112-a9b8-c1198cb35b8a" returned: 0 in 0.346s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:30:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f30e4def-8c70-475a-92b4-27486cf23199 tempest-SnapshotMetadataTestJSON-83532776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a4556bc0-72b7-43c5-8196-0694f424f317.318da0eb-2ab9-4112-a9b8-c1198cb35b8a {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:30:03 devstack sudo[101678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a4556bc0-72b7-43c5-8196-0694f424f317.318da0eb-2ab9-4112-a9b8-c1198cb35b8a Sep 15 16:30:03 devstack sudo[101678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:30:03 devstack sudo[101678]: pam_unix(sudo:session): session closed for user root Sep 15 16:30:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f30e4def-8c70-475a-92b4-27486cf23199 tempest-SnapshotMetadataTestJSON-83532776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a4556bc0-72b7-43c5-8196-0694f424f317.318da0eb-2ab9-4112-a9b8-c1198cb35b8a" returned: 0 in 0.278s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:30:03 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:SELECT=143,cinder:UPDATE=167,cinder:INSERT=41,cinder:DELETE=20 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 16:30:03 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:SELECT=145,cinder:UPDATE=180,cinder:INSERT=59,cinder:DELETE=10 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 16:30:03 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f30e4def-8c70-475a-92b4-27486cf23199 tempest-SnapshotMetadataTestJSON-83532776 None] Lock "cinder-quobyte-318da0eb-2ab9-4112-a9b8-c1198cb35b8a" released by "_delete_snapshot" :: held 1.560s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:30:03 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f30e4def-8c70-475a-92b4-27486cf23199 tempest-SnapshotMetadataTestJSON-83532776 None] Lock "cinder-quobyte-a4556bc0-72b7-43c5-8196-0694f424f317" released by "delete_snapshot" :: held 1.585s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:30:03 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-f30e4def-8c70-475a-92b4-27486cf23199 tempest-SnapshotMetadataTestJSON-83532776 None] Created reservations ['8d7e3fbd-8c84-4402-932c-0ad8839680de', '4aec8372-3d77-417d-8d63-620bb2628e2d', '448989f4-c107-4382-a79d-6844ccf7909d', 'b96431cc-f9bb-4301-9d40-b239dd84188c'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:30:03 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-f30e4def-8c70-475a-92b4-27486cf23199 tempest-SnapshotMetadataTestJSON-83532776 None] Delete snapshot completed successfully. Sep 15 16:30:03 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f30e4def-8c70-475a-92b4-27486cf23199 tempest-SnapshotMetadataTestJSON-83532776 None] Lock "cinder-318da0eb-2ab9-4112-a9b8-c1198cb35b8a-delete_snapshot" released by "delete_snapshot" :: held 1.725s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:30:04 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-bd42270f-8577-4c04-aa41-030adda20a1f tempest-SnapshotMetadataTestJSON-83532776 None] Acquiring lock "cinder-a4556bc0-72b7-43c5-8196-0694f424f317-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:30:04 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-bd42270f-8577-4c04-aa41-030adda20a1f tempest-SnapshotMetadataTestJSON-83532776 None] Lock "cinder-a4556bc0-72b7-43c5-8196-0694f424f317-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:30:04 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-738d51ee-e4e5-49ae-851a-bdb7f400f8a8 tempest-VolumeDependencyTests-1253320995 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:30:04 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-738d51ee-e4e5-49ae-851a-bdb7f400f8a8 tempest-VolumeDependencyTests-1253320995 None] Flow 'volume_create_manager' (a60f6833-ad0f-49f4-8acd-ecf4e2d1012e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:30:04 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-738d51ee-e4e5-49ae-851a-bdb7f400f8a8 tempest-VolumeDependencyTests-1253320995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8737ffe-86f1-45c3-a1a1-f44441044cac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:30:04 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-738d51ee-e4e5-49ae-851a-bdb7f400f8a8 tempest-VolumeDependencyTests-1253320995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8737ffe-86f1-45c3-a1a1-f44441044cac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:30:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2034736799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e401bc3-66af-469e-ba30-d81829148c76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7371d1caaa94445e9fbe331de3698eae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:30:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:30:04Z,use_quota=True,user_id='cb7d5a5dbf664c04bce4620d58a55936',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:30:04 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-738d51ee-e4e5-49ae-851a-bdb7f400f8a8 tempest-VolumeDependencyTests-1253320995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4644106-e0f3-43ec-924a-f687ad85de13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:30:04 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-738d51ee-e4e5-49ae-851a-bdb7f400f8a8 tempest-VolumeDependencyTests-1253320995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4644106-e0f3-43ec-924a-f687ad85de13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:30:04 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-738d51ee-e4e5-49ae-851a-bdb7f400f8a8 tempest-VolumeDependencyTests-1253320995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afedf83d-4be5-4679-8ba1-cbaa3a9b71ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:30:04 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-738d51ee-e4e5-49ae-851a-bdb7f400f8a8 tempest-VolumeDependencyTests-1253320995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afedf83d-4be5-4679-8ba1-cbaa3a9b71ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e401bc3-66af-469e-ba30-d81829148c76', 'volume_name': 'volume-6e401bc3-66af-469e-ba30-d81829148c76', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:30:04 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-738d51ee-e4e5-49ae-851a-bdb7f400f8a8 tempest-VolumeDependencyTests-1253320995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c24d040d-c9a6-488f-be45-ea3e1eb719ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:30:04 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-738d51ee-e4e5-49ae-851a-bdb7f400f8a8 tempest-VolumeDependencyTests-1253320995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c24d040d-c9a6-488f-be45-ea3e1eb719ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:30:04 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-738d51ee-e4e5-49ae-851a-bdb7f400f8a8 tempest-VolumeDependencyTests-1253320995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1766b34-650d-4d85-a60f-54364e5107d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:30:04 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-738d51ee-e4e5-49ae-851a-bdb7f400f8a8 tempest-VolumeDependencyTests-1253320995 None] Volume 6e401bc3-66af-469e-ba30-d81829148c76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e401bc3-66af-469e-ba30-d81829148c76', 'volume_size': 1} Sep 15 16:30:04 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-738d51ee-e4e5-49ae-851a-bdb7f400f8a8 tempest-VolumeDependencyTests-1253320995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:30:04 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-738d51ee-e4e5-49ae-851a-bdb7f400f8a8 tempest-VolumeDependencyTests-1253320995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:30:04 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-738d51ee-e4e5-49ae-851a-bdb7f400f8a8 tempest-VolumeDependencyTests-1253320995 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:30:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2034736799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e401bc3-66af-469e-ba30-d81829148c76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7371d1caaa94445e9fbe331de3698eae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:30:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:30:04Z,use_quota=True,user_id='cb7d5a5dbf664c04bce4620d58a55936',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:30:04 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-738d51ee-e4e5-49ae-851a-bdb7f400f8a8 tempest-VolumeDependencyTests-1253320995 None] Creating volume 6e401bc3-66af-469e-ba30-d81829148c76 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:30:04 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-738d51ee-e4e5-49ae-851a-bdb7f400f8a8 tempest-VolumeDependencyTests-1253320995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:30:04 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-738d51ee-e4e5-49ae-851a-bdb7f400f8a8 tempest-VolumeDependencyTests-1253320995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:30:04 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-738d51ee-e4e5-49ae-851a-bdb7f400f8a8 tempest-VolumeDependencyTests-1253320995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:30:04 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-738d51ee-e4e5-49ae-851a-bdb7f400f8a8 tempest-VolumeDependencyTests-1253320995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:30:04 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-738d51ee-e4e5-49ae-851a-bdb7f400f8a8 tempest-VolumeDependencyTests-1253320995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:30:04 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-738d51ee-e4e5-49ae-851a-bdb7f400f8a8 tempest-VolumeDependencyTests-1253320995 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:30:04 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-738d51ee-e4e5-49ae-851a-bdb7f400f8a8 tempest-VolumeDependencyTests-1253320995 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:30:04 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-738d51ee-e4e5-49ae-851a-bdb7f400f8a8 tempest-VolumeDependencyTests-1253320995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6e401bc3-66af-469e-ba30-d81829148c76 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:30:04 devstack sudo[101681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6e401bc3-66af-469e-ba30-d81829148c76 1073741824 Sep 15 16:30:04 devstack sudo[101681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:30:04 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-bd42270f-8577-4c04-aa41-030adda20a1f tempest-SnapshotMetadataTestJSON-83532776 None] Acquiring lock "cinder-quobyte-a4556bc0-72b7-43c5-8196-0694f424f317" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:30:04 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-bd42270f-8577-4c04-aa41-030adda20a1f tempest-SnapshotMetadataTestJSON-83532776 None] Lock "cinder-quobyte-a4556bc0-72b7-43c5-8196-0694f424f317" acquired by "delete_volume" :: waited 0.027s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:30:04 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[c704e092-f26f-421a-908c-675dc6921726]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:30:04 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-bd42270f-8577-4c04-aa41-030adda20a1f tempest-SnapshotMetadataTestJSON-83532776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a4556bc0-72b7-43c5-8196-0694f424f317 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:30:04 devstack sudo[101683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a4556bc0-72b7-43c5-8196-0694f424f317 Sep 15 16:30:04 devstack sudo[101683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:30:04 devstack sudo[101681]: pam_unix(sudo:session): session closed for user root Sep 15 16:30:04 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-738d51ee-e4e5-49ae-851a-bdb7f400f8a8 tempest-VolumeDependencyTests-1253320995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6e401bc3-66af-469e-ba30-d81829148c76 1073741824" returned: 0 in 0.452s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:30:04 devstack sudo[101683]: pam_unix(sudo:session): session closed for user root Sep 15 16:30:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-bd42270f-8577-4c04-aa41-030adda20a1f tempest-SnapshotMetadataTestJSON-83532776 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a4556bc0-72b7-43c5-8196-0694f424f317" returned: 0 in 0.366s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:30:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-bd42270f-8577-4c04-aa41-030adda20a1f tempest-SnapshotMetadataTestJSON-83532776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a4556bc0-72b7-43c5-8196-0694f424f317 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:30:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-738d51ee-e4e5-49ae-851a-bdb7f400f8a8 tempest-VolumeDependencyTests-1253320995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6e401bc3-66af-469e-ba30-d81829148c76 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:30:05 devstack sudo[101692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a4556bc0-72b7-43c5-8196-0694f424f317 Sep 15 16:30:05 devstack sudo[101692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:30:05 devstack sudo[101693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6e401bc3-66af-469e-ba30-d81829148c76 Sep 15 16:30:05 devstack sudo[101693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:30:05 devstack sudo[101693]: pam_unix(sudo:session): session closed for user root Sep 15 16:30:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-738d51ee-e4e5-49ae-851a-bdb7f400f8a8 tempest-VolumeDependencyTests-1253320995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6e401bc3-66af-469e-ba30-d81829148c76" returned: 0 in 0.235s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:30:05 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-738d51ee-e4e5-49ae-851a-bdb7f400f8a8 tempest-VolumeDependencyTests-1253320995 None] <== create_volume: return (742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:30:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-738d51ee-e4e5-49ae-851a-bdb7f400f8a8 tempest-VolumeDependencyTests-1253320995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.744s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:30:05 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-738d51ee-e4e5-49ae-851a-bdb7f400f8a8 tempest-VolumeDependencyTests-1253320995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1766b34-650d-4d85-a60f-54364e5107d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e401bc3-66af-469e-ba30-d81829148c76', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:30:05 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-738d51ee-e4e5-49ae-851a-bdb7f400f8a8 tempest-VolumeDependencyTests-1253320995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cffd7bd-3acd-4351-ac98-c0f11d7b2bc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:30:05 devstack sudo[101692]: pam_unix(sudo:session): session closed for user root Sep 15 16:30:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-bd42270f-8577-4c04-aa41-030adda20a1f tempest-SnapshotMetadataTestJSON-83532776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a4556bc0-72b7-43c5-8196-0694f424f317" returned: 0 in 0.276s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:30:05 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-738d51ee-e4e5-49ae-851a-bdb7f400f8a8 tempest-VolumeDependencyTests-1253320995 None] Volume volume-6e401bc3-66af-469e-ba30-d81829148c76 (6e401bc3-66af-469e-ba30-d81829148c76): created successfully Sep 15 16:30:05 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-738d51ee-e4e5-49ae-851a-bdb7f400f8a8 tempest-VolumeDependencyTests-1253320995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cffd7bd-3acd-4351-ac98-c0f11d7b2bc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:30:05 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-738d51ee-e4e5-49ae-851a-bdb7f400f8a8 tempest-VolumeDependencyTests-1253320995 None] Flow 'volume_create_manager' (a60f6833-ad0f-49f4-8acd-ecf4e2d1012e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:30:05 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-bd42270f-8577-4c04-aa41-030adda20a1f tempest-SnapshotMetadataTestJSON-83532776 None] Lock "cinder-quobyte-a4556bc0-72b7-43c5-8196-0694f424f317" released by "delete_volume" :: held 0.736s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:30:05 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-738d51ee-e4e5-49ae-851a-bdb7f400f8a8 tempest-VolumeDependencyTests-1253320995 None] Created volume successfully. Sep 15 16:30:05 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-bd42270f-8577-4c04-aa41-030adda20a1f tempest-SnapshotMetadataTestJSON-83532776 None] Created reservations ['100048a6-f9a0-4e40-96ef-4f2a7e16eea4', 'bb19df94-f11c-459f-87a3-fdee88489eba', '0814d5f8-811d-4392-81bc-2af1196a463f', '40528784-5130-4e0a-bc90-b78f0c558cc9'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:30:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-bd42270f-8577-4c04-aa41-030adda20a1f tempest-SnapshotMetadataTestJSON-83532776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:30:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-bd42270f-8577-4c04-aa41-030adda20a1f tempest-SnapshotMetadataTestJSON-83532776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:30:05 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-bd42270f-8577-4c04-aa41-030adda20a1f tempest-SnapshotMetadataTestJSON-83532776 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:30:05 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-bd42270f-8577-4c04-aa41-030adda20a1f tempest-SnapshotMetadataTestJSON-83532776 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:30:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-bd42270f-8577-4c04-aa41-030adda20a1f tempest-SnapshotMetadataTestJSON-83532776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:30:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-bd42270f-8577-4c04-aa41-030adda20a1f tempest-SnapshotMetadataTestJSON-83532776 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:30:05 devstack sudo[101698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:30:05 devstack sudo[101698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:30:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-9c05acb0-e0cc-4b99-8f3f-9a59a36367ce tempest-VolumeDependencyTests-1253320995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:30:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-9c05acb0-e0cc-4b99-8f3f-9a59a36367ce tempest-VolumeDependencyTests-1253320995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:30:05 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-9c05acb0-e0cc-4b99-8f3f-9a59a36367ce tempest-VolumeDependencyTests-1253320995 None] Creating offline snapshot 62388d0b-db61-4955-b6f0-3f6d1ffb74b4 of volume 6e401bc3-66af-469e-ba30-d81829148c76 {{(pid=86082) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 15 16:30:05 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0f33f31-f91c-410c-bc88-2a16e5777e41]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:30:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9c05acb0-e0cc-4b99-8f3f-9a59a36367ce tempest-VolumeDependencyTests-1253320995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6e401bc3-66af-469e-ba30-d81829148c76 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:30:05 devstack sudo[101698]: pam_unix(sudo:session): session closed for user root Sep 15 16:30:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-bd42270f-8577-4c04-aa41-030adda20a1f tempest-SnapshotMetadataTestJSON-83532776 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.311s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:30:05 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-bd42270f-8577-4c04-aa41-030adda20a1f tempest-SnapshotMetadataTestJSON-83532776 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:30:05 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-bd42270f-8577-4c04-aa41-030adda20a1f tempest-SnapshotMetadataTestJSON-83532776 None] Deleted volume successfully. Sep 15 16:30:05 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-bd42270f-8577-4c04-aa41-030adda20a1f tempest-SnapshotMetadataTestJSON-83532776 None] Lock "cinder-a4556bc0-72b7-43c5-8196-0694f424f317-delete_volume" released by "delete_volume" :: held 1.368s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:30:05 devstack sudo[101701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6e401bc3-66af-469e-ba30-d81829148c76 Sep 15 16:30:05 devstack sudo[101701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:30:06 devstack sudo[101701]: pam_unix(sudo:session): session closed for user root Sep 15 16:30:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9c05acb0-e0cc-4b99-8f3f-9a59a36367ce tempest-VolumeDependencyTests-1253320995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6e401bc3-66af-469e-ba30-d81829148c76" returned: 0 in 0.375s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:30:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9c05acb0-e0cc-4b99-8f3f-9a59a36367ce tempest-VolumeDependencyTests-1253320995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6e401bc3-66af-469e-ba30-d81829148c76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6e401bc3-66af-469e-ba30-d81829148c76.62388d0b-db61-4955-b6f0-3f6d1ffb74b4 1G {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:30:06 devstack sudo[101706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6e401bc3-66af-469e-ba30-d81829148c76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6e401bc3-66af-469e-ba30-d81829148c76.62388d0b-db61-4955-b6f0-3f6d1ffb74b4 1G Sep 15 16:30:06 devstack sudo[101706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:30:06 devstack sudo[101706]: pam_unix(sudo:session): session closed for user root Sep 15 16:30:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9c05acb0-e0cc-4b99-8f3f-9a59a36367ce tempest-VolumeDependencyTests-1253320995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6e401bc3-66af-469e-ba30-d81829148c76,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6e401bc3-66af-469e-ba30-d81829148c76.62388d0b-db61-4955-b6f0-3f6d1ffb74b4 1G" returned: 0 in 0.426s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:30:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9c05acb0-e0cc-4b99-8f3f-9a59a36367ce tempest-VolumeDependencyTests-1253320995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e401bc3-66af-469e-ba30-d81829148c76 -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6e401bc3-66af-469e-ba30-d81829148c76.62388d0b-db61-4955-b6f0-3f6d1ffb74b4 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:30:06 devstack sudo[101712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e401bc3-66af-469e-ba30-d81829148c76 -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6e401bc3-66af-469e-ba30-d81829148c76.62388d0b-db61-4955-b6f0-3f6d1ffb74b4 Sep 15 16:30:06 devstack sudo[101712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:30:06 devstack sudo[101712]: pam_unix(sudo:session): session closed for user root Sep 15 16:30:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9c05acb0-e0cc-4b99-8f3f-9a59a36367ce tempest-VolumeDependencyTests-1253320995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6e401bc3-66af-469e-ba30-d81829148c76 -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6e401bc3-66af-469e-ba30-d81829148c76.62388d0b-db61-4955-b6f0-3f6d1ffb74b4" returned: 0 in 0.322s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:30:06 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-9c05acb0-e0cc-4b99-8f3f-9a59a36367ce tempest-VolumeDependencyTests-1253320995 None] /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6e401bc3-66af-469e-ba30-d81829148c76.62388d0b-db61-4955-b6f0-3f6d1ffb74b4 is being set with open permissions: ugo+rw Sep 15 16:30:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9c05acb0-e0cc-4b99-8f3f-9a59a36367ce tempest-VolumeDependencyTests-1253320995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6e401bc3-66af-469e-ba30-d81829148c76.62388d0b-db61-4955-b6f0-3f6d1ffb74b4 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:30:06 devstack sudo[101718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6e401bc3-66af-469e-ba30-d81829148c76.62388d0b-db61-4955-b6f0-3f6d1ffb74b4 Sep 15 16:30:06 devstack sudo[101718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:30:07 devstack sudo[101718]: pam_unix(sudo:session): session closed for user root Sep 15 16:30:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9c05acb0-e0cc-4b99-8f3f-9a59a36367ce tempest-VolumeDependencyTests-1253320995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6e401bc3-66af-469e-ba30-d81829148c76.62388d0b-db61-4955-b6f0-3f6d1ffb74b4" returned: 0 in 0.273s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:30:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9c05acb0-e0cc-4b99-8f3f-9a59a36367ce tempest-VolumeDependencyTests-1253320995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6e401bc3-66af-469e-ba30-d81829148c76.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:30:07 devstack sudo[101721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6e401bc3-66af-469e-ba30-d81829148c76.info Sep 15 16:30:07 devstack sudo[101721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:30:07 devstack sudo[101721]: pam_unix(sudo:session): session closed for user root Sep 15 16:30:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9c05acb0-e0cc-4b99-8f3f-9a59a36367ce tempest-VolumeDependencyTests-1253320995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6e401bc3-66af-469e-ba30-d81829148c76.info" returned: 0 in 0.256s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:30:07 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-9c05acb0-e0cc-4b99-8f3f-9a59a36367ce tempest-VolumeDependencyTests-1253320995 None] /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6e401bc3-66af-469e-ba30-d81829148c76.info is being set with open permissions: ugo+rw Sep 15 16:30:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9c05acb0-e0cc-4b99-8f3f-9a59a36367ce tempest-VolumeDependencyTests-1253320995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6e401bc3-66af-469e-ba30-d81829148c76.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:30:07 devstack sudo[101724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6e401bc3-66af-469e-ba30-d81829148c76.info Sep 15 16:30:07 devstack sudo[101724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:30:07 devstack sudo[101724]: pam_unix(sudo:session): session closed for user root Sep 15 16:30:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9c05acb0-e0cc-4b99-8f3f-9a59a36367ce tempest-VolumeDependencyTests-1253320995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6e401bc3-66af-469e-ba30-d81829148c76.info" returned: 0 in 0.243s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:30:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-9c05acb0-e0cc-4b99-8f3f-9a59a36367ce tempest-VolumeDependencyTests-1253320995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.988s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:30:07 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-9c05acb0-e0cc-4b99-8f3f-9a59a36367ce tempest-VolumeDependencyTests-1253320995 None] Create snapshot completed successfully Sep 15 16:30:09 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-51be2ae1-6341-47dc-a0aa-8dc490994c11 tempest-VolumeDependencyTests-1253320995 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:30:09 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-51be2ae1-6341-47dc-a0aa-8dc490994c11 tempest-VolumeDependencyTests-1253320995 None] Flow 'volume_create_manager' (24b22b73-2a60-47d7-b245-6b785dffd6cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:30:09 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-51be2ae1-6341-47dc-a0aa-8dc490994c11 tempest-VolumeDependencyTests-1253320995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e43ce48-6a37-4c04-9dd4-60d9c9447ae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:30:09 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-51be2ae1-6341-47dc-a0aa-8dc490994c11 tempest-VolumeDependencyTests-1253320995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e43ce48-6a37-4c04-9dd4-60d9c9447ae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:30:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1433699937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55d2d21a-854c-4eb3-a4f1-269f9435d295,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7371d1caaa94445e9fbe331de3698eae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:30:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=62388d0b-db61-4955-b6f0-3f6d1ffb74b4,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:30:09Z,use_quota=True,user_id='cb7d5a5dbf664c04bce4620d58a55936',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:30:09 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-51be2ae1-6341-47dc-a0aa-8dc490994c11 tempest-VolumeDependencyTests-1253320995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c8528c4-c3ee-478a-94c4-d9dfddaa723f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:30:09 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-51be2ae1-6341-47dc-a0aa-8dc490994c11 tempest-VolumeDependencyTests-1253320995 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c8528c4-c3ee-478a-94c4-d9dfddaa723f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:30:09 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-51be2ae1-6341-47dc-a0aa-8dc490994c11 tempest-VolumeDependencyTests-1253320995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d7e0056-c5ab-4c60-8d16-77d541075c45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:30:09 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-51be2ae1-6341-47dc-a0aa-8dc490994c11 tempest-VolumeDependencyTests-1253320995 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d7e0056-c5ab-4c60-8d16-77d541075c45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '55d2d21a-854c-4eb3-a4f1-269f9435d295', 'volume_name': 'volume-55d2d21a-854c-4eb3-a4f1-269f9435d295', 'volume_size': 1, 'snapshot_id': '62388d0b-db61-4955-b6f0-3f6d1ffb74b4'}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:30:09 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-51be2ae1-6341-47dc-a0aa-8dc490994c11 tempest-VolumeDependencyTests-1253320995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12f87135-9cd0-4625-a788-8b72c2ee52ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:30:09 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-51be2ae1-6341-47dc-a0aa-8dc490994c11 tempest-VolumeDependencyTests-1253320995 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12f87135-9cd0-4625-a788-8b72c2ee52ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:30:09 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-51be2ae1-6341-47dc-a0aa-8dc490994c11 tempest-VolumeDependencyTests-1253320995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a886c27-32cd-4041-972a-1ec3c071e67f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:30:09 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-51be2ae1-6341-47dc-a0aa-8dc490994c11 tempest-VolumeDependencyTests-1253320995 None] Volume 55d2d21a-854c-4eb3-a4f1-269f9435d295: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-55d2d21a-854c-4eb3-a4f1-269f9435d295', 'volume_size': 1, 'snapshot_id': '62388d0b-db61-4955-b6f0-3f6d1ffb74b4'} Sep 15 16:30:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-51be2ae1-6341-47dc-a0aa-8dc490994c11 tempest-VolumeDependencyTests-1253320995 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:30:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-51be2ae1-6341-47dc-a0aa-8dc490994c11 tempest-VolumeDependencyTests-1253320995 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:30:09 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-51be2ae1-6341-47dc-a0aa-8dc490994c11 tempest-VolumeDependencyTests-1253320995 None] Acquiring lock "cinder-quobyte-62388d0b-db61-4955-b6f0-3f6d1ffb74b4-55d2d21a-854c-4eb3-a4f1-269f9435d295" by "_create_volume_from_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:30:09 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-51be2ae1-6341-47dc-a0aa-8dc490994c11 tempest-VolumeDependencyTests-1253320995 None] Lock "cinder-quobyte-62388d0b-db61-4955-b6f0-3f6d1ffb74b4-55d2d21a-854c-4eb3-a4f1-269f9435d295" acquired by "_create_volume_from_snapshot" :: waited 0.012s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:30:09 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-51be2ae1-6341-47dc-a0aa-8dc490994c11 tempest-VolumeDependencyTests-1253320995 None] Creating volume 55d2d21a-854c-4eb3-a4f1-269f9435d295 from snapshot 62388d0b-db61-4955-b6f0-3f6d1ffb74b4 {{(pid=86082) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 15 16:30:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-51be2ae1-6341-47dc-a0aa-8dc490994c11 tempest-VolumeDependencyTests-1253320995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:30:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-51be2ae1-6341-47dc-a0aa-8dc490994c11 tempest-VolumeDependencyTests-1253320995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:30:09 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-51be2ae1-6341-47dc-a0aa-8dc490994c11 tempest-VolumeDependencyTests-1253320995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:30:09 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-51be2ae1-6341-47dc-a0aa-8dc490994c11 tempest-VolumeDependencyTests-1253320995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:30:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-51be2ae1-6341-47dc-a0aa-8dc490994c11 tempest-VolumeDependencyTests-1253320995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:30:09 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-51be2ae1-6341-47dc-a0aa-8dc490994c11 tempest-VolumeDependencyTests-1253320995 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:30:09 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-51be2ae1-6341-47dc-a0aa-8dc490994c11 tempest-VolumeDependencyTests-1253320995 None] Acquiring lock "cinder-quobyte-55d2d21a-854c-4eb3-a4f1-269f9435d295" by "_copy_volume_from_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:30:09 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-51be2ae1-6341-47dc-a0aa-8dc490994c11 tempest-VolumeDependencyTests-1253320995 None] Lock "cinder-quobyte-55d2d21a-854c-4eb3-a4f1-269f9435d295" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:30:09 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-51be2ae1-6341-47dc-a0aa-8dc490994c11 tempest-VolumeDependencyTests-1253320995 None] snapshot: 62388d0b-db61-4955-b6f0-3f6d1ffb74b4, volume: 55d2d21a-854c-4eb3-a4f1-269f9435d295, {{(pid=86082) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 15 16:30:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-51be2ae1-6341-47dc-a0aa-8dc490994c11 tempest-VolumeDependencyTests-1253320995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:30:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-51be2ae1-6341-47dc-a0aa-8dc490994c11 tempest-VolumeDependencyTests-1253320995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:30:09 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-51be2ae1-6341-47dc-a0aa-8dc490994c11 tempest-VolumeDependencyTests-1253320995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:30:09 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-51be2ae1-6341-47dc-a0aa-8dc490994c11 tempest-VolumeDependencyTests-1253320995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:30:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-51be2ae1-6341-47dc-a0aa-8dc490994c11 tempest-VolumeDependencyTests-1253320995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:30:09 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[989703a0-97b9-4e69-810f-514465b24161]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:30:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-51be2ae1-6341-47dc-a0aa-8dc490994c11 tempest-VolumeDependencyTests-1253320995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6e401bc3-66af-469e-ba30-d81829148c76.62388d0b-db61-4955-b6f0-3f6d1ffb74b4 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:30:09 devstack sudo[101729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6e401bc3-66af-469e-ba30-d81829148c76.62388d0b-db61-4955-b6f0-3f6d1ffb74b4 Sep 15 16:30:09 devstack sudo[101729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:30:09 devstack sudo[101729]: pam_unix(sudo:session): session closed for user root Sep 15 16:30:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-51be2ae1-6341-47dc-a0aa-8dc490994c11 tempest-VolumeDependencyTests-1253320995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6e401bc3-66af-469e-ba30-d81829148c76.62388d0b-db61-4955-b6f0-3f6d1ffb74b4" returned: 0 in 0.382s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:30:09 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-51be2ae1-6341-47dc-a0aa-8dc490994c11 tempest-VolumeDependencyTests-1253320995 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e401bc3-66af-469e-ba30-d81829148c76(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 16:30:09 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c541366-5ae0-41a3-b99f-2851d6a84b4a]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:30:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-51be2ae1-6341-47dc-a0aa-8dc490994c11 tempest-VolumeDependencyTests-1253320995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6e401bc3-66af-469e-ba30-d81829148c76 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:30:09 devstack sudo[101734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6e401bc3-66af-469e-ba30-d81829148c76 Sep 15 16:30:09 devstack sudo[101734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:30:10 devstack sudo[101734]: pam_unix(sudo:session): session closed for user root Sep 15 16:30:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-51be2ae1-6341-47dc-a0aa-8dc490994c11 tempest-VolumeDependencyTests-1253320995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6e401bc3-66af-469e-ba30-d81829148c76" returned: 0 in 0.424s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:30:10 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-51be2ae1-6341-47dc-a0aa-8dc490994c11 tempest-VolumeDependencyTests-1253320995 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6e401bc3-66af-469e-ba30-d81829148c76 {{(pid=86082) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 15 16:30:10 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-51be2ae1-6341-47dc-a0aa-8dc490994c11 tempest-VolumeDependencyTests-1253320995 None] Creating direct copy from snapshot {{(pid=86082) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 15 16:30:10 devstack cinder-volume[86082]: DEBUG cinder.utils [None req-51be2ae1-6341-47dc-a0aa-8dc490994c11 tempest-VolumeDependencyTests-1253320995 None] Path /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-55d2d21a-854c-4eb3-a4f1-269f9435d295 not found in is_blk_device check {{(pid=86082) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 15 16:30:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-51be2ae1-6341-47dc-a0aa-8dc490994c11 tempest-VolumeDependencyTests-1253320995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6e401bc3-66af-469e-ba30-d81829148c76 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-55d2d21a-854c-4eb3-a4f1-269f9435d295 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:30:10 devstack sudo[101740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6e401bc3-66af-469e-ba30-d81829148c76 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-55d2d21a-854c-4eb3-a4f1-269f9435d295 Sep 15 16:30:10 devstack sudo[101740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:30:10 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-e20e1d0c-af75-40c5-a8b3-e28c2cfb148e tempest-VolumesTransfersV355Test-1255000157 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:30:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e20e1d0c-af75-40c5-a8b3-e28c2cfb148e tempest-VolumesTransfersV355Test-1255000157 None] Flow 'volume_create_manager' (7e18abd8-dae4-4c9c-ac63-a16a4513f169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:30:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e20e1d0c-af75-40c5-a8b3-e28c2cfb148e tempest-VolumesTransfersV355Test-1255000157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e5b003a-0576-4a06-9071-ce174ace35a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:30:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e20e1d0c-af75-40c5-a8b3-e28c2cfb148e tempest-VolumesTransfersV355Test-1255000157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e5b003a-0576-4a06-9071-ce174ace35a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:30:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-553114000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9347cf4-4db6-4342-a923-2d3a5bcd50f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ddcc8ae2d4641c897f9de45902e889b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:30:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:30:11Z,use_quota=True,user_id='e07ed57d216147a78fe07d3e1486af84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:30:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e20e1d0c-af75-40c5-a8b3-e28c2cfb148e tempest-VolumesTransfersV355Test-1255000157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a084ba41-bfcc-48b9-81f4-a776b99ea532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:30:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e20e1d0c-af75-40c5-a8b3-e28c2cfb148e tempest-VolumesTransfersV355Test-1255000157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a084ba41-bfcc-48b9-81f4-a776b99ea532) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:30:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e20e1d0c-af75-40c5-a8b3-e28c2cfb148e tempest-VolumesTransfersV355Test-1255000157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (454c7cfb-48a7-46fc-ae4e-1eaa10c0c71c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:30:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e20e1d0c-af75-40c5-a8b3-e28c2cfb148e tempest-VolumesTransfersV355Test-1255000157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (454c7cfb-48a7-46fc-ae4e-1eaa10c0c71c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9347cf4-4db6-4342-a923-2d3a5bcd50f6', 'volume_name': 'volume-f9347cf4-4db6-4342-a923-2d3a5bcd50f6', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:30:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e20e1d0c-af75-40c5-a8b3-e28c2cfb148e tempest-VolumesTransfersV355Test-1255000157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e979a30-2f2f-4974-8777-6157b17a1363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:30:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e20e1d0c-af75-40c5-a8b3-e28c2cfb148e tempest-VolumesTransfersV355Test-1255000157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e979a30-2f2f-4974-8777-6157b17a1363) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:30:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e20e1d0c-af75-40c5-a8b3-e28c2cfb148e tempest-VolumesTransfersV355Test-1255000157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (029f34ea-4761-4a32-a768-8246dbf9e45a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:30:10 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-e20e1d0c-af75-40c5-a8b3-e28c2cfb148e tempest-VolumesTransfersV355Test-1255000157 None] Volume f9347cf4-4db6-4342-a923-2d3a5bcd50f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9347cf4-4db6-4342-a923-2d3a5bcd50f6', 'volume_size': 1} Sep 15 16:30:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-e20e1d0c-af75-40c5-a8b3-e28c2cfb148e tempest-VolumesTransfersV355Test-1255000157 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:30:16 devstack sudo[101740]: pam_unix(sudo:session): session closed for user root Sep 15 16:30:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-51be2ae1-6341-47dc-a0aa-8dc490994c11 tempest-VolumeDependencyTests-1253320995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6e401bc3-66af-469e-ba30-d81829148c76 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-55d2d21a-854c-4eb3-a4f1-269f9435d295" returned: 0 in 5.696s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:30:16 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-51be2ae1-6341-47dc-a0aa-8dc490994c11 tempest-VolumeDependencyTests-1253320995 None] Image conversion details: src /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6e401bc3-66af-469e-ba30-d81829148c76, size 1024.00 MB, duration 5.70 sec, destination /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-55d2d21a-854c-4eb3-a4f1-269f9435d295 {{(pid=86082) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 15 16:30:16 devstack cinder-volume[86082]: INFO cinder.image.image_utils [None req-51be2ae1-6341-47dc-a0aa-8dc490994c11 tempest-VolumeDependencyTests-1253320995 None] Converted 1024.00 MB image at 179.76 MB/s Sep 15 16:30:16 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-51be2ae1-6341-47dc-a0aa-8dc490994c11 tempest-VolumeDependencyTests-1253320995 None] /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-55d2d21a-854c-4eb3-a4f1-269f9435d295 is being set with open permissions: ugo+rw Sep 15 16:30:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-51be2ae1-6341-47dc-a0aa-8dc490994c11 tempest-VolumeDependencyTests-1253320995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-55d2d21a-854c-4eb3-a4f1-269f9435d295 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:30:16 devstack sudo[101753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-55d2d21a-854c-4eb3-a4f1-269f9435d295 Sep 15 16:30:16 devstack sudo[101753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:30:16 devstack sudo[101753]: pam_unix(sudo:session): session closed for user root Sep 15 16:30:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-51be2ae1-6341-47dc-a0aa-8dc490994c11 tempest-VolumeDependencyTests-1253320995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-55d2d21a-854c-4eb3-a4f1-269f9435d295" returned: 0 in 0.238s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:30:16 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-51be2ae1-6341-47dc-a0aa-8dc490994c11 tempest-VolumeDependencyTests-1253320995 None] Lock "cinder-quobyte-55d2d21a-854c-4eb3-a4f1-269f9435d295" released by "_copy_volume_from_snapshot" :: held 6.832s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:30:16 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-51be2ae1-6341-47dc-a0aa-8dc490994c11 tempest-VolumeDependencyTests-1253320995 None] Lock "cinder-quobyte-62388d0b-db61-4955-b6f0-3f6d1ffb74b4-55d2d21a-854c-4eb3-a4f1-269f9435d295" released by "_create_volume_from_snapshot" :: held 6.894s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:30:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-51be2ae1-6341-47dc-a0aa-8dc490994c11 tempest-VolumeDependencyTests-1253320995 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.908s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:30:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-e20e1d0c-af75-40c5-a8b3-e28c2cfb148e tempest-VolumesTransfersV355Test-1255000157 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.633s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:30:16 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-e20e1d0c-af75-40c5-a8b3-e28c2cfb148e tempest-VolumesTransfersV355Test-1255000157 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:30:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-553114000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9347cf4-4db6-4342-a923-2d3a5bcd50f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ddcc8ae2d4641c897f9de45902e889b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:30:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:30:11Z,use_quota=True,user_id='e07ed57d216147a78fe07d3e1486af84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:30:16 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-e20e1d0c-af75-40c5-a8b3-e28c2cfb148e tempest-VolumesTransfersV355Test-1255000157 None] Creating volume f9347cf4-4db6-4342-a923-2d3a5bcd50f6 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:30:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-e20e1d0c-af75-40c5-a8b3-e28c2cfb148e tempest-VolumesTransfersV355Test-1255000157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:30:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-e20e1d0c-af75-40c5-a8b3-e28c2cfb148e tempest-VolumesTransfersV355Test-1255000157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:30:16 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-e20e1d0c-af75-40c5-a8b3-e28c2cfb148e tempest-VolumesTransfersV355Test-1255000157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:30:16 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-e20e1d0c-af75-40c5-a8b3-e28c2cfb148e tempest-VolumesTransfersV355Test-1255000157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:30:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-e20e1d0c-af75-40c5-a8b3-e28c2cfb148e tempest-VolumesTransfersV355Test-1255000157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:30:16 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-e20e1d0c-af75-40c5-a8b3-e28c2cfb148e tempest-VolumesTransfersV355Test-1255000157 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:30:16 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-e20e1d0c-af75-40c5-a8b3-e28c2cfb148e tempest-VolumesTransfersV355Test-1255000157 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:30:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e20e1d0c-af75-40c5-a8b3-e28c2cfb148e tempest-VolumesTransfersV355Test-1255000157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-f9347cf4-4db6-4342-a923-2d3a5bcd50f6 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:30:16 devstack sudo[101792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-f9347cf4-4db6-4342-a923-2d3a5bcd50f6 1073741824 Sep 15 16:30:16 devstack sudo[101792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:30:16 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-51be2ae1-6341-47dc-a0aa-8dc490994c11 tempest-VolumeDependencyTests-1253320995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a886c27-32cd-4041-972a-1ec3c071e67f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55d2d21a-854c-4eb3-a4f1-269f9435d295', 'volume_size': 1, 'snapshot_id': '62388d0b-db61-4955-b6f0-3f6d1ffb74b4'}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:30:16 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-51be2ae1-6341-47dc-a0aa-8dc490994c11 tempest-VolumeDependencyTests-1253320995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (494f18e3-1a42-47d9-9b29-93dc8cc52921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:30:16 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-51be2ae1-6341-47dc-a0aa-8dc490994c11 tempest-VolumeDependencyTests-1253320995 None] Volume volume-55d2d21a-854c-4eb3-a4f1-269f9435d295 (55d2d21a-854c-4eb3-a4f1-269f9435d295): created successfully Sep 15 16:30:16 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-51be2ae1-6341-47dc-a0aa-8dc490994c11 tempest-VolumeDependencyTests-1253320995 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (494f18e3-1a42-47d9-9b29-93dc8cc52921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:30:16 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-51be2ae1-6341-47dc-a0aa-8dc490994c11 tempest-VolumeDependencyTests-1253320995 None] Flow 'volume_create_manager' (24b22b73-2a60-47d7-b245-6b785dffd6cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:30:16 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-51be2ae1-6341-47dc-a0aa-8dc490994c11 tempest-VolumeDependencyTests-1253320995 None] Created volume successfully. Sep 15 16:30:16 devstack sudo[101792]: pam_unix(sudo:session): session closed for user root Sep 15 16:30:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e20e1d0c-af75-40c5-a8b3-e28c2cfb148e tempest-VolumesTransfersV355Test-1255000157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-f9347cf4-4db6-4342-a923-2d3a5bcd50f6 1073741824" returned: 0 in 0.430s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:30:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e20e1d0c-af75-40c5-a8b3-e28c2cfb148e tempest-VolumesTransfersV355Test-1255000157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-f9347cf4-4db6-4342-a923-2d3a5bcd50f6 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:30:16 devstack sudo[101798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-f9347cf4-4db6-4342-a923-2d3a5bcd50f6 Sep 15 16:30:16 devstack sudo[101798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:30:16 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-e1990b6f-f3ad-45d6-9db3-fb677b00f20d tempest-VolumeDependencyTests-1253320995 None] Acquiring lock "cinder-62388d0b-db61-4955-b6f0-3f6d1ffb74b4-delete_snapshot" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:30:16 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-e1990b6f-f3ad-45d6-9db3-fb677b00f20d tempest-VolumeDependencyTests-1253320995 None] Lock "cinder-62388d0b-db61-4955-b6f0-3f6d1ffb74b4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:30:16 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-e1990b6f-f3ad-45d6-9db3-fb677b00f20d tempest-VolumeDependencyTests-1253320995 None] Acquiring lock "cinder-quobyte-6e401bc3-66af-469e-ba30-d81829148c76" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:30:16 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-e1990b6f-f3ad-45d6-9db3-fb677b00f20d tempest-VolumeDependencyTests-1253320995 None] Lock "cinder-quobyte-6e401bc3-66af-469e-ba30-d81829148c76" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:30:16 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-e1990b6f-f3ad-45d6-9db3-fb677b00f20d tempest-VolumeDependencyTests-1253320995 None] Acquiring lock "cinder-quobyte-62388d0b-db61-4955-b6f0-3f6d1ffb74b4" by "_delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:30:16 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-e1990b6f-f3ad-45d6-9db3-fb677b00f20d tempest-VolumeDependencyTests-1253320995 None] Lock "cinder-quobyte-62388d0b-db61-4955-b6f0-3f6d1ffb74b4" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:30:16 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-e1990b6f-f3ad-45d6-9db3-fb677b00f20d tempest-VolumeDependencyTests-1253320995 None] Deleting offline snapshot 62388d0b-db61-4955-b6f0-3f6d1ffb74b4 of volume 6e401bc3-66af-469e-ba30-d81829148c76 {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 15 16:30:16 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-e1990b6f-f3ad-45d6-9db3-fb677b00f20d tempest-VolumeDependencyTests-1253320995 None] snapshot_file for this snap is: volume-6e401bc3-66af-469e-ba30-d81829148c76.62388d0b-db61-4955-b6f0-3f6d1ffb74b4 {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 15 16:30:16 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b33302a-ecea-4dae-8605-621abddb5af0]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:30:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e1990b6f-f3ad-45d6-9db3-fb677b00f20d tempest-VolumeDependencyTests-1253320995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6e401bc3-66af-469e-ba30-d81829148c76.62388d0b-db61-4955-b6f0-3f6d1ffb74b4 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:30:17 devstack sudo[101800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6e401bc3-66af-469e-ba30-d81829148c76.62388d0b-db61-4955-b6f0-3f6d1ffb74b4 Sep 15 16:30:17 devstack sudo[101800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:30:17 devstack sudo[101798]: pam_unix(sudo:session): session closed for user root Sep 15 16:30:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e20e1d0c-af75-40c5-a8b3-e28c2cfb148e tempest-VolumesTransfersV355Test-1255000157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-f9347cf4-4db6-4342-a923-2d3a5bcd50f6" returned: 0 in 0.269s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:30:17 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-e20e1d0c-af75-40c5-a8b3-e28c2cfb148e tempest-VolumesTransfersV355Test-1255000157 None] <== create_volume: return (744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:30:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-e20e1d0c-af75-40c5-a8b3-e28c2cfb148e tempest-VolumesTransfersV355Test-1255000157 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.748s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:30:17 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e20e1d0c-af75-40c5-a8b3-e28c2cfb148e tempest-VolumesTransfersV355Test-1255000157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (029f34ea-4761-4a32-a768-8246dbf9e45a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9347cf4-4db6-4342-a923-2d3a5bcd50f6', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:30:17 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e20e1d0c-af75-40c5-a8b3-e28c2cfb148e tempest-VolumesTransfersV355Test-1255000157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91f514bf-756a-4c8f-a861-5dd46bcb3e1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:30:17 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-e20e1d0c-af75-40c5-a8b3-e28c2cfb148e tempest-VolumesTransfersV355Test-1255000157 None] Volume volume-f9347cf4-4db6-4342-a923-2d3a5bcd50f6 (f9347cf4-4db6-4342-a923-2d3a5bcd50f6): created successfully Sep 15 16:30:17 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e20e1d0c-af75-40c5-a8b3-e28c2cfb148e tempest-VolumesTransfersV355Test-1255000157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91f514bf-756a-4c8f-a861-5dd46bcb3e1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:30:17 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e20e1d0c-af75-40c5-a8b3-e28c2cfb148e tempest-VolumesTransfersV355Test-1255000157 None] Flow 'volume_create_manager' (7e18abd8-dae4-4c9c-ac63-a16a4513f169) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:30:17 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-e20e1d0c-af75-40c5-a8b3-e28c2cfb148e tempest-VolumesTransfersV355Test-1255000157 None] Created volume successfully. Sep 15 16:30:17 devstack sudo[101800]: pam_unix(sudo:session): session closed for user root Sep 15 16:30:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e1990b6f-f3ad-45d6-9db3-fb677b00f20d tempest-VolumeDependencyTests-1253320995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6e401bc3-66af-469e-ba30-d81829148c76.62388d0b-db61-4955-b6f0-3f6d1ffb74b4" returned: 0 in 0.364s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:30:17 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-e1990b6f-f3ad-45d6-9db3-fb677b00f20d tempest-VolumeDependencyTests-1253320995 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6e401bc3-66af-469e-ba30-d81829148c76(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 16:30:17 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd6973a9-f635-4201-8995-a31d6f494c3d]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:30:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e1990b6f-f3ad-45d6-9db3-fb677b00f20d tempest-VolumeDependencyTests-1253320995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6e401bc3-66af-469e-ba30-d81829148c76 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:30:17 devstack sudo[101806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6e401bc3-66af-469e-ba30-d81829148c76 Sep 15 16:30:17 devstack sudo[101806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:30:17 devstack sudo[101806]: pam_unix(sudo:session): session closed for user root Sep 15 16:30:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e1990b6f-f3ad-45d6-9db3-fb677b00f20d tempest-VolumeDependencyTests-1253320995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6e401bc3-66af-469e-ba30-d81829148c76" returned: 0 in 0.507s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:30:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e1990b6f-f3ad-45d6-9db3-fb677b00f20d tempest-VolumeDependencyTests-1253320995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6e401bc3-66af-469e-ba30-d81829148c76.62388d0b-db61-4955-b6f0-3f6d1ffb74b4 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:30:17 devstack sudo[101811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6e401bc3-66af-469e-ba30-d81829148c76.62388d0b-db61-4955-b6f0-3f6d1ffb74b4 Sep 15 16:30:17 devstack sudo[101811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:30:18 devstack sudo[101811]: pam_unix(sudo:session): session closed for user root Sep 15 16:30:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e1990b6f-f3ad-45d6-9db3-fb677b00f20d tempest-VolumeDependencyTests-1253320995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6e401bc3-66af-469e-ba30-d81829148c76.62388d0b-db61-4955-b6f0-3f6d1ffb74b4" returned: 0 in 0.368s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:30:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e1990b6f-f3ad-45d6-9db3-fb677b00f20d tempest-VolumeDependencyTests-1253320995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6e401bc3-66af-469e-ba30-d81829148c76.62388d0b-db61-4955-b6f0-3f6d1ffb74b4 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:30:18 devstack sudo[101816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6e401bc3-66af-469e-ba30-d81829148c76.62388d0b-db61-4955-b6f0-3f6d1ffb74b4 Sep 15 16:30:18 devstack sudo[101816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:30:18 devstack sudo[101816]: pam_unix(sudo:session): session closed for user root Sep 15 16:30:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e1990b6f-f3ad-45d6-9db3-fb677b00f20d tempest-VolumeDependencyTests-1253320995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6e401bc3-66af-469e-ba30-d81829148c76.62388d0b-db61-4955-b6f0-3f6d1ffb74b4" returned: 0 in 0.252s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:30:18 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-e1990b6f-f3ad-45d6-9db3-fb677b00f20d tempest-VolumeDependencyTests-1253320995 None] Lock "cinder-quobyte-62388d0b-db61-4955-b6f0-3f6d1ffb74b4" released by "_delete_snapshot" :: held 1.606s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:30:18 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-e1990b6f-f3ad-45d6-9db3-fb677b00f20d tempest-VolumeDependencyTests-1253320995 None] Lock "cinder-quobyte-6e401bc3-66af-469e-ba30-d81829148c76" released by "delete_snapshot" :: held 1.634s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:30:18 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-e1990b6f-f3ad-45d6-9db3-fb677b00f20d tempest-VolumeDependencyTests-1253320995 None] Created reservations ['9bf72745-492d-47a7-927d-259b4d8fe029', 'c0a79771-86fa-46d8-a72e-25146241cfb2', '3166fafe-64cb-4c71-81f3-ab88f065cbb6', '4c98562e-f4fd-4730-9e4c-0aa6d0682dd0'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:30:18 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-e1990b6f-f3ad-45d6-9db3-fb677b00f20d tempest-VolumeDependencyTests-1253320995 None] Delete snapshot completed successfully. Sep 15 16:30:18 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-e1990b6f-f3ad-45d6-9db3-fb677b00f20d tempest-VolumeDependencyTests-1253320995 None] Lock "cinder-62388d0b-db61-4955-b6f0-3f6d1ffb74b4-delete_snapshot" released by "delete_snapshot" :: held 1.776s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:30:18 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-c01c0f39-ef33-4ccd-9c26-c31cbc23e6de tempest-VolumesTransfersV355Test-1437469923 None] Transfer volume completed successfully. Sep 15 16:30:18 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-2889f19d-8cbf-49d3-b633-bb2dd7fb0339 tempest-VolumeDependencyTests-1253320995 None] Acquiring lock "cinder-6e401bc3-66af-469e-ba30-d81829148c76-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:30:18 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-2889f19d-8cbf-49d3-b633-bb2dd7fb0339 tempest-VolumeDependencyTests-1253320995 None] Lock "cinder-6e401bc3-66af-469e-ba30-d81829148c76-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:30:19 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-2889f19d-8cbf-49d3-b633-bb2dd7fb0339 tempest-VolumeDependencyTests-1253320995 None] Acquiring lock "cinder-quobyte-6e401bc3-66af-469e-ba30-d81829148c76" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:30:19 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-2889f19d-8cbf-49d3-b633-bb2dd7fb0339 tempest-VolumeDependencyTests-1253320995 None] Lock "cinder-quobyte-6e401bc3-66af-469e-ba30-d81829148c76" acquired by "delete_volume" :: waited 0.020s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:30:19 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[b71478f9-71d9-46b0-abed-9ef546ab8c95]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:30:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2889f19d-8cbf-49d3-b633-bb2dd7fb0339 tempest-VolumeDependencyTests-1253320995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6e401bc3-66af-469e-ba30-d81829148c76 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:30:19 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-8e7d4481-cb72-4d4a-bcb4-3eb0293b8a76 tempest-VolumesTransfersV355Test-597979107 None] Acquiring lock "cinder-f9347cf4-4db6-4342-a923-2d3a5bcd50f6-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:30:19 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-8e7d4481-cb72-4d4a-bcb4-3eb0293b8a76 tempest-VolumesTransfersV355Test-597979107 None] Lock "cinder-f9347cf4-4db6-4342-a923-2d3a5bcd50f6-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:30:19 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-8e7d4481-cb72-4d4a-bcb4-3eb0293b8a76 tempest-VolumesTransfersV355Test-597979107 None] Acquiring lock "cinder-quobyte-f9347cf4-4db6-4342-a923-2d3a5bcd50f6" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:30:19 devstack sudo[101819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6e401bc3-66af-469e-ba30-d81829148c76 Sep 15 16:30:19 devstack sudo[101819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:30:19 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-8e7d4481-cb72-4d4a-bcb4-3eb0293b8a76 tempest-VolumesTransfersV355Test-597979107 None] Lock "cinder-quobyte-f9347cf4-4db6-4342-a923-2d3a5bcd50f6" acquired by "delete_volume" :: waited 0.015s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:30:19 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1a14796-47ae-49c6-b3b5-16910759342e]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:30:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8e7d4481-cb72-4d4a-bcb4-3eb0293b8a76 tempest-VolumesTransfersV355Test-597979107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-f9347cf4-4db6-4342-a923-2d3a5bcd50f6 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:30:19 devstack sudo[101821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-f9347cf4-4db6-4342-a923-2d3a5bcd50f6 Sep 15 16:30:19 devstack sudo[101821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:30:19 devstack sudo[101819]: pam_unix(sudo:session): session closed for user root Sep 15 16:30:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2889f19d-8cbf-49d3-b633-bb2dd7fb0339 tempest-VolumeDependencyTests-1253320995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6e401bc3-66af-469e-ba30-d81829148c76" returned: 0 in 0.382s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:30:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2889f19d-8cbf-49d3-b633-bb2dd7fb0339 tempest-VolumeDependencyTests-1253320995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6e401bc3-66af-469e-ba30-d81829148c76 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:30:19 devstack sudo[101826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6e401bc3-66af-469e-ba30-d81829148c76 Sep 15 16:30:19 devstack sudo[101826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:30:19 devstack sudo[101821]: pam_unix(sudo:session): session closed for user root Sep 15 16:30:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8e7d4481-cb72-4d4a-bcb4-3eb0293b8a76 tempest-VolumesTransfersV355Test-597979107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-f9347cf4-4db6-4342-a923-2d3a5bcd50f6" returned: 0 in 0.366s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:30:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8e7d4481-cb72-4d4a-bcb4-3eb0293b8a76 tempest-VolumesTransfersV355Test-597979107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-f9347cf4-4db6-4342-a923-2d3a5bcd50f6 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:30:19 devstack sudo[101831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-f9347cf4-4db6-4342-a923-2d3a5bcd50f6 Sep 15 16:30:19 devstack sudo[101831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:30:19 devstack sudo[101826]: pam_unix(sudo:session): session closed for user root Sep 15 16:30:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2889f19d-8cbf-49d3-b633-bb2dd7fb0339 tempest-VolumeDependencyTests-1253320995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6e401bc3-66af-469e-ba30-d81829148c76" returned: 0 in 0.246s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:30:19 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-2889f19d-8cbf-49d3-b633-bb2dd7fb0339 tempest-VolumeDependencyTests-1253320995 None] Lock "cinder-quobyte-6e401bc3-66af-469e-ba30-d81829148c76" released by "delete_volume" :: held 0.694s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:30:19 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-2889f19d-8cbf-49d3-b633-bb2dd7fb0339 tempest-VolumeDependencyTests-1253320995 None] Created reservations ['302b2eb7-172e-4614-8737-fb65b45cf530', '294e8e90-6e8c-4887-91df-90bf39faffa1', '9b004e03-7aa9-4f6d-9cca-09bf81a970c9', '7c1864d3-10c6-4f04-8935-6b524b88886e'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:30:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-2889f19d-8cbf-49d3-b633-bb2dd7fb0339 tempest-VolumeDependencyTests-1253320995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:30:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-2889f19d-8cbf-49d3-b633-bb2dd7fb0339 tempest-VolumeDependencyTests-1253320995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:30:19 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-2889f19d-8cbf-49d3-b633-bb2dd7fb0339 tempest-VolumeDependencyTests-1253320995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:30:19 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-2889f19d-8cbf-49d3-b633-bb2dd7fb0339 tempest-VolumeDependencyTests-1253320995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:30:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-2889f19d-8cbf-49d3-b633-bb2dd7fb0339 tempest-VolumeDependencyTests-1253320995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:30:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2889f19d-8cbf-49d3-b633-bb2dd7fb0339 tempest-VolumeDependencyTests-1253320995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:30:19 devstack sudo[101831]: pam_unix(sudo:session): session closed for user root Sep 15 16:30:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8e7d4481-cb72-4d4a-bcb4-3eb0293b8a76 tempest-VolumesTransfersV355Test-597979107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-f9347cf4-4db6-4342-a923-2d3a5bcd50f6" returned: 0 in 0.267s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:30:19 devstack sudo[101835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:30:19 devstack sudo[101835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:30:19 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-8e7d4481-cb72-4d4a-bcb4-3eb0293b8a76 tempest-VolumesTransfersV355Test-597979107 None] Lock "cinder-quobyte-f9347cf4-4db6-4342-a923-2d3a5bcd50f6" released by "delete_volume" :: held 0.679s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:30:19 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-8e7d4481-cb72-4d4a-bcb4-3eb0293b8a76 tempest-VolumesTransfersV355Test-597979107 None] Created reservations ['5ffd7dcc-c246-4caa-b8b2-c6f91f440e79', 'b7e8e278-7f38-44d9-bd1b-a1555f934e14', '07e18c55-bd75-41b1-bce6-df6d9a8a03b1', '7a10a8e5-d23b-4dd9-aa86-ff78d610783f'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:30:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-8e7d4481-cb72-4d4a-bcb4-3eb0293b8a76 tempest-VolumesTransfersV355Test-597979107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:30:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-8e7d4481-cb72-4d4a-bcb4-3eb0293b8a76 tempest-VolumesTransfersV355Test-597979107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:30:20 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-8e7d4481-cb72-4d4a-bcb4-3eb0293b8a76 tempest-VolumesTransfersV355Test-597979107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:30:20 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-8e7d4481-cb72-4d4a-bcb4-3eb0293b8a76 tempest-VolumesTransfersV355Test-597979107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:30:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-8e7d4481-cb72-4d4a-bcb4-3eb0293b8a76 tempest-VolumesTransfersV355Test-597979107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:30:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8e7d4481-cb72-4d4a-bcb4-3eb0293b8a76 tempest-VolumesTransfersV355Test-597979107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:30:20 devstack sudo[101837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:30:20 devstack sudo[101837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:30:20 devstack sudo[101835]: pam_unix(sudo:session): session closed for user root Sep 15 16:30:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2889f19d-8cbf-49d3-b633-bb2dd7fb0339 tempest-VolumeDependencyTests-1253320995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.272s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:30:20 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-2889f19d-8cbf-49d3-b633-bb2dd7fb0339 tempest-VolumeDependencyTests-1253320995 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:30:20 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-2889f19d-8cbf-49d3-b633-bb2dd7fb0339 tempest-VolumeDependencyTests-1253320995 None] Deleted volume successfully. Sep 15 16:30:20 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-332a1234-1109-460b-896c-bb5b72d5febf tempest-VolumeDependencyTests-1253320995 None] Acquiring lock "cinder-55d2d21a-854c-4eb3-a4f1-269f9435d295-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:30:20 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-332a1234-1109-460b-896c-bb5b72d5febf tempest-VolumeDependencyTests-1253320995 None] Lock "cinder-55d2d21a-854c-4eb3-a4f1-269f9435d295-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:30:20 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-2889f19d-8cbf-49d3-b633-bb2dd7fb0339 tempest-VolumeDependencyTests-1253320995 None] Lock "cinder-6e401bc3-66af-469e-ba30-d81829148c76-delete_volume" released by "delete_volume" :: held 1.202s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:30:20 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-332a1234-1109-460b-896c-bb5b72d5febf tempest-VolumeDependencyTests-1253320995 None] Acquiring lock "cinder-quobyte-55d2d21a-854c-4eb3-a4f1-269f9435d295" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:30:20 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-332a1234-1109-460b-896c-bb5b72d5febf tempest-VolumeDependencyTests-1253320995 None] Lock "cinder-quobyte-55d2d21a-854c-4eb3-a4f1-269f9435d295" acquired by "delete_volume" :: waited 0.021s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:30:20 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[19d5d018-3e92-442c-82f1-67f23acf02e5]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:30:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-332a1234-1109-460b-896c-bb5b72d5febf tempest-VolumeDependencyTests-1253320995 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-55d2d21a-854c-4eb3-a4f1-269f9435d295 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:30:20 devstack sudo[101837]: pam_unix(sudo:session): session closed for user root Sep 15 16:30:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8e7d4481-cb72-4d4a-bcb4-3eb0293b8a76 tempest-VolumesTransfersV355Test-597979107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.300s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:30:20 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-8e7d4481-cb72-4d4a-bcb4-3eb0293b8a76 tempest-VolumesTransfersV355Test-597979107 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:30:20 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-8e7d4481-cb72-4d4a-bcb4-3eb0293b8a76 tempest-VolumesTransfersV355Test-597979107 None] Deleted volume successfully. Sep 15 16:30:20 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-8e7d4481-cb72-4d4a-bcb4-3eb0293b8a76 tempest-VolumesTransfersV355Test-597979107 None] Lock "cinder-f9347cf4-4db6-4342-a923-2d3a5bcd50f6-delete_volume" released by "delete_volume" :: held 1.185s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:30:20 devstack sudo[101841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-55d2d21a-854c-4eb3-a4f1-269f9435d295 Sep 15 16:30:20 devstack sudo[101841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:30:20 devstack sudo[101841]: pam_unix(sudo:session): session closed for user root Sep 15 16:30:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-332a1234-1109-460b-896c-bb5b72d5febf tempest-VolumeDependencyTests-1253320995 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-55d2d21a-854c-4eb3-a4f1-269f9435d295" returned: 0 in 0.398s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:30:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-332a1234-1109-460b-896c-bb5b72d5febf tempest-VolumeDependencyTests-1253320995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-55d2d21a-854c-4eb3-a4f1-269f9435d295 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:30:20 devstack sudo[101846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-55d2d21a-854c-4eb3-a4f1-269f9435d295 Sep 15 16:30:20 devstack sudo[101846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:30:20 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-34e62877-0cb5-4c25-853d-0b2cfe370d08 tempest-VolumesTransfersV355Test-1255000157 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:30:20 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-34e62877-0cb5-4c25-853d-0b2cfe370d08 tempest-VolumesTransfersV355Test-1255000157 None] Flow 'volume_create_manager' (babacbad-4a45-4c5e-9169-db9b70437738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:30:20 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-34e62877-0cb5-4c25-853d-0b2cfe370d08 tempest-VolumesTransfersV355Test-1255000157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dad97317-70c4-480f-939a-210db171c385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:30:20 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-34e62877-0cb5-4c25-853d-0b2cfe370d08 tempest-VolumesTransfersV355Test-1255000157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dad97317-70c4-480f-939a-210db171c385) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:30:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-982245243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0e7e1ed-fa49-4a44-aca0-1142c841722a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ddcc8ae2d4641c897f9de45902e889b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:30:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:30:21Z,use_quota=True,user_id='e07ed57d216147a78fe07d3e1486af84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:30:20 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-34e62877-0cb5-4c25-853d-0b2cfe370d08 tempest-VolumesTransfersV355Test-1255000157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a64123b-d45c-4de5-9497-d841cbdf8eb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:30:20 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-34e62877-0cb5-4c25-853d-0b2cfe370d08 tempest-VolumesTransfersV355Test-1255000157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a64123b-d45c-4de5-9497-d841cbdf8eb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:30:20 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-34e62877-0cb5-4c25-853d-0b2cfe370d08 tempest-VolumesTransfersV355Test-1255000157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4f029ce-72b1-46bd-a3c3-2d2bc0925cd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:30:20 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-34e62877-0cb5-4c25-853d-0b2cfe370d08 tempest-VolumesTransfersV355Test-1255000157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4f029ce-72b1-46bd-a3c3-2d2bc0925cd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0e7e1ed-fa49-4a44-aca0-1142c841722a', 'volume_name': 'volume-d0e7e1ed-fa49-4a44-aca0-1142c841722a', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:30:20 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-34e62877-0cb5-4c25-853d-0b2cfe370d08 tempest-VolumesTransfersV355Test-1255000157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b77e6614-6ff4-4761-9cc0-1005ef6b9cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:30:20 devstack sudo[101846]: pam_unix(sudo:session): session closed for user root Sep 15 16:30:20 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-34e62877-0cb5-4c25-853d-0b2cfe370d08 tempest-VolumesTransfersV355Test-1255000157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b77e6614-6ff4-4761-9cc0-1005ef6b9cf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:30:20 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-34e62877-0cb5-4c25-853d-0b2cfe370d08 tempest-VolumesTransfersV355Test-1255000157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d88d1b61-d1d8-461e-af5f-5dbb0cf8208c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:30:20 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-34e62877-0cb5-4c25-853d-0b2cfe370d08 tempest-VolumesTransfersV355Test-1255000157 None] Volume d0e7e1ed-fa49-4a44-aca0-1142c841722a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0e7e1ed-fa49-4a44-aca0-1142c841722a', 'volume_size': 1} Sep 15 16:30:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-34e62877-0cb5-4c25-853d-0b2cfe370d08 tempest-VolumesTransfersV355Test-1255000157 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:30:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-34e62877-0cb5-4c25-853d-0b2cfe370d08 tempest-VolumesTransfersV355Test-1255000157 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:30:20 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-34e62877-0cb5-4c25-853d-0b2cfe370d08 tempest-VolumesTransfersV355Test-1255000157 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:30:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-982245243',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0e7e1ed-fa49-4a44-aca0-1142c841722a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ddcc8ae2d4641c897f9de45902e889b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:30:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:30:21Z,use_quota=True,user_id='e07ed57d216147a78fe07d3e1486af84',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:30:20 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-34e62877-0cb5-4c25-853d-0b2cfe370d08 tempest-VolumesTransfersV355Test-1255000157 None] Creating volume d0e7e1ed-fa49-4a44-aca0-1142c841722a {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:30:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-34e62877-0cb5-4c25-853d-0b2cfe370d08 tempest-VolumesTransfersV355Test-1255000157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:30:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-34e62877-0cb5-4c25-853d-0b2cfe370d08 tempest-VolumesTransfersV355Test-1255000157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:30:20 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-34e62877-0cb5-4c25-853d-0b2cfe370d08 tempest-VolumesTransfersV355Test-1255000157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:30:20 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-34e62877-0cb5-4c25-853d-0b2cfe370d08 tempest-VolumesTransfersV355Test-1255000157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:30:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-34e62877-0cb5-4c25-853d-0b2cfe370d08 tempest-VolumesTransfersV355Test-1255000157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:30:20 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-34e62877-0cb5-4c25-853d-0b2cfe370d08 tempest-VolumesTransfersV355Test-1255000157 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:30:20 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-34e62877-0cb5-4c25-853d-0b2cfe370d08 tempest-VolumesTransfersV355Test-1255000157 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:30:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-34e62877-0cb5-4c25-853d-0b2cfe370d08 tempest-VolumesTransfersV355Test-1255000157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-d0e7e1ed-fa49-4a44-aca0-1142c841722a 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:30:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-332a1234-1109-460b-896c-bb5b72d5febf tempest-VolumeDependencyTests-1253320995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-55d2d21a-854c-4eb3-a4f1-269f9435d295" returned: 0 in 0.280s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:30:20 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-332a1234-1109-460b-896c-bb5b72d5febf tempest-VolumeDependencyTests-1253320995 None] Lock "cinder-quobyte-55d2d21a-854c-4eb3-a4f1-269f9435d295" released by "delete_volume" :: held 0.734s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:30:20 devstack sudo[101849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-d0e7e1ed-fa49-4a44-aca0-1142c841722a 1073741824 Sep 15 16:30:20 devstack sudo[101849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:30:21 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-332a1234-1109-460b-896c-bb5b72d5febf tempest-VolumeDependencyTests-1253320995 None] Created reservations ['28562a12-4ddc-4d98-a859-735b491887c7', '2bcc7dd3-a80a-4cd7-bb17-20464627321a', '63506ce1-4c79-401f-8ffd-6ceac6869ae5', '25effb4e-4bfe-4527-ba1c-73999a559339'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:30:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-332a1234-1109-460b-896c-bb5b72d5febf tempest-VolumeDependencyTests-1253320995 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:30:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-332a1234-1109-460b-896c-bb5b72d5febf tempest-VolumeDependencyTests-1253320995 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:30:21 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-332a1234-1109-460b-896c-bb5b72d5febf tempest-VolumeDependencyTests-1253320995 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:30:21 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-332a1234-1109-460b-896c-bb5b72d5febf tempest-VolumeDependencyTests-1253320995 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:30:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-332a1234-1109-460b-896c-bb5b72d5febf tempest-VolumeDependencyTests-1253320995 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:30:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-332a1234-1109-460b-896c-bb5b72d5febf tempest-VolumeDependencyTests-1253320995 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:30:21 devstack sudo[101851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:30:21 devstack sudo[101851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:30:21 devstack sudo[101851]: pam_unix(sudo:session): session closed for user root Sep 15 16:30:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-332a1234-1109-460b-896c-bb5b72d5febf tempest-VolumeDependencyTests-1253320995 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.266s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:30:21 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-332a1234-1109-460b-896c-bb5b72d5febf tempest-VolumeDependencyTests-1253320995 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:30:21 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-332a1234-1109-460b-896c-bb5b72d5febf tempest-VolumeDependencyTests-1253320995 None] Deleted volume successfully. Sep 15 16:30:21 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-332a1234-1109-460b-896c-bb5b72d5febf tempest-VolumeDependencyTests-1253320995 None] Lock "cinder-55d2d21a-854c-4eb3-a4f1-269f9435d295-delete_volume" released by "delete_volume" :: held 1.207s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:30:21 devstack sudo[101849]: pam_unix(sudo:session): session closed for user root Sep 15 16:30:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-34e62877-0cb5-4c25-853d-0b2cfe370d08 tempest-VolumesTransfersV355Test-1255000157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-d0e7e1ed-fa49-4a44-aca0-1142c841722a 1073741824" returned: 0 in 0.487s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:30:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-34e62877-0cb5-4c25-853d-0b2cfe370d08 tempest-VolumesTransfersV355Test-1255000157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-d0e7e1ed-fa49-4a44-aca0-1142c841722a {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:30:21 devstack sudo[101858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-d0e7e1ed-fa49-4a44-aca0-1142c841722a Sep 15 16:30:21 devstack sudo[101858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:30:21 devstack sudo[101858]: pam_unix(sudo:session): session closed for user root Sep 15 16:30:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-34e62877-0cb5-4c25-853d-0b2cfe370d08 tempest-VolumesTransfersV355Test-1255000157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-d0e7e1ed-fa49-4a44-aca0-1142c841722a" returned: 0 in 0.268s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:30:21 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-34e62877-0cb5-4c25-853d-0b2cfe370d08 tempest-VolumesTransfersV355Test-1255000157 None] <== create_volume: return (798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:30:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-34e62877-0cb5-4c25-853d-0b2cfe370d08 tempest-VolumesTransfersV355Test-1255000157 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.800s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:30:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-34e62877-0cb5-4c25-853d-0b2cfe370d08 tempest-VolumesTransfersV355Test-1255000157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d88d1b61-d1d8-461e-af5f-5dbb0cf8208c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0e7e1ed-fa49-4a44-aca0-1142c841722a', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:30:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-34e62877-0cb5-4c25-853d-0b2cfe370d08 tempest-VolumesTransfersV355Test-1255000157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8d61b94-abf5-4ba2-b39a-c5c69f47f57d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:30:21 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-34e62877-0cb5-4c25-853d-0b2cfe370d08 tempest-VolumesTransfersV355Test-1255000157 None] Volume volume-d0e7e1ed-fa49-4a44-aca0-1142c841722a (d0e7e1ed-fa49-4a44-aca0-1142c841722a): created successfully Sep 15 16:30:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-34e62877-0cb5-4c25-853d-0b2cfe370d08 tempest-VolumesTransfersV355Test-1255000157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8d61b94-abf5-4ba2-b39a-c5c69f47f57d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:30:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-34e62877-0cb5-4c25-853d-0b2cfe370d08 tempest-VolumesTransfersV355Test-1255000157 None] Flow 'volume_create_manager' (babacbad-4a45-4c5e-9169-db9b70437738) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:30:21 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-34e62877-0cb5-4c25-853d-0b2cfe370d08 tempest-VolumesTransfersV355Test-1255000157 None] Created volume successfully. Sep 15 16:30:23 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c2b5279e-db39-4d6e-a6fe-e963e4fbb1de tempest-VolumesTransfersV355Test-597979107 None] Acquiring lock "cinder-d0e7e1ed-fa49-4a44-aca0-1142c841722a-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:30:23 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c2b5279e-db39-4d6e-a6fe-e963e4fbb1de tempest-VolumesTransfersV355Test-597979107 None] Lock "cinder-d0e7e1ed-fa49-4a44-aca0-1142c841722a-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:30:23 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c2b5279e-db39-4d6e-a6fe-e963e4fbb1de tempest-VolumesTransfersV355Test-597979107 None] Acquiring lock "cinder-quobyte-d0e7e1ed-fa49-4a44-aca0-1142c841722a" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:30:23 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c2b5279e-db39-4d6e-a6fe-e963e4fbb1de tempest-VolumesTransfersV355Test-597979107 None] Lock "cinder-quobyte-d0e7e1ed-fa49-4a44-aca0-1142c841722a" acquired by "delete_volume" :: waited 0.018s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:30:23 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce5bb95a-3865-4ce0-8012-2c0f053f7224]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:30:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c2b5279e-db39-4d6e-a6fe-e963e4fbb1de tempest-VolumesTransfersV355Test-597979107 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-d0e7e1ed-fa49-4a44-aca0-1142c841722a {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:30:23 devstack sudo[101862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-d0e7e1ed-fa49-4a44-aca0-1142c841722a Sep 15 16:30:23 devstack sudo[101862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:30:23 devstack sudo[101862]: pam_unix(sudo:session): session closed for user root Sep 15 16:30:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c2b5279e-db39-4d6e-a6fe-e963e4fbb1de tempest-VolumesTransfersV355Test-597979107 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-d0e7e1ed-fa49-4a44-aca0-1142c841722a" returned: 0 in 0.369s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:30:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c2b5279e-db39-4d6e-a6fe-e963e4fbb1de tempest-VolumesTransfersV355Test-597979107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-d0e7e1ed-fa49-4a44-aca0-1142c841722a {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:30:23 devstack sudo[101867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-d0e7e1ed-fa49-4a44-aca0-1142c841722a Sep 15 16:30:23 devstack sudo[101867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:30:23 devstack sudo[101867]: pam_unix(sudo:session): session closed for user root Sep 15 16:30:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c2b5279e-db39-4d6e-a6fe-e963e4fbb1de tempest-VolumesTransfersV355Test-597979107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-d0e7e1ed-fa49-4a44-aca0-1142c841722a" returned: 0 in 0.244s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:30:23 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c2b5279e-db39-4d6e-a6fe-e963e4fbb1de tempest-VolumesTransfersV355Test-597979107 None] Lock "cinder-quobyte-d0e7e1ed-fa49-4a44-aca0-1142c841722a" released by "delete_volume" :: held 0.658s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:30:24 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-c2b5279e-db39-4d6e-a6fe-e963e4fbb1de tempest-VolumesTransfersV355Test-597979107 None] Created reservations ['09cfed88-8129-4e3a-ab51-0d303f58905b', '9247e694-0a38-4e96-87ad-c849b4ff89b5', 'ad8331b5-5657-4f85-9504-d66a9ca4b4eb', '31ceed2a-fab9-411c-b98b-2d4e43b65527'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:30:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c2b5279e-db39-4d6e-a6fe-e963e4fbb1de tempest-VolumesTransfersV355Test-597979107 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:30:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c2b5279e-db39-4d6e-a6fe-e963e4fbb1de tempest-VolumesTransfersV355Test-597979107 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:30:24 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c2b5279e-db39-4d6e-a6fe-e963e4fbb1de tempest-VolumesTransfersV355Test-597979107 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:30:24 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c2b5279e-db39-4d6e-a6fe-e963e4fbb1de tempest-VolumesTransfersV355Test-597979107 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:30:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c2b5279e-db39-4d6e-a6fe-e963e4fbb1de tempest-VolumesTransfersV355Test-597979107 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:30:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c2b5279e-db39-4d6e-a6fe-e963e4fbb1de tempest-VolumesTransfersV355Test-597979107 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:30:24 devstack sudo[101870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:30:24 devstack sudo[101870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:30:24 devstack sudo[101870]: pam_unix(sudo:session): session closed for user root Sep 15 16:30:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c2b5279e-db39-4d6e-a6fe-e963e4fbb1de tempest-VolumesTransfersV355Test-597979107 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.253s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:30:24 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-c2b5279e-db39-4d6e-a6fe-e963e4fbb1de tempest-VolumesTransfersV355Test-597979107 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:30:24 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-c2b5279e-db39-4d6e-a6fe-e963e4fbb1de tempest-VolumesTransfersV355Test-597979107 None] Deleted volume successfully. Sep 15 16:30:24 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c2b5279e-db39-4d6e-a6fe-e963e4fbb1de tempest-VolumesTransfersV355Test-597979107 None] Lock "cinder-d0e7e1ed-fa49-4a44-aca0-1142c841722a-delete_volume" released by "delete_volume" :: held 1.114s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:30:24 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c659103-ba32-40b8-a086-f03f9e389e70 tempest-CinderUnicodeTest-1220130840 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:30:24 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-6c659103-ba32-40b8-a086-f03f9e389e70 tempest-CinderUnicodeTest-1220130840 None] Flow 'volume_create_manager' (31eac91c-39cb-4972-9227-dbb02daadc58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:30:24 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-6c659103-ba32-40b8-a086-f03f9e389e70 tempest-CinderUnicodeTest-1220130840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e158fec7-eff7-461e-bb72-f61b86e07519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:30:24 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-6c659103-ba32-40b8-a086-f03f9e389e70 tempest-CinderUnicodeTest-1220130840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e158fec7-eff7-461e-bb72-f61b86e07519) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:30:24Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bb19ecd-53ca-447f-a936-c47fa60a9aaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e865b66fd9043b39e087740b2b65325',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:30:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:30:24Z,use_quota=True,user_id='896494fcc2bd46aaba6b9ef0375ce2a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:30:24 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-6c659103-ba32-40b8-a086-f03f9e389e70 tempest-CinderUnicodeTest-1220130840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c144d59-abad-4146-92a1-40fcdcdd36ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:30:24 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-6c659103-ba32-40b8-a086-f03f9e389e70 tempest-CinderUnicodeTest-1220130840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c144d59-abad-4146-92a1-40fcdcdd36ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:30:24 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-6c659103-ba32-40b8-a086-f03f9e389e70 tempest-CinderUnicodeTest-1220130840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (799bbdb0-7119-4bd9-8a26-1b320d8961f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:30:24 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-6c659103-ba32-40b8-a086-f03f9e389e70 tempest-CinderUnicodeTest-1220130840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (799bbdb0-7119-4bd9-8a26-1b320d8961f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1bb19ecd-53ca-447f-a936-c47fa60a9aaf', 'volume_name': 'volume-1bb19ecd-53ca-447f-a936-c47fa60a9aaf', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:30:24 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-6c659103-ba32-40b8-a086-f03f9e389e70 tempest-CinderUnicodeTest-1220130840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ffd630e-45f1-4631-b7cf-8ddc95c1018b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:30:24 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-6c659103-ba32-40b8-a086-f03f9e389e70 tempest-CinderUnicodeTest-1220130840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ffd630e-45f1-4631-b7cf-8ddc95c1018b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:30:24 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-6c659103-ba32-40b8-a086-f03f9e389e70 tempest-CinderUnicodeTest-1220130840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dcabbec-9959-47c8-a7a0-0e248707cc7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:30:24 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-6c659103-ba32-40b8-a086-f03f9e389e70 tempest-CinderUnicodeTest-1220130840 None] Volume 1bb19ecd-53ca-447f-a936-c47fa60a9aaf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1bb19ecd-53ca-447f-a936-c47fa60a9aaf', 'volume_size': 1} Sep 15 16:30:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-6c659103-ba32-40b8-a086-f03f9e389e70 tempest-CinderUnicodeTest-1220130840 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:30:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-6c659103-ba32-40b8-a086-f03f9e389e70 tempest-CinderUnicodeTest-1220130840 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:30:24 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-6c659103-ba32-40b8-a086-f03f9e389e70 tempest-CinderUnicodeTest-1220130840 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:30:24Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1bb19ecd-53ca-447f-a936-c47fa60a9aaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e865b66fd9043b39e087740b2b65325',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:30:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:30:24Z,use_quota=True,user_id='896494fcc2bd46aaba6b9ef0375ce2a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:30:24 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-6c659103-ba32-40b8-a086-f03f9e389e70 tempest-CinderUnicodeTest-1220130840 None] Creating volume 1bb19ecd-53ca-447f-a936-c47fa60a9aaf {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:30:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-6c659103-ba32-40b8-a086-f03f9e389e70 tempest-CinderUnicodeTest-1220130840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:30:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-6c659103-ba32-40b8-a086-f03f9e389e70 tempest-CinderUnicodeTest-1220130840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:30:24 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-6c659103-ba32-40b8-a086-f03f9e389e70 tempest-CinderUnicodeTest-1220130840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:30:24 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-6c659103-ba32-40b8-a086-f03f9e389e70 tempest-CinderUnicodeTest-1220130840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:30:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-6c659103-ba32-40b8-a086-f03f9e389e70 tempest-CinderUnicodeTest-1220130840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:30:24 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-6c659103-ba32-40b8-a086-f03f9e389e70 tempest-CinderUnicodeTest-1220130840 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:30:24 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-6c659103-ba32-40b8-a086-f03f9e389e70 tempest-CinderUnicodeTest-1220130840 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:30:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-6c659103-ba32-40b8-a086-f03f9e389e70 tempest-CinderUnicodeTest-1220130840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1bb19ecd-53ca-447f-a936-c47fa60a9aaf 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:30:24 devstack sudo[101873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1bb19ecd-53ca-447f-a936-c47fa60a9aaf 1073741824 Sep 15 16:30:24 devstack sudo[101873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:30:25 devstack sudo[101873]: pam_unix(sudo:session): session closed for user root Sep 15 16:30:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-6c659103-ba32-40b8-a086-f03f9e389e70 tempest-CinderUnicodeTest-1220130840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1bb19ecd-53ca-447f-a936-c47fa60a9aaf 1073741824" returned: 0 in 0.480s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:30:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-6c659103-ba32-40b8-a086-f03f9e389e70 tempest-CinderUnicodeTest-1220130840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1bb19ecd-53ca-447f-a936-c47fa60a9aaf {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:30:25 devstack sudo[101879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1bb19ecd-53ca-447f-a936-c47fa60a9aaf Sep 15 16:30:25 devstack sudo[101879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:30:25 devstack sudo[101879]: pam_unix(sudo:session): session closed for user root Sep 15 16:30:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-6c659103-ba32-40b8-a086-f03f9e389e70 tempest-CinderUnicodeTest-1220130840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1bb19ecd-53ca-447f-a936-c47fa60a9aaf" returned: 0 in 0.244s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:30:25 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-6c659103-ba32-40b8-a086-f03f9e389e70 tempest-CinderUnicodeTest-1220130840 None] <== create_volume: return (776ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:30:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-6c659103-ba32-40b8-a086-f03f9e389e70 tempest-CinderUnicodeTest-1220130840 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.779s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:30:25 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-6c659103-ba32-40b8-a086-f03f9e389e70 tempest-CinderUnicodeTest-1220130840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8dcabbec-9959-47c8-a7a0-0e248707cc7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1bb19ecd-53ca-447f-a936-c47fa60a9aaf', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:30:25 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-6c659103-ba32-40b8-a086-f03f9e389e70 tempest-CinderUnicodeTest-1220130840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e8ed1f3-a0cb-4ed7-bb25-121e1b750eb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:30:25 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-6c659103-ba32-40b8-a086-f03f9e389e70 tempest-CinderUnicodeTest-1220130840 None] Volume volume-1bb19ecd-53ca-447f-a936-c47fa60a9aaf (1bb19ecd-53ca-447f-a936-c47fa60a9aaf): created successfully Sep 15 16:30:25 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-6c659103-ba32-40b8-a086-f03f9e389e70 tempest-CinderUnicodeTest-1220130840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e8ed1f3-a0cb-4ed7-bb25-121e1b750eb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:30:25 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-6c659103-ba32-40b8-a086-f03f9e389e70 tempest-CinderUnicodeTest-1220130840 None] Flow 'volume_create_manager' (31eac91c-39cb-4972-9227-dbb02daadc58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:30:25 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-6c659103-ba32-40b8-a086-f03f9e389e70 tempest-CinderUnicodeTest-1220130840 None] Created volume successfully. Sep 15 16:30:27 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce386850-1f5d-4cc4-9734-f5639bd801ee tempest-CinderUnicodeTest-1220130840 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:30:27 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ce386850-1f5d-4cc4-9734-f5639bd801ee tempest-CinderUnicodeTest-1220130840 None] Flow 'volume_create_manager' (03c61b68-01ef-4938-a388-72b03c782ee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:30:27 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ce386850-1f5d-4cc4-9734-f5639bd801ee tempest-CinderUnicodeTest-1220130840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d2b7f98-fcef-44ba-96b6-85d6cb009b1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:30:27 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ce386850-1f5d-4cc4-9734-f5639bd801ee tempest-CinderUnicodeTest-1220130840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d2b7f98-fcef-44ba-96b6-85d6cb009b1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:30:27Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1717545055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3b28ca3-74d6-4d2f-8744-de116341de37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e865b66fd9043b39e087740b2b65325',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:30:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:30:27Z,use_quota=True,user_id='896494fcc2bd46aaba6b9ef0375ce2a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:30:27 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ce386850-1f5d-4cc4-9734-f5639bd801ee tempest-CinderUnicodeTest-1220130840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22f0decd-bd63-4703-8c0f-0fc3fd1f8ef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:30:27 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ce386850-1f5d-4cc4-9734-f5639bd801ee tempest-CinderUnicodeTest-1220130840 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22f0decd-bd63-4703-8c0f-0fc3fd1f8ef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:30:27 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ce386850-1f5d-4cc4-9734-f5639bd801ee tempest-CinderUnicodeTest-1220130840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3f7e6fd-cb0f-4b62-b81d-0e64fcf4bba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:30:27 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ce386850-1f5d-4cc4-9734-f5639bd801ee tempest-CinderUnicodeTest-1220130840 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3f7e6fd-cb0f-4b62-b81d-0e64fcf4bba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3b28ca3-74d6-4d2f-8744-de116341de37', 'volume_name': 'volume-d3b28ca3-74d6-4d2f-8744-de116341de37', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:30:27 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ce386850-1f5d-4cc4-9734-f5639bd801ee tempest-CinderUnicodeTest-1220130840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9c0ec83-79f5-4e19-a1b0-8612829663ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:30:27 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ce386850-1f5d-4cc4-9734-f5639bd801ee tempest-CinderUnicodeTest-1220130840 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9c0ec83-79f5-4e19-a1b0-8612829663ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:30:27 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ce386850-1f5d-4cc4-9734-f5639bd801ee tempest-CinderUnicodeTest-1220130840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0205c209-b401-4321-8234-f4de283cb594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:30:27 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-ce386850-1f5d-4cc4-9734-f5639bd801ee tempest-CinderUnicodeTest-1220130840 None] Volume d3b28ca3-74d6-4d2f-8744-de116341de37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3b28ca3-74d6-4d2f-8744-de116341de37', 'volume_size': 1} Sep 15 16:30:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-ce386850-1f5d-4cc4-9734-f5639bd801ee tempest-CinderUnicodeTest-1220130840 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:30:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-ce386850-1f5d-4cc4-9734-f5639bd801ee tempest-CinderUnicodeTest-1220130840 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:30:27 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-ce386850-1f5d-4cc4-9734-f5639bd801ee tempest-CinderUnicodeTest-1220130840 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:30:27Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1717545055',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3b28ca3-74d6-4d2f-8744-de116341de37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0e865b66fd9043b39e087740b2b65325',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:30:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:30:27Z,use_quota=True,user_id='896494fcc2bd46aaba6b9ef0375ce2a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:30:27 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-ce386850-1f5d-4cc4-9734-f5639bd801ee tempest-CinderUnicodeTest-1220130840 None] Creating volume d3b28ca3-74d6-4d2f-8744-de116341de37 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:30:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-ce386850-1f5d-4cc4-9734-f5639bd801ee tempest-CinderUnicodeTest-1220130840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:30:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-ce386850-1f5d-4cc4-9734-f5639bd801ee tempest-CinderUnicodeTest-1220130840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:30:27 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-ce386850-1f5d-4cc4-9734-f5639bd801ee tempest-CinderUnicodeTest-1220130840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:30:27 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-ce386850-1f5d-4cc4-9734-f5639bd801ee tempest-CinderUnicodeTest-1220130840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:30:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-ce386850-1f5d-4cc4-9734-f5639bd801ee tempest-CinderUnicodeTest-1220130840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:30:27 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-ce386850-1f5d-4cc4-9734-f5639bd801ee tempest-CinderUnicodeTest-1220130840 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:30:27 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-ce386850-1f5d-4cc4-9734-f5639bd801ee tempest-CinderUnicodeTest-1220130840 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:30:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ce386850-1f5d-4cc4-9734-f5639bd801ee tempest-CinderUnicodeTest-1220130840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-d3b28ca3-74d6-4d2f-8744-de116341de37 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:30:27 devstack sudo[101883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-d3b28ca3-74d6-4d2f-8744-de116341de37 1073741824 Sep 15 16:30:27 devstack sudo[101883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:30:27 devstack sudo[101883]: pam_unix(sudo:session): session closed for user root Sep 15 16:30:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ce386850-1f5d-4cc4-9734-f5639bd801ee tempest-CinderUnicodeTest-1220130840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-d3b28ca3-74d6-4d2f-8744-de116341de37 1073741824" returned: 0 in 0.492s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:30:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ce386850-1f5d-4cc4-9734-f5639bd801ee tempest-CinderUnicodeTest-1220130840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-d3b28ca3-74d6-4d2f-8744-de116341de37 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:30:27 devstack sudo[101889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-d3b28ca3-74d6-4d2f-8744-de116341de37 Sep 15 16:30:27 devstack sudo[101889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:30:28 devstack sudo[101889]: pam_unix(sudo:session): session closed for user root Sep 15 16:30:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ce386850-1f5d-4cc4-9734-f5639bd801ee tempest-CinderUnicodeTest-1220130840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-d3b28ca3-74d6-4d2f-8744-de116341de37" returned: 0 in 0.279s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:30:28 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-ce386850-1f5d-4cc4-9734-f5639bd801ee tempest-CinderUnicodeTest-1220130840 None] <== create_volume: return (845ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:30:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-ce386850-1f5d-4cc4-9734-f5639bd801ee tempest-CinderUnicodeTest-1220130840 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.849s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:30:28 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ce386850-1f5d-4cc4-9734-f5639bd801ee tempest-CinderUnicodeTest-1220130840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0205c209-b401-4321-8234-f4de283cb594) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3b28ca3-74d6-4d2f-8744-de116341de37', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:30:28 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ce386850-1f5d-4cc4-9734-f5639bd801ee tempest-CinderUnicodeTest-1220130840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63e5cdb0-8c13-44a4-8518-4a407a864cf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:30:28 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-ce386850-1f5d-4cc4-9734-f5639bd801ee tempest-CinderUnicodeTest-1220130840 None] Volume volume-d3b28ca3-74d6-4d2f-8744-de116341de37 (d3b28ca3-74d6-4d2f-8744-de116341de37): created successfully Sep 15 16:30:28 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ce386850-1f5d-4cc4-9734-f5639bd801ee tempest-CinderUnicodeTest-1220130840 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63e5cdb0-8c13-44a4-8518-4a407a864cf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:30:28 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ce386850-1f5d-4cc4-9734-f5639bd801ee tempest-CinderUnicodeTest-1220130840 None] Flow 'volume_create_manager' (03c61b68-01ef-4938-a388-72b03c782ee5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:30:28 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-ce386850-1f5d-4cc4-9734-f5639bd801ee tempest-CinderUnicodeTest-1220130840 None] Created volume successfully. Sep 15 16:30:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-12d9537f-094d-4a86-888a-49eed9190b58 tempest-CinderUnicodeTest-1220130840 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:30:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-12d9537f-094d-4a86-888a-49eed9190b58 tempest-CinderUnicodeTest-1220130840 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:30:29 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-12d9537f-094d-4a86-888a-49eed9190b58 tempest-CinderUnicodeTest-1220130840 None] Creating offline snapshot a910a41e-3e09-481b-9400-2275b1e688c0 of volume d3b28ca3-74d6-4d2f-8744-de116341de37 {{(pid=86082) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 15 16:30:29 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dd81764-6c14-433e-a1fc-743d8a3b1702]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:30:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-12d9537f-094d-4a86-888a-49eed9190b58 tempest-CinderUnicodeTest-1220130840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-d3b28ca3-74d6-4d2f-8744-de116341de37 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:30:29 devstack sudo[101892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-d3b28ca3-74d6-4d2f-8744-de116341de37 Sep 15 16:30:29 devstack sudo[101892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:30:29 devstack sudo[101892]: pam_unix(sudo:session): session closed for user root Sep 15 16:30:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-12d9537f-094d-4a86-888a-49eed9190b58 tempest-CinderUnicodeTest-1220130840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-d3b28ca3-74d6-4d2f-8744-de116341de37" returned: 0 in 0.401s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:30:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-12d9537f-094d-4a86-888a-49eed9190b58 tempest-CinderUnicodeTest-1220130840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-d3b28ca3-74d6-4d2f-8744-de116341de37,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-d3b28ca3-74d6-4d2f-8744-de116341de37.a910a41e-3e09-481b-9400-2275b1e688c0 1G {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:30:29 devstack sudo[101897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-d3b28ca3-74d6-4d2f-8744-de116341de37,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-d3b28ca3-74d6-4d2f-8744-de116341de37.a910a41e-3e09-481b-9400-2275b1e688c0 1G Sep 15 16:30:29 devstack sudo[101897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:30:30 devstack sudo[101897]: pam_unix(sudo:session): session closed for user root Sep 15 16:30:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-12d9537f-094d-4a86-888a-49eed9190b58 tempest-CinderUnicodeTest-1220130840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-d3b28ca3-74d6-4d2f-8744-de116341de37,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-d3b28ca3-74d6-4d2f-8744-de116341de37.a910a41e-3e09-481b-9400-2275b1e688c0 1G" returned: 0 in 0.439s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:30:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-12d9537f-094d-4a86-888a-49eed9190b58 tempest-CinderUnicodeTest-1220130840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3b28ca3-74d6-4d2f-8744-de116341de37 -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-d3b28ca3-74d6-4d2f-8744-de116341de37.a910a41e-3e09-481b-9400-2275b1e688c0 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:30:30 devstack sudo[101902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3b28ca3-74d6-4d2f-8744-de116341de37 -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-d3b28ca3-74d6-4d2f-8744-de116341de37.a910a41e-3e09-481b-9400-2275b1e688c0 Sep 15 16:30:30 devstack sudo[101902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:30:30 devstack sudo[101902]: pam_unix(sudo:session): session closed for user root Sep 15 16:30:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-12d9537f-094d-4a86-888a-49eed9190b58 tempest-CinderUnicodeTest-1220130840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3b28ca3-74d6-4d2f-8744-de116341de37 -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-d3b28ca3-74d6-4d2f-8744-de116341de37.a910a41e-3e09-481b-9400-2275b1e688c0" returned: 0 in 0.342s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:30:30 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-12d9537f-094d-4a86-888a-49eed9190b58 tempest-CinderUnicodeTest-1220130840 None] /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-d3b28ca3-74d6-4d2f-8744-de116341de37.a910a41e-3e09-481b-9400-2275b1e688c0 is being set with open permissions: ugo+rw Sep 15 16:30:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-12d9537f-094d-4a86-888a-49eed9190b58 tempest-CinderUnicodeTest-1220130840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-d3b28ca3-74d6-4d2f-8744-de116341de37.a910a41e-3e09-481b-9400-2275b1e688c0 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:30:30 devstack sudo[101907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-d3b28ca3-74d6-4d2f-8744-de116341de37.a910a41e-3e09-481b-9400-2275b1e688c0 Sep 15 16:30:30 devstack sudo[101907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:30:30 devstack sudo[101907]: pam_unix(sudo:session): session closed for user root Sep 15 16:30:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-12d9537f-094d-4a86-888a-49eed9190b58 tempest-CinderUnicodeTest-1220130840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-d3b28ca3-74d6-4d2f-8744-de116341de37.a910a41e-3e09-481b-9400-2275b1e688c0" returned: 0 in 0.275s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:30:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-12d9537f-094d-4a86-888a-49eed9190b58 tempest-CinderUnicodeTest-1220130840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-d3b28ca3-74d6-4d2f-8744-de116341de37.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:30:30 devstack sudo[101910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-d3b28ca3-74d6-4d2f-8744-de116341de37.info Sep 15 16:30:30 devstack sudo[101910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:30:31 devstack sudo[101910]: pam_unix(sudo:session): session closed for user root Sep 15 16:30:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-12d9537f-094d-4a86-888a-49eed9190b58 tempest-CinderUnicodeTest-1220130840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-d3b28ca3-74d6-4d2f-8744-de116341de37.info" returned: 0 in 0.266s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:30:31 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-12d9537f-094d-4a86-888a-49eed9190b58 tempest-CinderUnicodeTest-1220130840 None] /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-d3b28ca3-74d6-4d2f-8744-de116341de37.info is being set with open permissions: ugo+rw Sep 15 16:30:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-12d9537f-094d-4a86-888a-49eed9190b58 tempest-CinderUnicodeTest-1220130840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-d3b28ca3-74d6-4d2f-8744-de116341de37.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:30:31 devstack sudo[101913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-d3b28ca3-74d6-4d2f-8744-de116341de37.info Sep 15 16:30:31 devstack sudo[101913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:30:31 devstack sudo[101913]: pam_unix(sudo:session): session closed for user root Sep 15 16:30:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-12d9537f-094d-4a86-888a-49eed9190b58 tempest-CinderUnicodeTest-1220130840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-d3b28ca3-74d6-4d2f-8744-de116341de37.info" returned: 0 in 0.265s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:30:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-12d9537f-094d-4a86-888a-49eed9190b58 tempest-CinderUnicodeTest-1220130840 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.095s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:30:31 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-12d9537f-094d-4a86-888a-49eed9190b58 tempest-CinderUnicodeTest-1220130840 None] Create snapshot completed successfully Sep 15 16:30:32 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-bbf53cc6-a88e-4c18-81bf-73283a0c691f tempest-CinderUnicodeTest-1220130840 None] Acquiring lock "cinder-a910a41e-3e09-481b-9400-2275b1e688c0-delete_snapshot" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:30:32 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-bbf53cc6-a88e-4c18-81bf-73283a0c691f tempest-CinderUnicodeTest-1220130840 None] Lock "cinder-a910a41e-3e09-481b-9400-2275b1e688c0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:30:32 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-bbf53cc6-a88e-4c18-81bf-73283a0c691f tempest-CinderUnicodeTest-1220130840 None] Acquiring lock "cinder-quobyte-d3b28ca3-74d6-4d2f-8744-de116341de37" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:30:32 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-bbf53cc6-a88e-4c18-81bf-73283a0c691f tempest-CinderUnicodeTest-1220130840 None] Lock "cinder-quobyte-d3b28ca3-74d6-4d2f-8744-de116341de37" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:30:32 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-bbf53cc6-a88e-4c18-81bf-73283a0c691f tempest-CinderUnicodeTest-1220130840 None] Acquiring lock "cinder-quobyte-a910a41e-3e09-481b-9400-2275b1e688c0" by "_delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:30:32 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-bbf53cc6-a88e-4c18-81bf-73283a0c691f tempest-CinderUnicodeTest-1220130840 None] Lock "cinder-quobyte-a910a41e-3e09-481b-9400-2275b1e688c0" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:30:32 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-bbf53cc6-a88e-4c18-81bf-73283a0c691f tempest-CinderUnicodeTest-1220130840 None] Deleting offline snapshot a910a41e-3e09-481b-9400-2275b1e688c0 of volume d3b28ca3-74d6-4d2f-8744-de116341de37 {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 15 16:30:32 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-bbf53cc6-a88e-4c18-81bf-73283a0c691f tempest-CinderUnicodeTest-1220130840 None] snapshot_file for this snap is: volume-d3b28ca3-74d6-4d2f-8744-de116341de37.a910a41e-3e09-481b-9400-2275b1e688c0 {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 15 16:30:32 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d516e48-0b78-4e8d-b8eb-98a232461e8d]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:30:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-bbf53cc6-a88e-4c18-81bf-73283a0c691f tempest-CinderUnicodeTest-1220130840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-d3b28ca3-74d6-4d2f-8744-de116341de37.a910a41e-3e09-481b-9400-2275b1e688c0 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:30:32 devstack sudo[101922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-d3b28ca3-74d6-4d2f-8744-de116341de37.a910a41e-3e09-481b-9400-2275b1e688c0 Sep 15 16:30:32 devstack sudo[101922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:30:33 devstack sudo[101922]: pam_unix(sudo:session): session closed for user root Sep 15 16:30:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-bbf53cc6-a88e-4c18-81bf-73283a0c691f tempest-CinderUnicodeTest-1220130840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-d3b28ca3-74d6-4d2f-8744-de116341de37.a910a41e-3e09-481b-9400-2275b1e688c0" returned: 0 in 0.379s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:30:33 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-bbf53cc6-a88e-4c18-81bf-73283a0c691f tempest-CinderUnicodeTest-1220130840 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d3b28ca3-74d6-4d2f-8744-de116341de37(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 16:30:33 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[118000c5-8c22-4a32-ba08-60efe58252a7]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:30:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-bbf53cc6-a88e-4c18-81bf-73283a0c691f tempest-CinderUnicodeTest-1220130840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-d3b28ca3-74d6-4d2f-8744-de116341de37 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:30:33 devstack sudo[101927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-d3b28ca3-74d6-4d2f-8744-de116341de37 Sep 15 16:30:33 devstack sudo[101927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:30:33 devstack sudo[101927]: pam_unix(sudo:session): session closed for user root Sep 15 16:30:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-bbf53cc6-a88e-4c18-81bf-73283a0c691f tempest-CinderUnicodeTest-1220130840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-d3b28ca3-74d6-4d2f-8744-de116341de37" returned: 0 in 0.395s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:30:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-bbf53cc6-a88e-4c18-81bf-73283a0c691f tempest-CinderUnicodeTest-1220130840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-d3b28ca3-74d6-4d2f-8744-de116341de37.a910a41e-3e09-481b-9400-2275b1e688c0 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:30:33 devstack sudo[101932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-d3b28ca3-74d6-4d2f-8744-de116341de37.a910a41e-3e09-481b-9400-2275b1e688c0 Sep 15 16:30:33 devstack sudo[101932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:30:33 devstack sudo[101932]: pam_unix(sudo:session): session closed for user root Sep 15 16:30:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-bbf53cc6-a88e-4c18-81bf-73283a0c691f tempest-CinderUnicodeTest-1220130840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-d3b28ca3-74d6-4d2f-8744-de116341de37.a910a41e-3e09-481b-9400-2275b1e688c0" returned: 0 in 0.482s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:30:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-bbf53cc6-a88e-4c18-81bf-73283a0c691f tempest-CinderUnicodeTest-1220130840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-d3b28ca3-74d6-4d2f-8744-de116341de37.a910a41e-3e09-481b-9400-2275b1e688c0 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:30:33 devstack sudo[101938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-d3b28ca3-74d6-4d2f-8744-de116341de37.a910a41e-3e09-481b-9400-2275b1e688c0 Sep 15 16:30:34 devstack sudo[101938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:30:34 devstack sudo[101938]: pam_unix(sudo:session): session closed for user root Sep 15 16:30:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-bbf53cc6-a88e-4c18-81bf-73283a0c691f tempest-CinderUnicodeTest-1220130840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-d3b28ca3-74d6-4d2f-8744-de116341de37.a910a41e-3e09-481b-9400-2275b1e688c0" returned: 0 in 0.258s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:30:34 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-bbf53cc6-a88e-4c18-81bf-73283a0c691f tempest-CinderUnicodeTest-1220130840 None] Lock "cinder-quobyte-a910a41e-3e09-481b-9400-2275b1e688c0" released by "_delete_snapshot" :: held 1.630s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:30:34 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-bbf53cc6-a88e-4c18-81bf-73283a0c691f tempest-CinderUnicodeTest-1220130840 None] Lock "cinder-quobyte-d3b28ca3-74d6-4d2f-8744-de116341de37" released by "delete_snapshot" :: held 1.662s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:30:34 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-bbf53cc6-a88e-4c18-81bf-73283a0c691f tempest-CinderUnicodeTest-1220130840 None] Created reservations ['82dc9386-c44b-4293-a545-c277cc2e33d5', '80a77656-afc6-4706-818a-01ded9adb0a0', '7e6b4d50-58ca-486f-a197-4bdd25dbda92', '559288fc-f367-495f-92af-464d4df9b158'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:30:34 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-bbf53cc6-a88e-4c18-81bf-73283a0c691f tempest-CinderUnicodeTest-1220130840 None] Delete snapshot completed successfully. Sep 15 16:30:34 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-bbf53cc6-a88e-4c18-81bf-73283a0c691f tempest-CinderUnicodeTest-1220130840 None] Lock "cinder-a910a41e-3e09-481b-9400-2275b1e688c0-delete_snapshot" released by "delete_snapshot" :: held 1.809s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:30:34 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-7ef86759-403d-4320-a059-405939f971fd tempest-CinderUnicodeTest-1220130840 None] Acquiring lock "cinder-d3b28ca3-74d6-4d2f-8744-de116341de37-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:30:34 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-7ef86759-403d-4320-a059-405939f971fd tempest-CinderUnicodeTest-1220130840 None] Lock "cinder-d3b28ca3-74d6-4d2f-8744-de116341de37-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:30:34 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-7ef86759-403d-4320-a059-405939f971fd tempest-CinderUnicodeTest-1220130840 None] Acquiring lock "cinder-quobyte-d3b28ca3-74d6-4d2f-8744-de116341de37" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:30:34 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-7ef86759-403d-4320-a059-405939f971fd tempest-CinderUnicodeTest-1220130840 None] Lock "cinder-quobyte-d3b28ca3-74d6-4d2f-8744-de116341de37" acquired by "delete_volume" :: waited 0.019s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:30:34 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f890ad6-0454-4ee9-a831-5dfabf298edf]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:30:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7ef86759-403d-4320-a059-405939f971fd tempest-CinderUnicodeTest-1220130840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-d3b28ca3-74d6-4d2f-8744-de116341de37 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:30:35 devstack sudo[101941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-d3b28ca3-74d6-4d2f-8744-de116341de37 Sep 15 16:30:35 devstack sudo[101941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:30:35 devstack sudo[101941]: pam_unix(sudo:session): session closed for user root Sep 15 16:30:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7ef86759-403d-4320-a059-405939f971fd tempest-CinderUnicodeTest-1220130840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-d3b28ca3-74d6-4d2f-8744-de116341de37" returned: 0 in 0.385s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:30:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7ef86759-403d-4320-a059-405939f971fd tempest-CinderUnicodeTest-1220130840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-d3b28ca3-74d6-4d2f-8744-de116341de37 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:30:35 devstack sudo[101946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-d3b28ca3-74d6-4d2f-8744-de116341de37 Sep 15 16:30:35 devstack sudo[101946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:30:35 devstack sudo[101946]: pam_unix(sudo:session): session closed for user root Sep 15 16:30:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7ef86759-403d-4320-a059-405939f971fd tempest-CinderUnicodeTest-1220130840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-d3b28ca3-74d6-4d2f-8744-de116341de37" returned: 0 in 0.266s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:30:35 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-7ef86759-403d-4320-a059-405939f971fd tempest-CinderUnicodeTest-1220130840 None] Lock "cinder-quobyte-d3b28ca3-74d6-4d2f-8744-de116341de37" released by "delete_volume" :: held 0.733s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:30:35 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-7ef86759-403d-4320-a059-405939f971fd tempest-CinderUnicodeTest-1220130840 None] Created reservations ['d962519e-f7b8-4dbf-96ca-7c81d511e6ac', '137faf7a-26fc-4956-b0b6-20cd6618a381', '5560780a-99ec-41af-9540-4c7ed08880f7', 'cf1949f8-fa9b-4d57-af45-8890d2931ea0'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:30:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-7ef86759-403d-4320-a059-405939f971fd tempest-CinderUnicodeTest-1220130840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:30:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-7ef86759-403d-4320-a059-405939f971fd tempest-CinderUnicodeTest-1220130840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:30:35 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-7ef86759-403d-4320-a059-405939f971fd tempest-CinderUnicodeTest-1220130840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:30:35 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-7ef86759-403d-4320-a059-405939f971fd tempest-CinderUnicodeTest-1220130840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:30:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-7ef86759-403d-4320-a059-405939f971fd tempest-CinderUnicodeTest-1220130840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:30:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7ef86759-403d-4320-a059-405939f971fd tempest-CinderUnicodeTest-1220130840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:30:35 devstack sudo[101949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:30:35 devstack sudo[101949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:30:35 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-4bb525cf-1605-4df7-b9f2-0804729c5e1f tempest-CinderUnicodeTest-1220130840 None] Acquiring lock "cinder-1bb19ecd-53ca-447f-a936-c47fa60a9aaf-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:30:36 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-4bb525cf-1605-4df7-b9f2-0804729c5e1f tempest-CinderUnicodeTest-1220130840 None] Lock "cinder-1bb19ecd-53ca-447f-a936-c47fa60a9aaf-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:30:36 devstack sudo[101949]: pam_unix(sudo:session): session closed for user root Sep 15 16:30:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7ef86759-403d-4320-a059-405939f971fd tempest-CinderUnicodeTest-1220130840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.319s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:30:36 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-7ef86759-403d-4320-a059-405939f971fd tempest-CinderUnicodeTest-1220130840 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:30:36 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-7ef86759-403d-4320-a059-405939f971fd tempest-CinderUnicodeTest-1220130840 None] Deleted volume successfully. Sep 15 16:30:36 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-4bb525cf-1605-4df7-b9f2-0804729c5e1f tempest-CinderUnicodeTest-1220130840 None] Acquiring lock "cinder-quobyte-1bb19ecd-53ca-447f-a936-c47fa60a9aaf" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:30:36 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-4bb525cf-1605-4df7-b9f2-0804729c5e1f tempest-CinderUnicodeTest-1220130840 None] Lock "cinder-quobyte-1bb19ecd-53ca-447f-a936-c47fa60a9aaf" acquired by "delete_volume" :: waited 0.022s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:30:36 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-7ef86759-403d-4320-a059-405939f971fd tempest-CinderUnicodeTest-1220130840 None] Lock "cinder-d3b28ca3-74d6-4d2f-8744-de116341de37-delete_volume" released by "delete_volume" :: held 1.314s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:30:36 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce7d4f6e-e5f1-4224-b1b5-bdc6a05969c5]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:30:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4bb525cf-1605-4df7-b9f2-0804729c5e1f tempest-CinderUnicodeTest-1220130840 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1bb19ecd-53ca-447f-a936-c47fa60a9aaf {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:30:36 devstack sudo[101952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1bb19ecd-53ca-447f-a936-c47fa60a9aaf Sep 15 16:30:36 devstack sudo[101952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:30:36 devstack sudo[101952]: pam_unix(sudo:session): session closed for user root Sep 15 16:30:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4bb525cf-1605-4df7-b9f2-0804729c5e1f tempest-CinderUnicodeTest-1220130840 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1bb19ecd-53ca-447f-a936-c47fa60a9aaf" returned: 0 in 0.380s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:30:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4bb525cf-1605-4df7-b9f2-0804729c5e1f tempest-CinderUnicodeTest-1220130840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1bb19ecd-53ca-447f-a936-c47fa60a9aaf {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:30:36 devstack sudo[101957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1bb19ecd-53ca-447f-a936-c47fa60a9aaf Sep 15 16:30:36 devstack sudo[101957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:30:36 devstack sudo[101957]: pam_unix(sudo:session): session closed for user root Sep 15 16:30:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4bb525cf-1605-4df7-b9f2-0804729c5e1f tempest-CinderUnicodeTest-1220130840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1bb19ecd-53ca-447f-a936-c47fa60a9aaf" returned: 0 in 0.266s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:30:36 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-4bb525cf-1605-4df7-b9f2-0804729c5e1f tempest-CinderUnicodeTest-1220130840 None] Lock "cinder-quobyte-1bb19ecd-53ca-447f-a936-c47fa60a9aaf" released by "delete_volume" :: held 0.701s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:30:36 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-4bb525cf-1605-4df7-b9f2-0804729c5e1f tempest-CinderUnicodeTest-1220130840 None] Created reservations ['b457849f-0aa4-4b94-a939-5e51b5ffdd8d', 'd84c931f-af4d-4195-83d5-88dc8c7163c5', 'fc647dee-2c94-40b1-91a2-bde67721e60d', '628c24fe-ede9-4ba6-8879-da23feef80b1'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:30:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-4bb525cf-1605-4df7-b9f2-0804729c5e1f tempest-CinderUnicodeTest-1220130840 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:30:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-4bb525cf-1605-4df7-b9f2-0804729c5e1f tempest-CinderUnicodeTest-1220130840 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:30:36 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-4bb525cf-1605-4df7-b9f2-0804729c5e1f tempest-CinderUnicodeTest-1220130840 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:30:36 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-4bb525cf-1605-4df7-b9f2-0804729c5e1f tempest-CinderUnicodeTest-1220130840 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:30:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-4bb525cf-1605-4df7-b9f2-0804729c5e1f tempest-CinderUnicodeTest-1220130840 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:30:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4bb525cf-1605-4df7-b9f2-0804729c5e1f tempest-CinderUnicodeTest-1220130840 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:30:36 devstack sudo[101963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:30:36 devstack sudo[101963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:30:37 devstack sudo[101963]: pam_unix(sudo:session): session closed for user root Sep 15 16:30:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4bb525cf-1605-4df7-b9f2-0804729c5e1f tempest-CinderUnicodeTest-1220130840 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.254s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:30:37 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-4bb525cf-1605-4df7-b9f2-0804729c5e1f tempest-CinderUnicodeTest-1220130840 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:30:37 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-4bb525cf-1605-4df7-b9f2-0804729c5e1f tempest-CinderUnicodeTest-1220130840 None] Deleted volume successfully. Sep 15 16:30:37 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-4bb525cf-1605-4df7-b9f2-0804729c5e1f tempest-CinderUnicodeTest-1220130840 None] Lock "cinder-1bb19ecd-53ca-447f-a936-c47fa60a9aaf-delete_volume" released by "delete_volume" :: held 1.201s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:30:40 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-1325bef0-1761-47c5-a83d-64ad2525cdbb tempest-VolumesActionsTest-481078182 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:30:40 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1325bef0-1761-47c5-a83d-64ad2525cdbb tempest-VolumesActionsTest-481078182 None] Flow 'volume_create_manager' (0a020544-bb1a-4355-8cd1-0997fd89b69c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:30:40 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1325bef0-1761-47c5-a83d-64ad2525cdbb tempest-VolumesActionsTest-481078182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c7e475e-8089-4a18-a3da-70d4c08577d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:30:40 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1325bef0-1761-47c5-a83d-64ad2525cdbb tempest-VolumesActionsTest-481078182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c7e475e-8089-4a18-a3da-70d4c08577d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:30:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1600767333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b82eed63-d7e6-4827-a84d-1d377bf1b932,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d913e87107574a338c1872968e78ebec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:30:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:30:41Z,use_quota=True,user_id='e9c536cf460d447db6cca61de18322e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:30:40 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1325bef0-1761-47c5-a83d-64ad2525cdbb tempest-VolumesActionsTest-481078182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11aeefbe-dfea-4609-b3cb-331b53db08a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:30:40 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1325bef0-1761-47c5-a83d-64ad2525cdbb tempest-VolumesActionsTest-481078182 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11aeefbe-dfea-4609-b3cb-331b53db08a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:30:40 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1325bef0-1761-47c5-a83d-64ad2525cdbb tempest-VolumesActionsTest-481078182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daaa5965-d4b2-4d08-9817-b6aa0e1703f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:30:40 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1325bef0-1761-47c5-a83d-64ad2525cdbb tempest-VolumesActionsTest-481078182 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daaa5965-d4b2-4d08-9817-b6aa0e1703f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b82eed63-d7e6-4827-a84d-1d377bf1b932', 'volume_name': 'volume-b82eed63-d7e6-4827-a84d-1d377bf1b932', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:30:40 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1325bef0-1761-47c5-a83d-64ad2525cdbb tempest-VolumesActionsTest-481078182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e3e3634-04cc-4d1d-b123-de77523541a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:30:40 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1325bef0-1761-47c5-a83d-64ad2525cdbb tempest-VolumesActionsTest-481078182 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e3e3634-04cc-4d1d-b123-de77523541a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:30:40 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1325bef0-1761-47c5-a83d-64ad2525cdbb tempest-VolumesActionsTest-481078182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a27946f-cfce-4958-a36f-ba89af6655e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:30:40 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-1325bef0-1761-47c5-a83d-64ad2525cdbb tempest-VolumesActionsTest-481078182 None] Volume b82eed63-d7e6-4827-a84d-1d377bf1b932: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b82eed63-d7e6-4827-a84d-1d377bf1b932', 'volume_size': 1} Sep 15 16:30:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-1325bef0-1761-47c5-a83d-64ad2525cdbb tempest-VolumesActionsTest-481078182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:30:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-1325bef0-1761-47c5-a83d-64ad2525cdbb tempest-VolumesActionsTest-481078182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:30:40 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-1325bef0-1761-47c5-a83d-64ad2525cdbb tempest-VolumesActionsTest-481078182 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:30:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1600767333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b82eed63-d7e6-4827-a84d-1d377bf1b932,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d913e87107574a338c1872968e78ebec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:30:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:30:41Z,use_quota=True,user_id='e9c536cf460d447db6cca61de18322e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:30:40 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-1325bef0-1761-47c5-a83d-64ad2525cdbb tempest-VolumesActionsTest-481078182 None] Creating volume b82eed63-d7e6-4827-a84d-1d377bf1b932 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:30:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-1325bef0-1761-47c5-a83d-64ad2525cdbb tempest-VolumesActionsTest-481078182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:30:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-1325bef0-1761-47c5-a83d-64ad2525cdbb tempest-VolumesActionsTest-481078182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:30:40 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-1325bef0-1761-47c5-a83d-64ad2525cdbb tempest-VolumesActionsTest-481078182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:30:40 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-1325bef0-1761-47c5-a83d-64ad2525cdbb tempest-VolumesActionsTest-481078182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:30:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-1325bef0-1761-47c5-a83d-64ad2525cdbb tempest-VolumesActionsTest-481078182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:30:40 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-1325bef0-1761-47c5-a83d-64ad2525cdbb tempest-VolumesActionsTest-481078182 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:30:40 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-1325bef0-1761-47c5-a83d-64ad2525cdbb tempest-VolumesActionsTest-481078182 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:30:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-1325bef0-1761-47c5-a83d-64ad2525cdbb tempest-VolumesActionsTest-481078182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b82eed63-d7e6-4827-a84d-1d377bf1b932 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:30:40 devstack sudo[101966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b82eed63-d7e6-4827-a84d-1d377bf1b932 1073741824 Sep 15 16:30:40 devstack sudo[101966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:30:41 devstack sudo[101966]: pam_unix(sudo:session): session closed for user root Sep 15 16:30:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-1325bef0-1761-47c5-a83d-64ad2525cdbb tempest-VolumesActionsTest-481078182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b82eed63-d7e6-4827-a84d-1d377bf1b932 1073741824" returned: 0 in 0.482s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:30:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-1325bef0-1761-47c5-a83d-64ad2525cdbb tempest-VolumesActionsTest-481078182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b82eed63-d7e6-4827-a84d-1d377bf1b932 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:30:41 devstack sudo[101972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b82eed63-d7e6-4827-a84d-1d377bf1b932 Sep 15 16:30:41 devstack sudo[101972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:30:41 devstack sudo[101972]: pam_unix(sudo:session): session closed for user root Sep 15 16:30:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-1325bef0-1761-47c5-a83d-64ad2525cdbb tempest-VolumesActionsTest-481078182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b82eed63-d7e6-4827-a84d-1d377bf1b932" returned: 0 in 0.263s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:30:41 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-1325bef0-1761-47c5-a83d-64ad2525cdbb tempest-VolumesActionsTest-481078182 None] <== create_volume: return (795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:30:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-1325bef0-1761-47c5-a83d-64ad2525cdbb tempest-VolumesActionsTest-481078182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.798s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:30:41 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1325bef0-1761-47c5-a83d-64ad2525cdbb tempest-VolumesActionsTest-481078182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a27946f-cfce-4958-a36f-ba89af6655e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b82eed63-d7e6-4827-a84d-1d377bf1b932', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:30:41 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1325bef0-1761-47c5-a83d-64ad2525cdbb tempest-VolumesActionsTest-481078182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06d6d8aa-a839-464f-a19f-fd0155ed3a46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:30:41 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-1325bef0-1761-47c5-a83d-64ad2525cdbb tempest-VolumesActionsTest-481078182 None] Volume volume-b82eed63-d7e6-4827-a84d-1d377bf1b932 (b82eed63-d7e6-4827-a84d-1d377bf1b932): created successfully Sep 15 16:30:41 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1325bef0-1761-47c5-a83d-64ad2525cdbb tempest-VolumesActionsTest-481078182 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06d6d8aa-a839-464f-a19f-fd0155ed3a46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:30:41 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-1325bef0-1761-47c5-a83d-64ad2525cdbb tempest-VolumesActionsTest-481078182 None] Flow 'volume_create_manager' (0a020544-bb1a-4355-8cd1-0997fd89b69c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:30:41 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-1325bef0-1761-47c5-a83d-64ad2525cdbb tempest-VolumesActionsTest-481078182 None] Created volume successfully. Sep 15 16:30:49 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-68858012-80e6-4cec-863c-10004e0224a6 tempest-VolumesActionsTest-481078182 None] Acquiring lock "cinder-b82eed63-d7e6-4827-a84d-1d377bf1b932" by "attach_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:30:49 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-68858012-80e6-4cec-863c-10004e0224a6 tempest-VolumesActionsTest-481078182 None] Lock "cinder-b82eed63-d7e6-4827-a84d-1d377bf1b932" acquired by "attach_volume" :: waited 0.018s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:30:49 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-68858012-80e6-4cec-863c-10004e0224a6 tempest-VolumesActionsTest-481078182 None] Attaching volume b82eed63-d7e6-4827-a84d-1d377bf1b932 to instance 3a6a8d10-212b-4c08-b590-15cf42d5b488 at mountpoint /dev/vdb on host None. Sep 15 16:30:49 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-68858012-80e6-4cec-863c-10004e0224a6 tempest-VolumesActionsTest-481078182 None] Attach volume completed successfully. Sep 15 16:30:49 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-68858012-80e6-4cec-863c-10004e0224a6 tempest-VolumesActionsTest-481078182 None] Lock "cinder-b82eed63-d7e6-4827-a84d-1d377bf1b932" released by "attach_volume" :: held 0.090s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:30:49 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-fee53419-a4e0-47b9-b5d1-3c4bbb8a6cc6 tempest-VolumesActionsTest-481078182 None] Acquiring lock "cinder-b82eed63-d7e6-4827-a84d-1d377bf1b932-detach_volume" by "detach_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:30:50 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-fee53419-a4e0-47b9-b5d1-3c4bbb8a6cc6 tempest-VolumesActionsTest-481078182 None] Lock "cinder-b82eed63-d7e6-4827-a84d-1d377bf1b932-detach_volume" acquired by "detach_volume" :: waited 0.015s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:30:50 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-fee53419-a4e0-47b9-b5d1-3c4bbb8a6cc6 tempest-VolumesActionsTest-481078182 None] Detaching volume b82eed63-d7e6-4827-a84d-1d377bf1b932 from instance 3a6a8d10-212b-4c08-b590-15cf42d5b488. Sep 15 16:30:50 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-fee53419-a4e0-47b9-b5d1-3c4bbb8a6cc6 tempest-VolumesActionsTest-481078182 None] Detach volume completed successfully. Sep 15 16:30:50 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-fee53419-a4e0-47b9-b5d1-3c4bbb8a6cc6 tempest-VolumesActionsTest-481078182 None] Lock "cinder-b82eed63-d7e6-4827-a84d-1d377bf1b932-detach_volume" released by "detach_volume" :: held 0.057s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:30:59 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-1146bec5-744c-4f06-8027-aeb8636c5f34 tempest-VolumesActionsTest-481078182 None] Acquiring lock "cinder-b82eed63-d7e6-4827-a84d-1d377bf1b932" by "attach_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:30:59 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-1146bec5-744c-4f06-8027-aeb8636c5f34 tempest-VolumesActionsTest-481078182 None] Lock "cinder-b82eed63-d7e6-4827-a84d-1d377bf1b932" acquired by "attach_volume" :: waited 0.019s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:30:59 devstack cinder-volume[86082]: DEBUG oslo_service.periodic_task [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86082) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 15 16:30:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:30:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:30:59 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:30:59 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:30:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:30:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:30:59 devstack sudo[102172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:30:59 devstack sudo[102172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:30:59 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-1146bec5-744c-4f06-8027-aeb8636c5f34 tempest-VolumesActionsTest-481078182 None] Attaching volume b82eed63-d7e6-4827-a84d-1d377bf1b932 to instance a5ebe9b9-7a71-4b0e-98ad-f31ea35dd609 at mountpoint /dev/vdb on host None. Sep 15 16:30:59 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-1146bec5-744c-4f06-8027-aeb8636c5f34 tempest-VolumesActionsTest-481078182 None] Attach volume completed successfully. Sep 15 16:30:59 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-1146bec5-744c-4f06-8027-aeb8636c5f34 tempest-VolumesActionsTest-481078182 None] Lock "cinder-b82eed63-d7e6-4827-a84d-1d377bf1b932" released by "attach_volume" :: held 0.126s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:31:00 devstack sudo[102172]: pam_unix(sudo:session): session closed for user root Sep 15 16:31:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.272s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:31:00 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:31:00 devstack cinder-volume[86082]: DEBUG oslo_service.periodic_task [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Running periodic task VolumeManager._thread_info {{(pid=86082) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 15 16:31:00 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] thread count: 28 {{(pid=86082) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 15 16:31:00 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] thread info: [<_MainThread(MainThread, started 124875935469696)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86082) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 15 16:31:00 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-789f1ae2-ab72-47c1-ba7f-46c0faa11ff1 tempest-VolumesActionsTest-481078182 None] Acquiring lock "cinder-b82eed63-d7e6-4827-a84d-1d377bf1b932-detach_volume" by "detach_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:31:00 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-789f1ae2-ab72-47c1-ba7f-46c0faa11ff1 tempest-VolumesActionsTest-481078182 None] Lock "cinder-b82eed63-d7e6-4827-a84d-1d377bf1b932-detach_volume" acquired by "detach_volume" :: waited 0.017s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:31:00 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-789f1ae2-ab72-47c1-ba7f-46c0faa11ff1 tempest-VolumesActionsTest-481078182 None] Detaching volume b82eed63-d7e6-4827-a84d-1d377bf1b932 from instance a5ebe9b9-7a71-4b0e-98ad-f31ea35dd609. Sep 15 16:31:00 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-789f1ae2-ab72-47c1-ba7f-46c0faa11ff1 tempest-VolumesActionsTest-481078182 None] Detach volume completed successfully. Sep 15 16:31:00 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-789f1ae2-ab72-47c1-ba7f-46c0faa11ff1 tempest-VolumesActionsTest-481078182 None] Lock "cinder-b82eed63-d7e6-4827-a84d-1d377bf1b932-detach_volume" released by "detach_volume" :: held 0.057s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:31:04 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:SELECT=90,cinder:INSERT=34,cinder:UPDATE=96,cinder:DELETE=9 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 16:31:04 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-de1d0583-16e3-4287-8000-183ac134b4e4 tempest-VolumesActionsTest-481078182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:31:04 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-de1d0583-16e3-4287-8000-183ac134b4e4 tempest-VolumesActionsTest-481078182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:31:04 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[59f63e03-10d0-4c01-b79b-6a1c26d29c0f]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:31:04 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-de1d0583-16e3-4287-8000-183ac134b4e4 tempest-VolumesActionsTest-481078182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b82eed63-d7e6-4827-a84d-1d377bf1b932 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:31:04 devstack sudo[102198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b82eed63-d7e6-4827-a84d-1d377bf1b932 Sep 15 16:31:04 devstack sudo[102198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:31:05 devstack sudo[102198]: pam_unix(sudo:session): session closed for user root Sep 15 16:31:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-de1d0583-16e3-4287-8000-183ac134b4e4 tempest-VolumesActionsTest-481078182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b82eed63-d7e6-4827-a84d-1d377bf1b932" returned: 0 in 0.354s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:31:05 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdeb2cc6-b682-4a4d-b783-6cbec290d680]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:31:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-de1d0583-16e3-4287-8000-183ac134b4e4 tempest-VolumesActionsTest-481078182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b82eed63-d7e6-4827-a84d-1d377bf1b932 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:31:05 devstack sudo[102204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b82eed63-d7e6-4827-a84d-1d377bf1b932 Sep 15 16:31:05 devstack sudo[102204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:31:05 devstack sudo[102204]: pam_unix(sudo:session): session closed for user root Sep 15 16:31:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-de1d0583-16e3-4287-8000-183ac134b4e4 tempest-VolumesActionsTest-481078182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b82eed63-d7e6-4827-a84d-1d377bf1b932" returned: 0 in 0.358s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:31:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-de1d0583-16e3-4287-8000-183ac134b4e4 tempest-VolumesActionsTest-481078182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b82eed63-d7e6-4827-a84d-1d377bf1b932 /opt/stack/data/cinder/conversion/b82eed63-d7e6-4827-a84d-1d377bf1b932.temp_image.24bb0122-08be-4592-9631-35ce09c8b07bspqqpyqw.img {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:31:05 devstack sudo[102209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b82eed63-d7e6-4827-a84d-1d377bf1b932 /opt/stack/data/cinder/conversion/b82eed63-d7e6-4827-a84d-1d377bf1b932.temp_image.24bb0122-08be-4592-9631-35ce09c8b07bspqqpyqw.img Sep 15 16:31:05 devstack sudo[102209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:31:10 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:SELECT=84,cinder:INSERT=19,cinder:UPDATE=109,cinder:DELETE=7 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 16:31:11 devstack sudo[102209]: pam_unix(sudo:session): session closed for user root Sep 15 16:31:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-de1d0583-16e3-4287-8000-183ac134b4e4 tempest-VolumesActionsTest-481078182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b82eed63-d7e6-4827-a84d-1d377bf1b932 /opt/stack/data/cinder/conversion/b82eed63-d7e6-4827-a84d-1d377bf1b932.temp_image.24bb0122-08be-4592-9631-35ce09c8b07bspqqpyqw.img" returned: 0 in 5.686s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:31:11 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0c4adae-933e-44e9-b427-84f5150904f1]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:31:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-de1d0583-16e3-4287-8000-183ac134b4e4 tempest-VolumesActionsTest-481078182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b82eed63-d7e6-4827-a84d-1d377bf1b932 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:31:11 devstack sudo[102223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b82eed63-d7e6-4827-a84d-1d377bf1b932 Sep 15 16:31:11 devstack sudo[102223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:31:11 devstack sudo[102223]: pam_unix(sudo:session): session closed for user root Sep 15 16:31:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-de1d0583-16e3-4287-8000-183ac134b4e4 tempest-VolumesActionsTest-481078182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b82eed63-d7e6-4827-a84d-1d377bf1b932" returned: 0 in 0.497s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:31:11 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-de1d0583-16e3-4287-8000-183ac134b4e4 tempest-VolumesActionsTest-481078182 None] Image conversion details: src /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b82eed63-d7e6-4827-a84d-1d377bf1b932, size 1024.00 MB, duration 5.69 sec, destination /opt/stack/data/cinder/conversion/b82eed63-d7e6-4827-a84d-1d377bf1b932.temp_image.24bb0122-08be-4592-9631-35ce09c8b07bspqqpyqw.img {{(pid=86082) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 15 16:31:11 devstack cinder-volume[86082]: INFO cinder.image.image_utils [None req-de1d0583-16e3-4287-8000-183ac134b4e4 tempest-VolumesActionsTest-481078182 None] Converted 1024.00 MB image at 180.06 MB/s Sep 15 16:31:11 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-de1d0583-16e3-4287-8000-183ac134b4e4 tempest-VolumesActionsTest-481078182 None] 24bb0122-08be-4592-9631-35ce09c8b07b was raw, no need to convert to raw {{(pid=86082) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 15 16:31:21 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:SELECT=2 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 16:31:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-de1d0583-16e3-4287-8000-183ac134b4e4 tempest-VolumesActionsTest-481078182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 25.038s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:31:29 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-de1d0583-16e3-4287-8000-183ac134b4e4 tempest-VolumesActionsTest-481078182 None] Uploaded volume to glance image-id: 24bb0122-08be-4592-9631-35ce09c8b07b. {{(pid=86082) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 15 16:31:29 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-de1d0583-16e3-4287-8000-183ac134b4e4 tempest-VolumesActionsTest-481078182 None] Copy volume to image completed successfully. Sep 15 16:31:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-9c26976b-c578-4a2d-a310-a19723ea9804 tempest-VolumesActionsTest-481078182 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:31:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-9c26976b-c578-4a2d-a310-a19723ea9804 tempest-VolumesActionsTest-481078182 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:31:31 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[690bef6d-b207-4623-96f8-3b6f030bbe06]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:31:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9c26976b-c578-4a2d-a310-a19723ea9804 tempest-VolumesActionsTest-481078182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b82eed63-d7e6-4827-a84d-1d377bf1b932 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:31:31 devstack sudo[102266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b82eed63-d7e6-4827-a84d-1d377bf1b932 Sep 15 16:31:31 devstack sudo[102266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:31:31 devstack sudo[102266]: pam_unix(sudo:session): session closed for user root Sep 15 16:31:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9c26976b-c578-4a2d-a310-a19723ea9804 tempest-VolumesActionsTest-481078182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b82eed63-d7e6-4827-a84d-1d377bf1b932" returned: 0 in 0.347s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:31:31 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[5232ca68-93ec-400d-a5c5-b10c5eefd7c7]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:31:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9c26976b-c578-4a2d-a310-a19723ea9804 tempest-VolumesActionsTest-481078182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b82eed63-d7e6-4827-a84d-1d377bf1b932 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:31:31 devstack sudo[102277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b82eed63-d7e6-4827-a84d-1d377bf1b932 Sep 15 16:31:31 devstack sudo[102277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:31:31 devstack sudo[102277]: pam_unix(sudo:session): session closed for user root Sep 15 16:31:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9c26976b-c578-4a2d-a310-a19723ea9804 tempest-VolumesActionsTest-481078182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b82eed63-d7e6-4827-a84d-1d377bf1b932" returned: 0 in 0.351s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:31:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9c26976b-c578-4a2d-a310-a19723ea9804 tempest-VolumesActionsTest-481078182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b82eed63-d7e6-4827-a84d-1d377bf1b932 /opt/stack/data/cinder/conversion/b82eed63-d7e6-4827-a84d-1d377bf1b932.temp_image.d8fe0e08-ea62-4f1e-9d79-86534cfce955ob6yaz5q.img {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:31:31 devstack sudo[102282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b82eed63-d7e6-4827-a84d-1d377bf1b932 /opt/stack/data/cinder/conversion/b82eed63-d7e6-4827-a84d-1d377bf1b932.temp_image.d8fe0e08-ea62-4f1e-9d79-86534cfce955ob6yaz5q.img Sep 15 16:31:31 devstack sudo[102282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:31:37 devstack sudo[102282]: pam_unix(sudo:session): session closed for user root Sep 15 16:31:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9c26976b-c578-4a2d-a310-a19723ea9804 tempest-VolumesActionsTest-481078182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b82eed63-d7e6-4827-a84d-1d377bf1b932 /opt/stack/data/cinder/conversion/b82eed63-d7e6-4827-a84d-1d377bf1b932.temp_image.d8fe0e08-ea62-4f1e-9d79-86534cfce955ob6yaz5q.img" returned: 0 in 5.861s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:31:37 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[00d78466-988a-4269-863b-25a1e4745eea]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:31:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9c26976b-c578-4a2d-a310-a19723ea9804 tempest-VolumesActionsTest-481078182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b82eed63-d7e6-4827-a84d-1d377bf1b932 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:31:37 devstack sudo[102299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b82eed63-d7e6-4827-a84d-1d377bf1b932 Sep 15 16:31:37 devstack sudo[102299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:31:38 devstack sudo[102299]: pam_unix(sudo:session): session closed for user root Sep 15 16:31:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9c26976b-c578-4a2d-a310-a19723ea9804 tempest-VolumesActionsTest-481078182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b82eed63-d7e6-4827-a84d-1d377bf1b932" returned: 0 in 0.510s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:31:38 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-9c26976b-c578-4a2d-a310-a19723ea9804 tempest-VolumesActionsTest-481078182 None] Image conversion details: src /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b82eed63-d7e6-4827-a84d-1d377bf1b932, size 1024.00 MB, duration 5.86 sec, destination /opt/stack/data/cinder/conversion/b82eed63-d7e6-4827-a84d-1d377bf1b932.temp_image.d8fe0e08-ea62-4f1e-9d79-86534cfce955ob6yaz5q.img {{(pid=86082) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 15 16:31:38 devstack cinder-volume[86082]: INFO cinder.image.image_utils [None req-9c26976b-c578-4a2d-a310-a19723ea9804 tempest-VolumesActionsTest-481078182 None] Converted 1024.00 MB image at 174.67 MB/s Sep 15 16:31:38 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-9c26976b-c578-4a2d-a310-a19723ea9804 tempest-VolumesActionsTest-481078182 None] d8fe0e08-ea62-4f1e-9d79-86534cfce955 was raw, converting to qcow2 {{(pid=86082) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}} Sep 15 16:31:38 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[aee63d8b-db27-455c-aaa8-880c51ef304b]: (4, 'raw') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:31:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9c26976b-c578-4a2d-a310-a19723ea9804 tempest-VolumesActionsTest-481078182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/b82eed63-d7e6-4827-a84d-1d377bf1b932.temp_image.d8fe0e08-ea62-4f1e-9d79-86534cfce955ob6yaz5q.img {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:31:38 devstack sudo[102304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/b82eed63-d7e6-4827-a84d-1d377bf1b932.temp_image.d8fe0e08-ea62-4f1e-9d79-86534cfce955ob6yaz5q.img Sep 15 16:31:38 devstack sudo[102304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:31:38 devstack sudo[102304]: pam_unix(sudo:session): session closed for user root Sep 15 16:31:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9c26976b-c578-4a2d-a310-a19723ea9804 tempest-VolumesActionsTest-481078182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/b82eed63-d7e6-4827-a84d-1d377bf1b932.temp_image.d8fe0e08-ea62-4f1e-9d79-86534cfce955ob6yaz5q.img" returned: 0 in 0.315s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:31:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9c26976b-c578-4a2d-a310-a19723ea9804 tempest-VolumesActionsTest-481078182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b82eed63-d7e6-4827-a84d-1d377bf1b932.temp_image.d8fe0e08-ea62-4f1e-9d79-86534cfce955ob6yaz5q.img {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:31:38 devstack sudo[102308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b82eed63-d7e6-4827-a84d-1d377bf1b932.temp_image.d8fe0e08-ea62-4f1e-9d79-86534cfce955ob6yaz5q.img Sep 15 16:31:38 devstack sudo[102308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:31:39 devstack sudo[102308]: pam_unix(sudo:session): session closed for user root Sep 15 16:31:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9c26976b-c578-4a2d-a310-a19723ea9804 tempest-VolumesActionsTest-481078182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b82eed63-d7e6-4827-a84d-1d377bf1b932.temp_image.d8fe0e08-ea62-4f1e-9d79-86534cfce955ob6yaz5q.img" returned: 1 in 0.314s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:31:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9c26976b-c578-4a2d-a310-a19723ea9804 tempest-VolumesActionsTest-481078182 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/b82eed63-d7e6-4827-a84d-1d377bf1b932.temp_image.d8fe0e08-ea62-4f1e-9d79-86534cfce955ob6yaz5q.img' failed. Not Retrying. {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 15 16:31:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9c26976b-c578-4a2d-a310-a19723ea9804 tempest-VolumesActionsTest-481078182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/b82eed63-d7e6-4827-a84d-1d377bf1b932.temp_image.d8fe0e08-ea62-4f1e-9d79-86534cfce955ob6yaz5q.img /opt/stack/data/cinder/conversion/vol_upload_8ngspf99 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:31:39 devstack sudo[102313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/b82eed63-d7e6-4827-a84d-1d377bf1b932.temp_image.d8fe0e08-ea62-4f1e-9d79-86534cfce955ob6yaz5q.img /opt/stack/data/cinder/conversion/vol_upload_8ngspf99 Sep 15 16:31:39 devstack sudo[102313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:31:39 devstack sudo[102313]: pam_unix(sudo:session): session closed for user root Sep 15 16:31:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9c26976b-c578-4a2d-a310-a19723ea9804 tempest-VolumesActionsTest-481078182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/b82eed63-d7e6-4827-a84d-1d377bf1b932.temp_image.d8fe0e08-ea62-4f1e-9d79-86534cfce955ob6yaz5q.img /opt/stack/data/cinder/conversion/vol_upload_8ngspf99" returned: 0 in 0.243s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:31:39 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-9c26976b-c578-4a2d-a310-a19723ea9804 tempest-VolumesActionsTest-481078182 None] Image conversion details: src /opt/stack/data/cinder/conversion/b82eed63-d7e6-4827-a84d-1d377bf1b932.temp_image.d8fe0e08-ea62-4f1e-9d79-86534cfce955ob6yaz5q.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_8ngspf99 {{(pid=86082) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 15 16:31:39 devstack cinder-volume[86082]: INFO cinder.image.image_utils [None req-9c26976b-c578-4a2d-a310-a19723ea9804 tempest-VolumesActionsTest-481078182 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 15 16:31:39 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9307c16-f2c9-43c4-aea4-57ad63432145]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:31:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9c26976b-c578-4a2d-a310-a19723ea9804 tempest-VolumesActionsTest-481078182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_8ngspf99 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:31:39 devstack sudo[102319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_8ngspf99 Sep 15 16:31:39 devstack sudo[102319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:31:39 devstack sudo[102319]: pam_unix(sudo:session): session closed for user root Sep 15 16:31:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9c26976b-c578-4a2d-a310-a19723ea9804 tempest-VolumesActionsTest-481078182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_8ngspf99" returned: 0 in 0.317s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:31:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-9c26976b-c578-4a2d-a310-a19723ea9804 tempest-VolumesActionsTest-481078182 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 9.494s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:31:40 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9c26976b-c578-4a2d-a310-a19723ea9804 tempest-VolumesActionsTest-481078182 None] Uploaded volume to glance image-id: d8fe0e08-ea62-4f1e-9d79-86534cfce955. {{(pid=86082) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 15 16:31:40 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-9c26976b-c578-4a2d-a310-a19723ea9804 tempest-VolumesActionsTest-481078182 None] Copy volume to image completed successfully. Sep 15 16:31:42 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-56adcc3a-7204-4b7a-883f-2c095c144a18 tempest-VolumesActionsTest-481078182 None] Acquiring lock "cinder-b82eed63-d7e6-4827-a84d-1d377bf1b932-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:31:42 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-56adcc3a-7204-4b7a-883f-2c095c144a18 tempest-VolumesActionsTest-481078182 None] Lock "cinder-b82eed63-d7e6-4827-a84d-1d377bf1b932-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:31:42 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-56adcc3a-7204-4b7a-883f-2c095c144a18 tempest-VolumesActionsTest-481078182 None] Acquiring lock "cinder-quobyte-b82eed63-d7e6-4827-a84d-1d377bf1b932" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:31:42 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-56adcc3a-7204-4b7a-883f-2c095c144a18 tempest-VolumesActionsTest-481078182 None] Lock "cinder-quobyte-b82eed63-d7e6-4827-a84d-1d377bf1b932" acquired by "delete_volume" :: waited 0.014s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:31:42 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[49fc6cf3-6b8e-4796-9647-a8fb59377dd1]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:31:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-56adcc3a-7204-4b7a-883f-2c095c144a18 tempest-VolumesActionsTest-481078182 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b82eed63-d7e6-4827-a84d-1d377bf1b932 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:31:42 devstack sudo[102324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b82eed63-d7e6-4827-a84d-1d377bf1b932 Sep 15 16:31:42 devstack sudo[102324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:31:42 devstack sudo[102324]: pam_unix(sudo:session): session closed for user root Sep 15 16:31:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-56adcc3a-7204-4b7a-883f-2c095c144a18 tempest-VolumesActionsTest-481078182 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b82eed63-d7e6-4827-a84d-1d377bf1b932" returned: 0 in 0.371s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:31:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-56adcc3a-7204-4b7a-883f-2c095c144a18 tempest-VolumesActionsTest-481078182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b82eed63-d7e6-4827-a84d-1d377bf1b932 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:31:42 devstack sudo[102329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b82eed63-d7e6-4827-a84d-1d377bf1b932 Sep 15 16:31:42 devstack sudo[102329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:31:42 devstack sudo[102329]: pam_unix(sudo:session): session closed for user root Sep 15 16:31:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-56adcc3a-7204-4b7a-883f-2c095c144a18 tempest-VolumesActionsTest-481078182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b82eed63-d7e6-4827-a84d-1d377bf1b932" returned: 0 in 0.244s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:31:42 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-56adcc3a-7204-4b7a-883f-2c095c144a18 tempest-VolumesActionsTest-481078182 None] Lock "cinder-quobyte-b82eed63-d7e6-4827-a84d-1d377bf1b932" released by "delete_volume" :: held 0.651s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:31:43 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-56adcc3a-7204-4b7a-883f-2c095c144a18 tempest-VolumesActionsTest-481078182 None] Created reservations ['54a78d9f-da6f-4d3c-988a-2d5d4a09bdaf', '0c549176-6c98-4b07-b6da-fbf7447364e7', 'e783adfe-7ef4-4e4a-875c-f713bf8c2b18', 'b3f18913-bbb5-4184-b958-e04b88974952'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:31:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-56adcc3a-7204-4b7a-883f-2c095c144a18 tempest-VolumesActionsTest-481078182 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:31:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-56adcc3a-7204-4b7a-883f-2c095c144a18 tempest-VolumesActionsTest-481078182 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:31:43 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-56adcc3a-7204-4b7a-883f-2c095c144a18 tempest-VolumesActionsTest-481078182 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:31:43 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-56adcc3a-7204-4b7a-883f-2c095c144a18 tempest-VolumesActionsTest-481078182 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:31:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-56adcc3a-7204-4b7a-883f-2c095c144a18 tempest-VolumesActionsTest-481078182 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:31:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-56adcc3a-7204-4b7a-883f-2c095c144a18 tempest-VolumesActionsTest-481078182 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:31:43 devstack sudo[102332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:31:43 devstack sudo[102332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:31:43 devstack sudo[102332]: pam_unix(sudo:session): session closed for user root Sep 15 16:31:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-56adcc3a-7204-4b7a-883f-2c095c144a18 tempest-VolumesActionsTest-481078182 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.243s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:31:43 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-56adcc3a-7204-4b7a-883f-2c095c144a18 tempest-VolumesActionsTest-481078182 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:31:43 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-56adcc3a-7204-4b7a-883f-2c095c144a18 tempest-VolumesActionsTest-481078182 None] Deleted volume successfully. Sep 15 16:31:43 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-56adcc3a-7204-4b7a-883f-2c095c144a18 tempest-VolumesActionsTest-481078182 None] Lock "cinder-b82eed63-d7e6-4827-a84d-1d377bf1b932-delete_volume" released by "delete_volume" :: held 1.091s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:31:50 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-092da12d-e4ea-4ad3-b245-f5b08baedfc4 tempest-VolumesGetTest-1239150761 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:31:50 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-092da12d-e4ea-4ad3-b245-f5b08baedfc4 tempest-VolumesGetTest-1239150761 None] Flow 'volume_create_manager' (cd439f51-21eb-41a3-924f-93d637111244) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:31:50 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-092da12d-e4ea-4ad3-b245-f5b08baedfc4 tempest-VolumesGetTest-1239150761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4dd7f52-8cab-443b-b669-4d115276bdbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:31:50 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-092da12d-e4ea-4ad3-b245-f5b08baedfc4 tempest-VolumesGetTest-1239150761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e4dd7f52-8cab-443b-b669-4d115276bdbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:31:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-284562503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=baf5f362-1949-4c1a-8a56-12c975f307f4,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f5a0bb68482346e68fdb180432e510b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:31:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:31:50Z,use_quota=True,user_id='c565d0459d61428f8e3171809fd98282',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:31:50 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-092da12d-e4ea-4ad3-b245-f5b08baedfc4 tempest-VolumesGetTest-1239150761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bc9c144-5a6c-4429-8249-a1f18af8ee24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:31:50 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-092da12d-e4ea-4ad3-b245-f5b08baedfc4 tempest-VolumesGetTest-1239150761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bc9c144-5a6c-4429-8249-a1f18af8ee24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:31:50 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-092da12d-e4ea-4ad3-b245-f5b08baedfc4 tempest-VolumesGetTest-1239150761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4891ce51-c803-499c-90c3-7fd0756e6b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:31:50 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-092da12d-e4ea-4ad3-b245-f5b08baedfc4 tempest-VolumesGetTest-1239150761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4891ce51-c803-499c-90c3-7fd0756e6b91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'baf5f362-1949-4c1a-8a56-12c975f307f4', 'volume_name': 'volume-baf5f362-1949-4c1a-8a56-12c975f307f4', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:31:50 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-092da12d-e4ea-4ad3-b245-f5b08baedfc4 tempest-VolumesGetTest-1239150761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ec920f8-65b6-4db9-a088-9f1480791e7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:31:50 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-092da12d-e4ea-4ad3-b245-f5b08baedfc4 tempest-VolumesGetTest-1239150761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ec920f8-65b6-4db9-a088-9f1480791e7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:31:50 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-092da12d-e4ea-4ad3-b245-f5b08baedfc4 tempest-VolumesGetTest-1239150761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cab38db-2728-4585-afdc-967cd890bc1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:31:50 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-092da12d-e4ea-4ad3-b245-f5b08baedfc4 tempest-VolumesGetTest-1239150761 None] Volume baf5f362-1949-4c1a-8a56-12c975f307f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-baf5f362-1949-4c1a-8a56-12c975f307f4', 'volume_size': 1} Sep 15 16:31:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-092da12d-e4ea-4ad3-b245-f5b08baedfc4 tempest-VolumesGetTest-1239150761 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:31:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-092da12d-e4ea-4ad3-b245-f5b08baedfc4 tempest-VolumesGetTest-1239150761 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:31:50 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-092da12d-e4ea-4ad3-b245-f5b08baedfc4 tempest-VolumesGetTest-1239150761 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:31:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-284562503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=baf5f362-1949-4c1a-8a56-12c975f307f4,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f5a0bb68482346e68fdb180432e510b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:31:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:31:50Z,use_quota=True,user_id='c565d0459d61428f8e3171809fd98282',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:31:50 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-092da12d-e4ea-4ad3-b245-f5b08baedfc4 tempest-VolumesGetTest-1239150761 None] Creating volume baf5f362-1949-4c1a-8a56-12c975f307f4 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:31:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-092da12d-e4ea-4ad3-b245-f5b08baedfc4 tempest-VolumesGetTest-1239150761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:31:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-092da12d-e4ea-4ad3-b245-f5b08baedfc4 tempest-VolumesGetTest-1239150761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:31:50 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-092da12d-e4ea-4ad3-b245-f5b08baedfc4 tempest-VolumesGetTest-1239150761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:31:50 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-092da12d-e4ea-4ad3-b245-f5b08baedfc4 tempest-VolumesGetTest-1239150761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:31:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-092da12d-e4ea-4ad3-b245-f5b08baedfc4 tempest-VolumesGetTest-1239150761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:31:50 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-092da12d-e4ea-4ad3-b245-f5b08baedfc4 tempest-VolumesGetTest-1239150761 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:31:50 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-092da12d-e4ea-4ad3-b245-f5b08baedfc4 tempest-VolumesGetTest-1239150761 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:31:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-092da12d-e4ea-4ad3-b245-f5b08baedfc4 tempest-VolumesGetTest-1239150761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-baf5f362-1949-4c1a-8a56-12c975f307f4 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:31:50 devstack sudo[102343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-baf5f362-1949-4c1a-8a56-12c975f307f4 1073741824 Sep 15 16:31:50 devstack sudo[102343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:31:50 devstack sudo[102343]: pam_unix(sudo:session): session closed for user root Sep 15 16:31:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-092da12d-e4ea-4ad3-b245-f5b08baedfc4 tempest-VolumesGetTest-1239150761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-baf5f362-1949-4c1a-8a56-12c975f307f4 1073741824" returned: 0 in 0.400s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:31:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-092da12d-e4ea-4ad3-b245-f5b08baedfc4 tempest-VolumesGetTest-1239150761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-baf5f362-1949-4c1a-8a56-12c975f307f4 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:31:50 devstack sudo[102348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-baf5f362-1949-4c1a-8a56-12c975f307f4 Sep 15 16:31:50 devstack sudo[102348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:31:50 devstack sudo[102348]: pam_unix(sudo:session): session closed for user root Sep 15 16:31:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-092da12d-e4ea-4ad3-b245-f5b08baedfc4 tempest-VolumesGetTest-1239150761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-baf5f362-1949-4c1a-8a56-12c975f307f4" returned: 0 in 0.231s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:31:50 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-092da12d-e4ea-4ad3-b245-f5b08baedfc4 tempest-VolumesGetTest-1239150761 None] <== create_volume: return (670ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:31:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-092da12d-e4ea-4ad3-b245-f5b08baedfc4 tempest-VolumesGetTest-1239150761 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.673s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:31:50 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-092da12d-e4ea-4ad3-b245-f5b08baedfc4 tempest-VolumesGetTest-1239150761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4cab38db-2728-4585-afdc-967cd890bc1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-baf5f362-1949-4c1a-8a56-12c975f307f4', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:31:50 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-092da12d-e4ea-4ad3-b245-f5b08baedfc4 tempest-VolumesGetTest-1239150761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64779b89-8c8e-4728-a19a-47597a412200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:31:50 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-092da12d-e4ea-4ad3-b245-f5b08baedfc4 tempest-VolumesGetTest-1239150761 None] Volume volume-baf5f362-1949-4c1a-8a56-12c975f307f4 (baf5f362-1949-4c1a-8a56-12c975f307f4): created successfully Sep 15 16:31:50 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-092da12d-e4ea-4ad3-b245-f5b08baedfc4 tempest-VolumesGetTest-1239150761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64779b89-8c8e-4728-a19a-47597a412200) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:31:50 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-092da12d-e4ea-4ad3-b245-f5b08baedfc4 tempest-VolumesGetTest-1239150761 None] Flow 'volume_create_manager' (cd439f51-21eb-41a3-924f-93d637111244) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:31:50 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-092da12d-e4ea-4ad3-b245-f5b08baedfc4 tempest-VolumesGetTest-1239150761 None] Created volume successfully. Sep 15 16:31:51 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-028acefc-63b4-4a4d-ac9c-4552b60cd13d tempest-VolumesGetTest-1239150761 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:31:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-028acefc-63b4-4a4d-ac9c-4552b60cd13d tempest-VolumesGetTest-1239150761 None] Flow 'volume_create_manager' (62ab64fd-7f1f-4ac0-8072-fba580f2a87d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:31:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-028acefc-63b4-4a4d-ac9c-4552b60cd13d tempest-VolumesGetTest-1239150761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55bf1293-688c-457a-86d4-5fb0b7f6dbdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:31:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-028acefc-63b4-4a4d-ac9c-4552b60cd13d tempest-VolumesGetTest-1239150761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55bf1293-688c-457a-86d4-5fb0b7f6dbdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:31:51Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-949752838',display_name='tempest-VolumesGetTest-Volume-1214663019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79fe2edb-6c39-40fd-b90c-1160862d8355,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5a0bb68482346e68fdb180432e510b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:31:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:31:52Z,use_quota=True,user_id='c565d0459d61428f8e3171809fd98282',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:31:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-028acefc-63b4-4a4d-ac9c-4552b60cd13d tempest-VolumesGetTest-1239150761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c78146f6-ae7c-4dce-82fe-560cc1b74d54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:31:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-028acefc-63b4-4a4d-ac9c-4552b60cd13d tempest-VolumesGetTest-1239150761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c78146f6-ae7c-4dce-82fe-560cc1b74d54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:31:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-028acefc-63b4-4a4d-ac9c-4552b60cd13d tempest-VolumesGetTest-1239150761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18347d64-902c-4b95-b422-0063331a1028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:31:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-028acefc-63b4-4a4d-ac9c-4552b60cd13d tempest-VolumesGetTest-1239150761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18347d64-902c-4b95-b422-0063331a1028) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79fe2edb-6c39-40fd-b90c-1160862d8355', 'volume_name': 'volume-79fe2edb-6c39-40fd-b90c-1160862d8355', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:31:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-028acefc-63b4-4a4d-ac9c-4552b60cd13d tempest-VolumesGetTest-1239150761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96d4faea-6bbf-47d5-bb12-64ff98950b8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:31:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-028acefc-63b4-4a4d-ac9c-4552b60cd13d tempest-VolumesGetTest-1239150761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96d4faea-6bbf-47d5-bb12-64ff98950b8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:31:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-028acefc-63b4-4a4d-ac9c-4552b60cd13d tempest-VolumesGetTest-1239150761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4b7e362-59f9-4f61-aa3d-d447f722f0ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:31:51 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-028acefc-63b4-4a4d-ac9c-4552b60cd13d tempest-VolumesGetTest-1239150761 None] Volume 79fe2edb-6c39-40fd-b90c-1160862d8355: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79fe2edb-6c39-40fd-b90c-1160862d8355', 'volume_size': 1} Sep 15 16:31:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-028acefc-63b4-4a4d-ac9c-4552b60cd13d tempest-VolumesGetTest-1239150761 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:31:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-028acefc-63b4-4a4d-ac9c-4552b60cd13d tempest-VolumesGetTest-1239150761 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:31:51 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-028acefc-63b4-4a4d-ac9c-4552b60cd13d tempest-VolumesGetTest-1239150761 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:31:51Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-949752838',display_name='tempest-VolumesGetTest-Volume-1214663019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79fe2edb-6c39-40fd-b90c-1160862d8355,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5a0bb68482346e68fdb180432e510b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:31:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:31:52Z,use_quota=True,user_id='c565d0459d61428f8e3171809fd98282',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:31:51 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-028acefc-63b4-4a4d-ac9c-4552b60cd13d tempest-VolumesGetTest-1239150761 None] Creating volume 79fe2edb-6c39-40fd-b90c-1160862d8355 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:31:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-028acefc-63b4-4a4d-ac9c-4552b60cd13d tempest-VolumesGetTest-1239150761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:31:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-028acefc-63b4-4a4d-ac9c-4552b60cd13d tempest-VolumesGetTest-1239150761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:31:51 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-028acefc-63b4-4a4d-ac9c-4552b60cd13d tempest-VolumesGetTest-1239150761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:31:51 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-028acefc-63b4-4a4d-ac9c-4552b60cd13d tempest-VolumesGetTest-1239150761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:31:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-028acefc-63b4-4a4d-ac9c-4552b60cd13d tempest-VolumesGetTest-1239150761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:31:51 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-028acefc-63b4-4a4d-ac9c-4552b60cd13d tempest-VolumesGetTest-1239150761 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:31:51 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-028acefc-63b4-4a4d-ac9c-4552b60cd13d tempest-VolumesGetTest-1239150761 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:31:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-028acefc-63b4-4a4d-ac9c-4552b60cd13d tempest-VolumesGetTest-1239150761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-79fe2edb-6c39-40fd-b90c-1160862d8355 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:31:51 devstack sudo[102351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-79fe2edb-6c39-40fd-b90c-1160862d8355 1073741824 Sep 15 16:31:51 devstack sudo[102351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:31:52 devstack sudo[102351]: pam_unix(sudo:session): session closed for user root Sep 15 16:31:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-028acefc-63b4-4a4d-ac9c-4552b60cd13d tempest-VolumesGetTest-1239150761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-79fe2edb-6c39-40fd-b90c-1160862d8355 1073741824" returned: 0 in 0.412s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:31:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-028acefc-63b4-4a4d-ac9c-4552b60cd13d tempest-VolumesGetTest-1239150761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-79fe2edb-6c39-40fd-b90c-1160862d8355 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:31:52 devstack sudo[102357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-79fe2edb-6c39-40fd-b90c-1160862d8355 Sep 15 16:31:52 devstack sudo[102357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:31:52 devstack sudo[102357]: pam_unix(sudo:session): session closed for user root Sep 15 16:31:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-028acefc-63b4-4a4d-ac9c-4552b60cd13d tempest-VolumesGetTest-1239150761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-79fe2edb-6c39-40fd-b90c-1160862d8355" returned: 0 in 0.238s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:31:52 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-028acefc-63b4-4a4d-ac9c-4552b60cd13d tempest-VolumesGetTest-1239150761 None] <== create_volume: return (691ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:31:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-028acefc-63b4-4a4d-ac9c-4552b60cd13d tempest-VolumesGetTest-1239150761 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.694s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:31:52 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-028acefc-63b4-4a4d-ac9c-4552b60cd13d tempest-VolumesGetTest-1239150761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4b7e362-59f9-4f61-aa3d-d447f722f0ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79fe2edb-6c39-40fd-b90c-1160862d8355', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:31:52 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-028acefc-63b4-4a4d-ac9c-4552b60cd13d tempest-VolumesGetTest-1239150761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3c0b2d6-84fd-453c-8b2b-d26424ce4c50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:31:52 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-028acefc-63b4-4a4d-ac9c-4552b60cd13d tempest-VolumesGetTest-1239150761 None] Volume volume-79fe2edb-6c39-40fd-b90c-1160862d8355 (79fe2edb-6c39-40fd-b90c-1160862d8355): created successfully Sep 15 16:31:52 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-028acefc-63b4-4a4d-ac9c-4552b60cd13d tempest-VolumesGetTest-1239150761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3c0b2d6-84fd-453c-8b2b-d26424ce4c50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:31:52 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-028acefc-63b4-4a4d-ac9c-4552b60cd13d tempest-VolumesGetTest-1239150761 None] Flow 'volume_create_manager' (62ab64fd-7f1f-4ac0-8072-fba580f2a87d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:31:52 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-028acefc-63b4-4a4d-ac9c-4552b60cd13d tempest-VolumesGetTest-1239150761 None] Created volume successfully. Sep 15 16:31:52 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-273829f9-c2dd-48aa-b9ef-deefa7ac1be2 tempest-VolumesGetTest-1239150761 None] Acquiring lock "cinder-79fe2edb-6c39-40fd-b90c-1160862d8355-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:31:52 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-273829f9-c2dd-48aa-b9ef-deefa7ac1be2 tempest-VolumesGetTest-1239150761 None] Lock "cinder-79fe2edb-6c39-40fd-b90c-1160862d8355-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:31:52 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-273829f9-c2dd-48aa-b9ef-deefa7ac1be2 tempest-VolumesGetTest-1239150761 None] Acquiring lock "cinder-quobyte-79fe2edb-6c39-40fd-b90c-1160862d8355" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:31:52 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-273829f9-c2dd-48aa-b9ef-deefa7ac1be2 tempest-VolumesGetTest-1239150761 None] Lock "cinder-quobyte-79fe2edb-6c39-40fd-b90c-1160862d8355" acquired by "delete_volume" :: waited 0.015s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:31:52 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fc1ff84-498b-4a75-92b7-106cb962f81a]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:31:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-273829f9-c2dd-48aa-b9ef-deefa7ac1be2 tempest-VolumesGetTest-1239150761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-79fe2edb-6c39-40fd-b90c-1160862d8355 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:31:53 devstack sudo[102360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-79fe2edb-6c39-40fd-b90c-1160862d8355 Sep 15 16:31:53 devstack sudo[102360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:31:53 devstack sudo[102360]: pam_unix(sudo:session): session closed for user root Sep 15 16:31:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-273829f9-c2dd-48aa-b9ef-deefa7ac1be2 tempest-VolumesGetTest-1239150761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-79fe2edb-6c39-40fd-b90c-1160862d8355" returned: 0 in 0.354s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:31:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-273829f9-c2dd-48aa-b9ef-deefa7ac1be2 tempest-VolumesGetTest-1239150761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-79fe2edb-6c39-40fd-b90c-1160862d8355 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:31:53 devstack sudo[102365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-79fe2edb-6c39-40fd-b90c-1160862d8355 Sep 15 16:31:53 devstack sudo[102365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:31:53 devstack sudo[102365]: pam_unix(sudo:session): session closed for user root Sep 15 16:31:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-273829f9-c2dd-48aa-b9ef-deefa7ac1be2 tempest-VolumesGetTest-1239150761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-79fe2edb-6c39-40fd-b90c-1160862d8355" returned: 0 in 0.242s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:31:53 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-273829f9-c2dd-48aa-b9ef-deefa7ac1be2 tempest-VolumesGetTest-1239150761 None] Lock "cinder-quobyte-79fe2edb-6c39-40fd-b90c-1160862d8355" released by "delete_volume" :: held 0.637s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:31:53 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-273829f9-c2dd-48aa-b9ef-deefa7ac1be2 tempest-VolumesGetTest-1239150761 None] Created reservations ['da7ad2ab-f9f4-4ee9-9b37-fcf0f8d42ef1', '0a4d96a0-7159-4add-9308-b9e2c4796901', '4e6ee4d6-0451-45bd-9067-331559d91f7a', '94b7c362-93cb-4908-9deb-6c669bccca01'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:31:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-273829f9-c2dd-48aa-b9ef-deefa7ac1be2 tempest-VolumesGetTest-1239150761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:31:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-273829f9-c2dd-48aa-b9ef-deefa7ac1be2 tempest-VolumesGetTest-1239150761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:31:53 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-273829f9-c2dd-48aa-b9ef-deefa7ac1be2 tempest-VolumesGetTest-1239150761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:31:53 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-273829f9-c2dd-48aa-b9ef-deefa7ac1be2 tempest-VolumesGetTest-1239150761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:31:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-273829f9-c2dd-48aa-b9ef-deefa7ac1be2 tempest-VolumesGetTest-1239150761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:31:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-273829f9-c2dd-48aa-b9ef-deefa7ac1be2 tempest-VolumesGetTest-1239150761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:31:53 devstack sudo[102368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:31:53 devstack sudo[102368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:31:53 devstack sudo[102368]: pam_unix(sudo:session): session closed for user root Sep 15 16:31:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-273829f9-c2dd-48aa-b9ef-deefa7ac1be2 tempest-VolumesGetTest-1239150761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.238s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:31:53 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-273829f9-c2dd-48aa-b9ef-deefa7ac1be2 tempest-VolumesGetTest-1239150761 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:31:53 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-273829f9-c2dd-48aa-b9ef-deefa7ac1be2 tempest-VolumesGetTest-1239150761 None] Deleted volume successfully. Sep 15 16:31:53 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-273829f9-c2dd-48aa-b9ef-deefa7ac1be2 tempest-VolumesGetTest-1239150761 None] Lock "cinder-79fe2edb-6c39-40fd-b90c-1160862d8355-delete_volume" released by "delete_volume" :: held 1.066s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:31:54 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-cd902f48-9bb5-4c40-9287-55aa15e3e0e1 tempest-VolumesGetTest-1239150761 None] Acquiring lock "cinder-baf5f362-1949-4c1a-8a56-12c975f307f4-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:31:54 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-cd902f48-9bb5-4c40-9287-55aa15e3e0e1 tempest-VolumesGetTest-1239150761 None] Lock "cinder-baf5f362-1949-4c1a-8a56-12c975f307f4-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:31:54 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-cd902f48-9bb5-4c40-9287-55aa15e3e0e1 tempest-VolumesGetTest-1239150761 None] Acquiring lock "cinder-quobyte-baf5f362-1949-4c1a-8a56-12c975f307f4" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:31:54 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-cd902f48-9bb5-4c40-9287-55aa15e3e0e1 tempest-VolumesGetTest-1239150761 None] Lock "cinder-quobyte-baf5f362-1949-4c1a-8a56-12c975f307f4" acquired by "delete_volume" :: waited 0.015s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:31:54 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[8333d447-b676-417f-8cb5-51c05235763e]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:31:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-cd902f48-9bb5-4c40-9287-55aa15e3e0e1 tempest-VolumesGetTest-1239150761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-baf5f362-1949-4c1a-8a56-12c975f307f4 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:31:54 devstack sudo[102371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-baf5f362-1949-4c1a-8a56-12c975f307f4 Sep 15 16:31:54 devstack sudo[102371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:31:54 devstack sudo[102371]: pam_unix(sudo:session): session closed for user root Sep 15 16:31:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-cd902f48-9bb5-4c40-9287-55aa15e3e0e1 tempest-VolumesGetTest-1239150761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-baf5f362-1949-4c1a-8a56-12c975f307f4" returned: 0 in 0.354s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:31:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-cd902f48-9bb5-4c40-9287-55aa15e3e0e1 tempest-VolumesGetTest-1239150761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-baf5f362-1949-4c1a-8a56-12c975f307f4 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:31:54 devstack sudo[102376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-baf5f362-1949-4c1a-8a56-12c975f307f4 Sep 15 16:31:54 devstack sudo[102376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:31:54 devstack sudo[102376]: pam_unix(sudo:session): session closed for user root Sep 15 16:31:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-cd902f48-9bb5-4c40-9287-55aa15e3e0e1 tempest-VolumesGetTest-1239150761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-baf5f362-1949-4c1a-8a56-12c975f307f4" returned: 0 in 0.242s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:31:54 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-cd902f48-9bb5-4c40-9287-55aa15e3e0e1 tempest-VolumesGetTest-1239150761 None] Lock "cinder-quobyte-baf5f362-1949-4c1a-8a56-12c975f307f4" released by "delete_volume" :: held 0.635s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:31:54 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-cd902f48-9bb5-4c40-9287-55aa15e3e0e1 tempest-VolumesGetTest-1239150761 None] Created reservations ['fd55db33-1fcf-4ff3-a118-0956aca75e79', '3a5c9ff6-5dc6-4715-975b-b79c0f26d2f5', '8e36b440-5082-439d-b796-f54bbd831eba', '7a052ed9-d524-40b4-b082-232e5e95c0a7'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:31:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-cd902f48-9bb5-4c40-9287-55aa15e3e0e1 tempest-VolumesGetTest-1239150761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:31:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-cd902f48-9bb5-4c40-9287-55aa15e3e0e1 tempest-VolumesGetTest-1239150761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:31:54 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-cd902f48-9bb5-4c40-9287-55aa15e3e0e1 tempest-VolumesGetTest-1239150761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:31:54 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-cd902f48-9bb5-4c40-9287-55aa15e3e0e1 tempest-VolumesGetTest-1239150761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:31:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-cd902f48-9bb5-4c40-9287-55aa15e3e0e1 tempest-VolumesGetTest-1239150761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:31:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-cd902f48-9bb5-4c40-9287-55aa15e3e0e1 tempest-VolumesGetTest-1239150761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:31:54 devstack sudo[102379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:31:54 devstack sudo[102379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:31:55 devstack sudo[102379]: pam_unix(sudo:session): session closed for user root Sep 15 16:31:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-cd902f48-9bb5-4c40-9287-55aa15e3e0e1 tempest-VolumesGetTest-1239150761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.232s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:31:55 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-cd902f48-9bb5-4c40-9287-55aa15e3e0e1 tempest-VolumesGetTest-1239150761 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:31:55 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-cd902f48-9bb5-4c40-9287-55aa15e3e0e1 tempest-VolumesGetTest-1239150761 None] Deleted volume successfully. Sep 15 16:31:55 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-cd902f48-9bb5-4c40-9287-55aa15e3e0e1 tempest-VolumesGetTest-1239150761 None] Lock "cinder-baf5f362-1949-4c1a-8a56-12c975f307f4-delete_volume" released by "delete_volume" :: held 1.042s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:31:55 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-46f87932-e37f-4f10-9232-b4b1a199b6bf tempest-VolumesGetTest-1239150761 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:31:55 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-46f87932-e37f-4f10-9232-b4b1a199b6bf tempest-VolumesGetTest-1239150761 None] Flow 'volume_create_manager' (e0959851-08ec-44b0-8f2f-f83091fd658e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:31:55 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-46f87932-e37f-4f10-9232-b4b1a199b6bf tempest-VolumesGetTest-1239150761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5030a512-1c34-4610-818a-b6a3f72c2d88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:31:55 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-46f87932-e37f-4f10-9232-b4b1a199b6bf tempest-VolumesGetTest-1239150761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5030a512-1c34-4610-818a-b6a3f72c2d88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:31:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1086438954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b781428d-bc84-4d90-b4ed-fc69a4e6c358,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5a0bb68482346e68fdb180432e510b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:31:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:31:56Z,use_quota=True,user_id='c565d0459d61428f8e3171809fd98282',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:31:55 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-46f87932-e37f-4f10-9232-b4b1a199b6bf tempest-VolumesGetTest-1239150761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11146133-03d9-4aeb-8d47-1162899ee5ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:31:55 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-46f87932-e37f-4f10-9232-b4b1a199b6bf tempest-VolumesGetTest-1239150761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11146133-03d9-4aeb-8d47-1162899ee5ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:31:55 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-46f87932-e37f-4f10-9232-b4b1a199b6bf tempest-VolumesGetTest-1239150761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d9828da-9df9-4a63-97f3-2e01f1c478a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:31:55 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-46f87932-e37f-4f10-9232-b4b1a199b6bf tempest-VolumesGetTest-1239150761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d9828da-9df9-4a63-97f3-2e01f1c478a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b781428d-bc84-4d90-b4ed-fc69a4e6c358', 'volume_name': 'volume-b781428d-bc84-4d90-b4ed-fc69a4e6c358', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:31:55 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-46f87932-e37f-4f10-9232-b4b1a199b6bf tempest-VolumesGetTest-1239150761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77fad9d3-3175-40a3-8f5c-5db6920287c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:31:55 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-46f87932-e37f-4f10-9232-b4b1a199b6bf tempest-VolumesGetTest-1239150761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77fad9d3-3175-40a3-8f5c-5db6920287c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:31:55 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-46f87932-e37f-4f10-9232-b4b1a199b6bf tempest-VolumesGetTest-1239150761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7bf6767-b5ff-456a-8271-584168c78f20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:31:55 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-46f87932-e37f-4f10-9232-b4b1a199b6bf tempest-VolumesGetTest-1239150761 None] Volume b781428d-bc84-4d90-b4ed-fc69a4e6c358: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b781428d-bc84-4d90-b4ed-fc69a4e6c358', 'volume_size': 1} Sep 15 16:31:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-46f87932-e37f-4f10-9232-b4b1a199b6bf tempest-VolumesGetTest-1239150761 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:31:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-46f87932-e37f-4f10-9232-b4b1a199b6bf tempest-VolumesGetTest-1239150761 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:31:55 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-46f87932-e37f-4f10-9232-b4b1a199b6bf tempest-VolumesGetTest-1239150761 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:31:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1086438954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b781428d-bc84-4d90-b4ed-fc69a4e6c358,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5a0bb68482346e68fdb180432e510b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:31:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:31:56Z,use_quota=True,user_id='c565d0459d61428f8e3171809fd98282',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:31:55 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-46f87932-e37f-4f10-9232-b4b1a199b6bf tempest-VolumesGetTest-1239150761 None] Creating volume b781428d-bc84-4d90-b4ed-fc69a4e6c358 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:31:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-46f87932-e37f-4f10-9232-b4b1a199b6bf tempest-VolumesGetTest-1239150761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:31:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-46f87932-e37f-4f10-9232-b4b1a199b6bf tempest-VolumesGetTest-1239150761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:31:55 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-46f87932-e37f-4f10-9232-b4b1a199b6bf tempest-VolumesGetTest-1239150761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:31:55 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-46f87932-e37f-4f10-9232-b4b1a199b6bf tempest-VolumesGetTest-1239150761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:31:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-46f87932-e37f-4f10-9232-b4b1a199b6bf tempest-VolumesGetTest-1239150761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:31:55 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-46f87932-e37f-4f10-9232-b4b1a199b6bf tempest-VolumesGetTest-1239150761 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:31:55 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-46f87932-e37f-4f10-9232-b4b1a199b6bf tempest-VolumesGetTest-1239150761 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:31:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-46f87932-e37f-4f10-9232-b4b1a199b6bf tempest-VolumesGetTest-1239150761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b781428d-bc84-4d90-b4ed-fc69a4e6c358 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:31:55 devstack sudo[102382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b781428d-bc84-4d90-b4ed-fc69a4e6c358 1073741824 Sep 15 16:31:55 devstack sudo[102382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:31:56 devstack sudo[102382]: pam_unix(sudo:session): session closed for user root Sep 15 16:31:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-46f87932-e37f-4f10-9232-b4b1a199b6bf tempest-VolumesGetTest-1239150761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b781428d-bc84-4d90-b4ed-fc69a4e6c358 1073741824" returned: 0 in 0.407s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:31:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-46f87932-e37f-4f10-9232-b4b1a199b6bf tempest-VolumesGetTest-1239150761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b781428d-bc84-4d90-b4ed-fc69a4e6c358 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:31:56 devstack sudo[102387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b781428d-bc84-4d90-b4ed-fc69a4e6c358 Sep 15 16:31:56 devstack sudo[102387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:31:56 devstack sudo[102387]: pam_unix(sudo:session): session closed for user root Sep 15 16:31:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-46f87932-e37f-4f10-9232-b4b1a199b6bf tempest-VolumesGetTest-1239150761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b781428d-bc84-4d90-b4ed-fc69a4e6c358" returned: 0 in 0.239s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:31:56 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-46f87932-e37f-4f10-9232-b4b1a199b6bf tempest-VolumesGetTest-1239150761 None] <== create_volume: return (685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:31:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-46f87932-e37f-4f10-9232-b4b1a199b6bf tempest-VolumesGetTest-1239150761 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.687s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:31:56 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-46f87932-e37f-4f10-9232-b4b1a199b6bf tempest-VolumesGetTest-1239150761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7bf6767-b5ff-456a-8271-584168c78f20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b781428d-bc84-4d90-b4ed-fc69a4e6c358', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:31:56 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-46f87932-e37f-4f10-9232-b4b1a199b6bf tempest-VolumesGetTest-1239150761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8402807-eb55-4124-8551-c34f8289e03f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:31:56 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-46f87932-e37f-4f10-9232-b4b1a199b6bf tempest-VolumesGetTest-1239150761 None] Volume volume-b781428d-bc84-4d90-b4ed-fc69a4e6c358 (b781428d-bc84-4d90-b4ed-fc69a4e6c358): created successfully Sep 15 16:31:56 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-46f87932-e37f-4f10-9232-b4b1a199b6bf tempest-VolumesGetTest-1239150761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8402807-eb55-4124-8551-c34f8289e03f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:31:56 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-46f87932-e37f-4f10-9232-b4b1a199b6bf tempest-VolumesGetTest-1239150761 None] Flow 'volume_create_manager' (e0959851-08ec-44b0-8f2f-f83091fd658e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:31:56 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-46f87932-e37f-4f10-9232-b4b1a199b6bf tempest-VolumesGetTest-1239150761 None] Created volume successfully. Sep 15 16:31:57 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ebc9717-6453-474a-863b-13c2b1a54d0c tempest-VolumesGetTest-1239150761 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:31:57 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2ebc9717-6453-474a-863b-13c2b1a54d0c tempest-VolumesGetTest-1239150761 None] Flow 'volume_create_manager' (790609ae-9409-4f33-96eb-dda9e73cd448) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:31:57 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2ebc9717-6453-474a-863b-13c2b1a54d0c tempest-VolumesGetTest-1239150761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de9bb52f-d255-4044-8d80-0af8c7794ca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:31:57 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2ebc9717-6453-474a-863b-13c2b1a54d0c tempest-VolumesGetTest-1239150761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de9bb52f-d255-4044-8d80-0af8c7794ca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:31:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1087071776',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07cc1c76-dfff-4161-9ba3-ccf09f0bc80a,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f5a0bb68482346e68fdb180432e510b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:31:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=b781428d-bc84-4d90-b4ed-fc69a4e6c358,status='creating',terminated_at=None,updated_at=2026-09-15T14:31:57Z,use_quota=True,user_id='c565d0459d61428f8e3171809fd98282',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:31:57 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2ebc9717-6453-474a-863b-13c2b1a54d0c tempest-VolumesGetTest-1239150761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51acb366-38c3-4dd6-8499-d3b5e057ec51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:31:57 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2ebc9717-6453-474a-863b-13c2b1a54d0c tempest-VolumesGetTest-1239150761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51acb366-38c3-4dd6-8499-d3b5e057ec51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:31:57 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2ebc9717-6453-474a-863b-13c2b1a54d0c tempest-VolumesGetTest-1239150761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e17bf0a-6804-4fcc-ac81-84c4a44c440f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:31:57 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2ebc9717-6453-474a-863b-13c2b1a54d0c tempest-VolumesGetTest-1239150761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e17bf0a-6804-4fcc-ac81-84c4a44c440f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '07cc1c76-dfff-4161-9ba3-ccf09f0bc80a', 'volume_name': 'volume-07cc1c76-dfff-4161-9ba3-ccf09f0bc80a', 'volume_size': 1, 'source_volid': 'b781428d-bc84-4d90-b4ed-fc69a4e6c358', 'source_volstatus': 'available'}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:31:57 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2ebc9717-6453-474a-863b-13c2b1a54d0c tempest-VolumesGetTest-1239150761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97483c3e-6a95-4c3d-8e57-452b8ed5bdcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:31:57 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2ebc9717-6453-474a-863b-13c2b1a54d0c tempest-VolumesGetTest-1239150761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97483c3e-6a95-4c3d-8e57-452b8ed5bdcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:31:57 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2ebc9717-6453-474a-863b-13c2b1a54d0c tempest-VolumesGetTest-1239150761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0442a500-0989-4bac-82af-4733e51e3ee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:31:57 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-2ebc9717-6453-474a-863b-13c2b1a54d0c tempest-VolumesGetTest-1239150761 None] Volume 07cc1c76-dfff-4161-9ba3-ccf09f0bc80a: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-07cc1c76-dfff-4161-9ba3-ccf09f0bc80a', 'volume_size': 1, 'source_volid': 'b781428d-bc84-4d90-b4ed-fc69a4e6c358', 'source_volstatus': 'available'} Sep 15 16:31:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-2ebc9717-6453-474a-863b-13c2b1a54d0c tempest-VolumesGetTest-1239150761 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:31:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-2ebc9717-6453-474a-863b-13c2b1a54d0c tempest-VolumesGetTest-1239150761 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:31:57 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-2ebc9717-6453-474a-863b-13c2b1a54d0c tempest-VolumesGetTest-1239150761 None] Cloning volume b781428d-bc84-4d90-b4ed-fc69a4e6c358 to volume 07cc1c76-dfff-4161-9ba3-ccf09f0bc80a Sep 15 16:31:57 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-2ebc9717-6453-474a-863b-13c2b1a54d0c tempest-VolumesGetTest-1239150761 None] Creating offline snapshot f1dfe508-df43-4628-8827-9ca21a292515 of volume b781428d-bc84-4d90-b4ed-fc69a4e6c358 {{(pid=86082) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 15 16:31:57 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[18bb3cde-bb38-4036-b4bc-11971ea33e83]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:31:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2ebc9717-6453-474a-863b-13c2b1a54d0c tempest-VolumesGetTest-1239150761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b781428d-bc84-4d90-b4ed-fc69a4e6c358 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:31:57 devstack sudo[102391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b781428d-bc84-4d90-b4ed-fc69a4e6c358 Sep 15 16:31:57 devstack sudo[102391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:31:57 devstack sudo[102391]: pam_unix(sudo:session): session closed for user root Sep 15 16:31:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2ebc9717-6453-474a-863b-13c2b1a54d0c tempest-VolumesGetTest-1239150761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b781428d-bc84-4d90-b4ed-fc69a4e6c358" returned: 0 in 0.357s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:31:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2ebc9717-6453-474a-863b-13c2b1a54d0c tempest-VolumesGetTest-1239150761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b781428d-bc84-4d90-b4ed-fc69a4e6c358,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b781428d-bc84-4d90-b4ed-fc69a4e6c358.f1dfe508-df43-4628-8827-9ca21a292515 1G {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:31:57 devstack sudo[102396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b781428d-bc84-4d90-b4ed-fc69a4e6c358,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b781428d-bc84-4d90-b4ed-fc69a4e6c358.f1dfe508-df43-4628-8827-9ca21a292515 1G Sep 15 16:31:57 devstack sudo[102396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:31:58 devstack sudo[102396]: pam_unix(sudo:session): session closed for user root Sep 15 16:31:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2ebc9717-6453-474a-863b-13c2b1a54d0c tempest-VolumesGetTest-1239150761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b781428d-bc84-4d90-b4ed-fc69a4e6c358,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b781428d-bc84-4d90-b4ed-fc69a4e6c358.f1dfe508-df43-4628-8827-9ca21a292515 1G" returned: 0 in 0.395s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:31:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2ebc9717-6453-474a-863b-13c2b1a54d0c tempest-VolumesGetTest-1239150761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b781428d-bc84-4d90-b4ed-fc69a4e6c358 -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b781428d-bc84-4d90-b4ed-fc69a4e6c358.f1dfe508-df43-4628-8827-9ca21a292515 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:31:58 devstack sudo[102401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b781428d-bc84-4d90-b4ed-fc69a4e6c358 -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b781428d-bc84-4d90-b4ed-fc69a4e6c358.f1dfe508-df43-4628-8827-9ca21a292515 Sep 15 16:31:58 devstack sudo[102401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:31:58 devstack sudo[102401]: pam_unix(sudo:session): session closed for user root Sep 15 16:31:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2ebc9717-6453-474a-863b-13c2b1a54d0c tempest-VolumesGetTest-1239150761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b781428d-bc84-4d90-b4ed-fc69a4e6c358 -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b781428d-bc84-4d90-b4ed-fc69a4e6c358.f1dfe508-df43-4628-8827-9ca21a292515" returned: 0 in 0.283s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:31:58 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-2ebc9717-6453-474a-863b-13c2b1a54d0c tempest-VolumesGetTest-1239150761 None] /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b781428d-bc84-4d90-b4ed-fc69a4e6c358.f1dfe508-df43-4628-8827-9ca21a292515 is being set with open permissions: ugo+rw Sep 15 16:31:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2ebc9717-6453-474a-863b-13c2b1a54d0c tempest-VolumesGetTest-1239150761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b781428d-bc84-4d90-b4ed-fc69a4e6c358.f1dfe508-df43-4628-8827-9ca21a292515 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:31:58 devstack sudo[102406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b781428d-bc84-4d90-b4ed-fc69a4e6c358.f1dfe508-df43-4628-8827-9ca21a292515 Sep 15 16:31:58 devstack sudo[102406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:31:58 devstack sudo[102406]: pam_unix(sudo:session): session closed for user root Sep 15 16:31:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2ebc9717-6453-474a-863b-13c2b1a54d0c tempest-VolumesGetTest-1239150761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b781428d-bc84-4d90-b4ed-fc69a4e6c358.f1dfe508-df43-4628-8827-9ca21a292515" returned: 0 in 0.235s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:31:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2ebc9717-6453-474a-863b-13c2b1a54d0c tempest-VolumesGetTest-1239150761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b781428d-bc84-4d90-b4ed-fc69a4e6c358.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:31:58 devstack sudo[102409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b781428d-bc84-4d90-b4ed-fc69a4e6c358.info Sep 15 16:31:58 devstack sudo[102409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:31:58 devstack sudo[102409]: pam_unix(sudo:session): session closed for user root Sep 15 16:31:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2ebc9717-6453-474a-863b-13c2b1a54d0c tempest-VolumesGetTest-1239150761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b781428d-bc84-4d90-b4ed-fc69a4e6c358.info" returned: 0 in 0.241s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:31:58 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-2ebc9717-6453-474a-863b-13c2b1a54d0c tempest-VolumesGetTest-1239150761 None] /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b781428d-bc84-4d90-b4ed-fc69a4e6c358.info is being set with open permissions: ugo+rw Sep 15 16:31:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2ebc9717-6453-474a-863b-13c2b1a54d0c tempest-VolumesGetTest-1239150761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b781428d-bc84-4d90-b4ed-fc69a4e6c358.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:31:58 devstack sudo[102412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b781428d-bc84-4d90-b4ed-fc69a4e6c358.info Sep 15 16:31:58 devstack sudo[102412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:31:59 devstack sudo[102412]: pam_unix(sudo:session): session closed for user root Sep 15 16:31:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2ebc9717-6453-474a-863b-13c2b1a54d0c tempest-VolumesGetTest-1239150761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b781428d-bc84-4d90-b4ed-fc69a4e6c358.info" returned: 0 in 0.246s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:31:59 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-2ebc9717-6453-474a-863b-13c2b1a54d0c tempest-VolumesGetTest-1239150761 None] Acquiring lock "cinder-quobyte-07cc1c76-dfff-4161-9ba3-ccf09f0bc80a" by "_copy_volume_from_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:31:59 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-2ebc9717-6453-474a-863b-13c2b1a54d0c tempest-VolumesGetTest-1239150761 None] Lock "cinder-quobyte-07cc1c76-dfff-4161-9ba3-ccf09f0bc80a" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:31:59 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-2ebc9717-6453-474a-863b-13c2b1a54d0c tempest-VolumesGetTest-1239150761 None] snapshot: f1dfe508-df43-4628-8827-9ca21a292515, volume: 07cc1c76-dfff-4161-9ba3-ccf09f0bc80a, {{(pid=86082) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 15 16:31:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-2ebc9717-6453-474a-863b-13c2b1a54d0c tempest-VolumesGetTest-1239150761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:31:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-2ebc9717-6453-474a-863b-13c2b1a54d0c tempest-VolumesGetTest-1239150761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:31:59 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-2ebc9717-6453-474a-863b-13c2b1a54d0c tempest-VolumesGetTest-1239150761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:31:59 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-2ebc9717-6453-474a-863b-13c2b1a54d0c tempest-VolumesGetTest-1239150761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:31:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-2ebc9717-6453-474a-863b-13c2b1a54d0c tempest-VolumesGetTest-1239150761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:31:59 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[114efd05-9ba9-4ec0-a5e4-9a12895c8bad]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:31:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2ebc9717-6453-474a-863b-13c2b1a54d0c tempest-VolumesGetTest-1239150761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b781428d-bc84-4d90-b4ed-fc69a4e6c358.f1dfe508-df43-4628-8827-9ca21a292515 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:31:59 devstack sudo[102415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b781428d-bc84-4d90-b4ed-fc69a4e6c358.f1dfe508-df43-4628-8827-9ca21a292515 Sep 15 16:31:59 devstack sudo[102415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:31:59 devstack sudo[102415]: pam_unix(sudo:session): session closed for user root Sep 15 16:31:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2ebc9717-6453-474a-863b-13c2b1a54d0c tempest-VolumesGetTest-1239150761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b781428d-bc84-4d90-b4ed-fc69a4e6c358.f1dfe508-df43-4628-8827-9ca21a292515" returned: 0 in 0.359s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:31:59 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-2ebc9717-6453-474a-863b-13c2b1a54d0c tempest-VolumesGetTest-1239150761 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b781428d-bc84-4d90-b4ed-fc69a4e6c358(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 16:31:59 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[262c3ce4-6233-441b-a5f1-acdaf1cfdb18]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:31:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2ebc9717-6453-474a-863b-13c2b1a54d0c tempest-VolumesGetTest-1239150761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b781428d-bc84-4d90-b4ed-fc69a4e6c358 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:31:59 devstack sudo[102420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b781428d-bc84-4d90-b4ed-fc69a4e6c358 Sep 15 16:31:59 devstack sudo[102420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:31:59 devstack cinder-volume[86082]: DEBUG oslo_service.periodic_task [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86082) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 15 16:31:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:31:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:31:59 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:31:59 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:31:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:31:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:31:59 devstack sudo[102426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:31:59 devstack sudo[102426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:31:59 devstack sudo[102420]: pam_unix(sudo:session): session closed for user root Sep 15 16:31:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2ebc9717-6453-474a-863b-13c2b1a54d0c tempest-VolumesGetTest-1239150761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b781428d-bc84-4d90-b4ed-fc69a4e6c358" returned: 0 in 0.363s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:31:59 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-2ebc9717-6453-474a-863b-13c2b1a54d0c tempest-VolumesGetTest-1239150761 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b781428d-bc84-4d90-b4ed-fc69a4e6c358 {{(pid=86082) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 15 16:31:59 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-2ebc9717-6453-474a-863b-13c2b1a54d0c tempest-VolumesGetTest-1239150761 None] Creating direct copy from snapshot {{(pid=86082) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 15 16:31:59 devstack cinder-volume[86082]: DEBUG cinder.utils [None req-2ebc9717-6453-474a-863b-13c2b1a54d0c tempest-VolumesGetTest-1239150761 None] Path /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-07cc1c76-dfff-4161-9ba3-ccf09f0bc80a not found in is_blk_device check {{(pid=86082) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 15 16:31:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2ebc9717-6453-474a-863b-13c2b1a54d0c tempest-VolumesGetTest-1239150761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b781428d-bc84-4d90-b4ed-fc69a4e6c358 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-07cc1c76-dfff-4161-9ba3-ccf09f0bc80a {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:31:59 devstack sudo[102428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b781428d-bc84-4d90-b4ed-fc69a4e6c358 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-07cc1c76-dfff-4161-9ba3-ccf09f0bc80a Sep 15 16:31:59 devstack sudo[102428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:32:00 devstack sudo[102426]: pam_unix(sudo:session): session closed for user root Sep 15 16:32:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.250s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:32:00 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:32:00 devstack cinder-volume[86082]: DEBUG oslo_service.periodic_task [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Running periodic task VolumeManager._thread_info {{(pid=86082) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 15 16:32:00 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] thread count: 28 {{(pid=86082) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 15 16:32:00 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] thread info: [<_MainThread(MainThread, started 124875935469696)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86082) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 15 16:32:05 devstack sudo[102428]: pam_unix(sudo:session): session closed for user root Sep 15 16:32:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2ebc9717-6453-474a-863b-13c2b1a54d0c tempest-VolumesGetTest-1239150761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b781428d-bc84-4d90-b4ed-fc69a4e6c358 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-07cc1c76-dfff-4161-9ba3-ccf09f0bc80a" returned: 0 in 5.996s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:32:05 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-2ebc9717-6453-474a-863b-13c2b1a54d0c tempest-VolumesGetTest-1239150761 None] Image conversion details: src /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b781428d-bc84-4d90-b4ed-fc69a4e6c358, size 1024.00 MB, duration 6.00 sec, destination /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-07cc1c76-dfff-4161-9ba3-ccf09f0bc80a {{(pid=86082) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 15 16:32:05 devstack cinder-volume[86082]: INFO cinder.image.image_utils [None req-2ebc9717-6453-474a-863b-13c2b1a54d0c tempest-VolumesGetTest-1239150761 None] Converted 1024.00 MB image at 170.76 MB/s Sep 15 16:32:05 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-2ebc9717-6453-474a-863b-13c2b1a54d0c tempest-VolumesGetTest-1239150761 None] /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-07cc1c76-dfff-4161-9ba3-ccf09f0bc80a is being set with open permissions: ugo+rw Sep 15 16:32:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2ebc9717-6453-474a-863b-13c2b1a54d0c tempest-VolumesGetTest-1239150761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-07cc1c76-dfff-4161-9ba3-ccf09f0bc80a {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:32:05 devstack sudo[102443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-07cc1c76-dfff-4161-9ba3-ccf09f0bc80a Sep 15 16:32:05 devstack sudo[102443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:32:06 devstack sudo[102443]: pam_unix(sudo:session): session closed for user root Sep 15 16:32:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2ebc9717-6453-474a-863b-13c2b1a54d0c tempest-VolumesGetTest-1239150761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-07cc1c76-dfff-4161-9ba3-ccf09f0bc80a" returned: 0 in 0.240s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:32:06 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-2ebc9717-6453-474a-863b-13c2b1a54d0c tempest-VolumesGetTest-1239150761 None] Lock "cinder-quobyte-07cc1c76-dfff-4161-9ba3-ccf09f0bc80a" released by "_copy_volume_from_snapshot" :: held 7.031s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:32:06 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-2ebc9717-6453-474a-863b-13c2b1a54d0c tempest-VolumesGetTest-1239150761 None] Acquiring lock "cinder-quobyte-f1dfe508-df43-4628-8827-9ca21a292515" by "_delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:32:06 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-2ebc9717-6453-474a-863b-13c2b1a54d0c tempest-VolumesGetTest-1239150761 None] Lock "cinder-quobyte-f1dfe508-df43-4628-8827-9ca21a292515" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:32:06 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-2ebc9717-6453-474a-863b-13c2b1a54d0c tempest-VolumesGetTest-1239150761 None] Deleting offline snapshot f1dfe508-df43-4628-8827-9ca21a292515 of volume b781428d-bc84-4d90-b4ed-fc69a4e6c358 {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 15 16:32:06 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-2ebc9717-6453-474a-863b-13c2b1a54d0c tempest-VolumesGetTest-1239150761 None] snapshot_file for this snap is: volume-b781428d-bc84-4d90-b4ed-fc69a4e6c358.f1dfe508-df43-4628-8827-9ca21a292515 {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 15 16:32:06 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[c61f5c17-ff34-4e99-9b9f-f7d7300e5cab]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:32:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2ebc9717-6453-474a-863b-13c2b1a54d0c tempest-VolumesGetTest-1239150761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b781428d-bc84-4d90-b4ed-fc69a4e6c358.f1dfe508-df43-4628-8827-9ca21a292515 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:32:06 devstack sudo[102446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b781428d-bc84-4d90-b4ed-fc69a4e6c358.f1dfe508-df43-4628-8827-9ca21a292515 Sep 15 16:32:06 devstack sudo[102446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:32:06 devstack sudo[102446]: pam_unix(sudo:session): session closed for user root Sep 15 16:32:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2ebc9717-6453-474a-863b-13c2b1a54d0c tempest-VolumesGetTest-1239150761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b781428d-bc84-4d90-b4ed-fc69a4e6c358.f1dfe508-df43-4628-8827-9ca21a292515" returned: 0 in 0.350s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:32:06 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-2ebc9717-6453-474a-863b-13c2b1a54d0c tempest-VolumesGetTest-1239150761 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b781428d-bc84-4d90-b4ed-fc69a4e6c358(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 16:32:06 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[a32f05e7-1f43-4ed8-b59a-57a402fd75da]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:32:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2ebc9717-6453-474a-863b-13c2b1a54d0c tempest-VolumesGetTest-1239150761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b781428d-bc84-4d90-b4ed-fc69a4e6c358 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:32:06 devstack sudo[102451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b781428d-bc84-4d90-b4ed-fc69a4e6c358 Sep 15 16:32:06 devstack sudo[102451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:32:07 devstack sudo[102451]: pam_unix(sudo:session): session closed for user root Sep 15 16:32:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2ebc9717-6453-474a-863b-13c2b1a54d0c tempest-VolumesGetTest-1239150761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b781428d-bc84-4d90-b4ed-fc69a4e6c358" returned: 0 in 0.525s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:32:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2ebc9717-6453-474a-863b-13c2b1a54d0c tempest-VolumesGetTest-1239150761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b781428d-bc84-4d90-b4ed-fc69a4e6c358.f1dfe508-df43-4628-8827-9ca21a292515 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:32:07 devstack sudo[102457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b781428d-bc84-4d90-b4ed-fc69a4e6c358.f1dfe508-df43-4628-8827-9ca21a292515 Sep 15 16:32:07 devstack sudo[102457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:32:07 devstack sudo[102457]: pam_unix(sudo:session): session closed for user root Sep 15 16:32:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2ebc9717-6453-474a-863b-13c2b1a54d0c tempest-VolumesGetTest-1239150761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b781428d-bc84-4d90-b4ed-fc69a4e6c358.f1dfe508-df43-4628-8827-9ca21a292515" returned: 0 in 0.320s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:32:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2ebc9717-6453-474a-863b-13c2b1a54d0c tempest-VolumesGetTest-1239150761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b781428d-bc84-4d90-b4ed-fc69a4e6c358.f1dfe508-df43-4628-8827-9ca21a292515 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:32:07 devstack sudo[102462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b781428d-bc84-4d90-b4ed-fc69a4e6c358.f1dfe508-df43-4628-8827-9ca21a292515 Sep 15 16:32:07 devstack sudo[102462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:32:07 devstack sudo[102462]: pam_unix(sudo:session): session closed for user root Sep 15 16:32:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2ebc9717-6453-474a-863b-13c2b1a54d0c tempest-VolumesGetTest-1239150761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b781428d-bc84-4d90-b4ed-fc69a4e6c358.f1dfe508-df43-4628-8827-9ca21a292515" returned: 0 in 0.245s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:32:07 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-2ebc9717-6453-474a-863b-13c2b1a54d0c tempest-VolumesGetTest-1239150761 None] Lock "cinder-quobyte-f1dfe508-df43-4628-8827-9ca21a292515" released by "_delete_snapshot" :: held 1.531s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:32:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-2ebc9717-6453-474a-863b-13c2b1a54d0c tempest-VolumesGetTest-1239150761 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.494s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:32:07 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2ebc9717-6453-474a-863b-13c2b1a54d0c tempest-VolumesGetTest-1239150761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0442a500-0989-4bac-82af-4733e51e3ee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07cc1c76-dfff-4161-9ba3-ccf09f0bc80a', 'volume_size': 1, 'source_volid': 'b781428d-bc84-4d90-b4ed-fc69a4e6c358', 'source_volstatus': 'available'}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:32:07 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2ebc9717-6453-474a-863b-13c2b1a54d0c tempest-VolumesGetTest-1239150761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e546a69b-cddb-436c-964d-77068178274d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:32:07 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-2ebc9717-6453-474a-863b-13c2b1a54d0c tempest-VolumesGetTest-1239150761 None] Volume volume-07cc1c76-dfff-4161-9ba3-ccf09f0bc80a (07cc1c76-dfff-4161-9ba3-ccf09f0bc80a): created successfully Sep 15 16:32:07 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2ebc9717-6453-474a-863b-13c2b1a54d0c tempest-VolumesGetTest-1239150761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e546a69b-cddb-436c-964d-77068178274d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:32:07 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2ebc9717-6453-474a-863b-13c2b1a54d0c tempest-VolumesGetTest-1239150761 None] Flow 'volume_create_manager' (790609ae-9409-4f33-96eb-dda9e73cd448) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:32:07 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-2ebc9717-6453-474a-863b-13c2b1a54d0c tempest-VolumesGetTest-1239150761 None] Created volume successfully. Sep 15 16:32:08 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-13d3c052-9ecd-4c53-8f49-583e5e3e8203 tempest-VolumesGetTest-1239150761 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:32:08 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-13d3c052-9ecd-4c53-8f49-583e5e3e8203 tempest-VolumesGetTest-1239150761 None] Flow 'volume_create_manager' (b61ee1bd-acdf-42ea-892c-343e3eeb1fdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:32:08 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-13d3c052-9ecd-4c53-8f49-583e5e3e8203 tempest-VolumesGetTest-1239150761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d03cd7f-f757-421e-bf02-87674d201830) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:32:08 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-13d3c052-9ecd-4c53-8f49-583e5e3e8203 tempest-VolumesGetTest-1239150761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d03cd7f-f757-421e-bf02-87674d201830) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:32:08Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-456011040',display_name='tempest-VolumesGetTest-Volume-272033512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cceaa99-e297-40a5-8169-981f4a48d148,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5a0bb68482346e68fdb180432e510b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:32:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:32:08Z,use_quota=True,user_id='c565d0459d61428f8e3171809fd98282',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:32:08 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-13d3c052-9ecd-4c53-8f49-583e5e3e8203 tempest-VolumesGetTest-1239150761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16006574-149a-4598-8213-208b1c058c92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:32:08 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-13d3c052-9ecd-4c53-8f49-583e5e3e8203 tempest-VolumesGetTest-1239150761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16006574-149a-4598-8213-208b1c058c92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:32:08 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-13d3c052-9ecd-4c53-8f49-583e5e3e8203 tempest-VolumesGetTest-1239150761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (208ed4bf-f666-4cb7-86cc-f9d777da6f70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:32:08 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-13d3c052-9ecd-4c53-8f49-583e5e3e8203 tempest-VolumesGetTest-1239150761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (208ed4bf-f666-4cb7-86cc-f9d777da6f70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8cceaa99-e297-40a5-8169-981f4a48d148', 'volume_name': 'volume-8cceaa99-e297-40a5-8169-981f4a48d148', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:32:08 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-13d3c052-9ecd-4c53-8f49-583e5e3e8203 tempest-VolumesGetTest-1239150761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ca2e88b-a2cb-4736-affc-30ac06e2b3fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:32:08 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-13d3c052-9ecd-4c53-8f49-583e5e3e8203 tempest-VolumesGetTest-1239150761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ca2e88b-a2cb-4736-affc-30ac06e2b3fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:32:08 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-13d3c052-9ecd-4c53-8f49-583e5e3e8203 tempest-VolumesGetTest-1239150761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96bffa19-8ea2-4302-b934-8d78feee197b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:32:08 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-13d3c052-9ecd-4c53-8f49-583e5e3e8203 tempest-VolumesGetTest-1239150761 None] Volume 8cceaa99-e297-40a5-8169-981f4a48d148: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8cceaa99-e297-40a5-8169-981f4a48d148', 'volume_size': 1} Sep 15 16:32:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-13d3c052-9ecd-4c53-8f49-583e5e3e8203 tempest-VolumesGetTest-1239150761 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:32:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-13d3c052-9ecd-4c53-8f49-583e5e3e8203 tempest-VolumesGetTest-1239150761 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:32:08 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-13d3c052-9ecd-4c53-8f49-583e5e3e8203 tempest-VolumesGetTest-1239150761 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:32:08Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-456011040',display_name='tempest-VolumesGetTest-Volume-272033512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8cceaa99-e297-40a5-8169-981f4a48d148,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5a0bb68482346e68fdb180432e510b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:32:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:32:08Z,use_quota=True,user_id='c565d0459d61428f8e3171809fd98282',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:32:08 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-13d3c052-9ecd-4c53-8f49-583e5e3e8203 tempest-VolumesGetTest-1239150761 None] Creating volume 8cceaa99-e297-40a5-8169-981f4a48d148 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:32:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-13d3c052-9ecd-4c53-8f49-583e5e3e8203 tempest-VolumesGetTest-1239150761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:32:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-13d3c052-9ecd-4c53-8f49-583e5e3e8203 tempest-VolumesGetTest-1239150761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:32:08 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-13d3c052-9ecd-4c53-8f49-583e5e3e8203 tempest-VolumesGetTest-1239150761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:32:08 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-13d3c052-9ecd-4c53-8f49-583e5e3e8203 tempest-VolumesGetTest-1239150761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:32:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-13d3c052-9ecd-4c53-8f49-583e5e3e8203 tempest-VolumesGetTest-1239150761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:32:08 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-13d3c052-9ecd-4c53-8f49-583e5e3e8203 tempest-VolumesGetTest-1239150761 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:32:08 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-13d3c052-9ecd-4c53-8f49-583e5e3e8203 tempest-VolumesGetTest-1239150761 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:32:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-13d3c052-9ecd-4c53-8f49-583e5e3e8203 tempest-VolumesGetTest-1239150761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-8cceaa99-e297-40a5-8169-981f4a48d148 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:32:08 devstack sudo[102465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-8cceaa99-e297-40a5-8169-981f4a48d148 1073741824 Sep 15 16:32:08 devstack sudo[102465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:32:08 devstack sudo[102465]: pam_unix(sudo:session): session closed for user root Sep 15 16:32:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-13d3c052-9ecd-4c53-8f49-583e5e3e8203 tempest-VolumesGetTest-1239150761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-8cceaa99-e297-40a5-8169-981f4a48d148 1073741824" returned: 0 in 0.407s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:32:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-13d3c052-9ecd-4c53-8f49-583e5e3e8203 tempest-VolumesGetTest-1239150761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-8cceaa99-e297-40a5-8169-981f4a48d148 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:32:09 devstack sudo[102470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-8cceaa99-e297-40a5-8169-981f4a48d148 Sep 15 16:32:09 devstack sudo[102470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:32:09 devstack sudo[102470]: pam_unix(sudo:session): session closed for user root Sep 15 16:32:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-13d3c052-9ecd-4c53-8f49-583e5e3e8203 tempest-VolumesGetTest-1239150761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-8cceaa99-e297-40a5-8169-981f4a48d148" returned: 0 in 0.239s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:32:09 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-13d3c052-9ecd-4c53-8f49-583e5e3e8203 tempest-VolumesGetTest-1239150761 None] <== create_volume: return (687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:32:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-13d3c052-9ecd-4c53-8f49-583e5e3e8203 tempest-VolumesGetTest-1239150761 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.689s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:32:09 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-13d3c052-9ecd-4c53-8f49-583e5e3e8203 tempest-VolumesGetTest-1239150761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96bffa19-8ea2-4302-b934-8d78feee197b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8cceaa99-e297-40a5-8169-981f4a48d148', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:32:09 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-13d3c052-9ecd-4c53-8f49-583e5e3e8203 tempest-VolumesGetTest-1239150761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6c62d5a-c511-4c2f-a0ee-b2faccf43792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:32:09 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-13d3c052-9ecd-4c53-8f49-583e5e3e8203 tempest-VolumesGetTest-1239150761 None] Volume volume-8cceaa99-e297-40a5-8169-981f4a48d148 (8cceaa99-e297-40a5-8169-981f4a48d148): created successfully Sep 15 16:32:09 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-13d3c052-9ecd-4c53-8f49-583e5e3e8203 tempest-VolumesGetTest-1239150761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b6c62d5a-c511-4c2f-a0ee-b2faccf43792) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:32:09 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-13d3c052-9ecd-4c53-8f49-583e5e3e8203 tempest-VolumesGetTest-1239150761 None] Flow 'volume_create_manager' (b61ee1bd-acdf-42ea-892c-343e3eeb1fdb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:32:09 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-13d3c052-9ecd-4c53-8f49-583e5e3e8203 tempest-VolumesGetTest-1239150761 None] Created volume successfully. Sep 15 16:32:09 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-bafa3381-80b1-4158-9649-0e1da3f0ca96 tempest-VolumesGetTest-1239150761 None] Acquiring lock "cinder-8cceaa99-e297-40a5-8169-981f4a48d148-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:32:09 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-bafa3381-80b1-4158-9649-0e1da3f0ca96 tempest-VolumesGetTest-1239150761 None] Lock "cinder-8cceaa99-e297-40a5-8169-981f4a48d148-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:32:09 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-bafa3381-80b1-4158-9649-0e1da3f0ca96 tempest-VolumesGetTest-1239150761 None] Acquiring lock "cinder-quobyte-8cceaa99-e297-40a5-8169-981f4a48d148" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:32:09 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-bafa3381-80b1-4158-9649-0e1da3f0ca96 tempest-VolumesGetTest-1239150761 None] Lock "cinder-quobyte-8cceaa99-e297-40a5-8169-981f4a48d148" acquired by "delete_volume" :: waited 0.014s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:32:09 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc6fb1a8-eabd-418e-9f1c-0c6073b09594]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:32:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-bafa3381-80b1-4158-9649-0e1da3f0ca96 tempest-VolumesGetTest-1239150761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-8cceaa99-e297-40a5-8169-981f4a48d148 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:32:09 devstack sudo[102473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-8cceaa99-e297-40a5-8169-981f4a48d148 Sep 15 16:32:09 devstack sudo[102473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:32:10 devstack sudo[102473]: pam_unix(sudo:session): session closed for user root Sep 15 16:32:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-bafa3381-80b1-4158-9649-0e1da3f0ca96 tempest-VolumesGetTest-1239150761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-8cceaa99-e297-40a5-8169-981f4a48d148" returned: 0 in 0.346s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:32:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-bafa3381-80b1-4158-9649-0e1da3f0ca96 tempest-VolumesGetTest-1239150761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-8cceaa99-e297-40a5-8169-981f4a48d148 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:32:10 devstack sudo[102478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-8cceaa99-e297-40a5-8169-981f4a48d148 Sep 15 16:32:10 devstack sudo[102478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:32:10 devstack sudo[102478]: pam_unix(sudo:session): session closed for user root Sep 15 16:32:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-bafa3381-80b1-4158-9649-0e1da3f0ca96 tempest-VolumesGetTest-1239150761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-8cceaa99-e297-40a5-8169-981f4a48d148" returned: 0 in 0.241s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:32:10 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-bafa3381-80b1-4158-9649-0e1da3f0ca96 tempest-VolumesGetTest-1239150761 None] Lock "cinder-quobyte-8cceaa99-e297-40a5-8169-981f4a48d148" released by "delete_volume" :: held 0.629s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:32:10 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-bafa3381-80b1-4158-9649-0e1da3f0ca96 tempest-VolumesGetTest-1239150761 None] Created reservations ['cf08ffed-2ef5-4530-98b0-29980085ee9e', '9c28a4cf-c737-47a0-b852-e1e72b6b191c', '4a0556ed-49d8-4b76-894f-35d12105daa4', '36ce645f-b424-4094-8af0-31ae624ce696'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:32:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-bafa3381-80b1-4158-9649-0e1da3f0ca96 tempest-VolumesGetTest-1239150761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:32:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-bafa3381-80b1-4158-9649-0e1da3f0ca96 tempest-VolumesGetTest-1239150761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:32:10 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-bafa3381-80b1-4158-9649-0e1da3f0ca96 tempest-VolumesGetTest-1239150761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:32:10 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-bafa3381-80b1-4158-9649-0e1da3f0ca96 tempest-VolumesGetTest-1239150761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:32:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-bafa3381-80b1-4158-9649-0e1da3f0ca96 tempest-VolumesGetTest-1239150761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:32:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-bafa3381-80b1-4158-9649-0e1da3f0ca96 tempest-VolumesGetTest-1239150761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:32:10 devstack sudo[102481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:32:10 devstack sudo[102481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:32:10 devstack sudo[102481]: pam_unix(sudo:session): session closed for user root Sep 15 16:32:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-bafa3381-80b1-4158-9649-0e1da3f0ca96 tempest-VolumesGetTest-1239150761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.237s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:32:10 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-bafa3381-80b1-4158-9649-0e1da3f0ca96 tempest-VolumesGetTest-1239150761 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:32:10 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-bafa3381-80b1-4158-9649-0e1da3f0ca96 tempest-VolumesGetTest-1239150761 None] Deleted volume successfully. Sep 15 16:32:10 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-bafa3381-80b1-4158-9649-0e1da3f0ca96 tempest-VolumesGetTest-1239150761 None] Lock "cinder-8cceaa99-e297-40a5-8169-981f4a48d148-delete_volume" released by "delete_volume" :: held 1.042s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:32:10 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-0d819b60-38a8-470b-b5ae-183ca5135fbe tempest-VolumesGetTest-1239150761 None] Acquiring lock "cinder-07cc1c76-dfff-4161-9ba3-ccf09f0bc80a-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:32:10 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-0d819b60-38a8-470b-b5ae-183ca5135fbe tempest-VolumesGetTest-1239150761 None] Lock "cinder-07cc1c76-dfff-4161-9ba3-ccf09f0bc80a-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:32:10 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-0d819b60-38a8-470b-b5ae-183ca5135fbe tempest-VolumesGetTest-1239150761 None] Acquiring lock "cinder-quobyte-07cc1c76-dfff-4161-9ba3-ccf09f0bc80a" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:32:10 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-0d819b60-38a8-470b-b5ae-183ca5135fbe tempest-VolumesGetTest-1239150761 None] Lock "cinder-quobyte-07cc1c76-dfff-4161-9ba3-ccf09f0bc80a" acquired by "delete_volume" :: waited 0.014s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:32:10 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e655acb-303b-4083-a987-763231584f56]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:32:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0d819b60-38a8-470b-b5ae-183ca5135fbe tempest-VolumesGetTest-1239150761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-07cc1c76-dfff-4161-9ba3-ccf09f0bc80a {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:32:11 devstack sudo[102484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-07cc1c76-dfff-4161-9ba3-ccf09f0bc80a Sep 15 16:32:11 devstack sudo[102484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:32:11 devstack sudo[102484]: pam_unix(sudo:session): session closed for user root Sep 15 16:32:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0d819b60-38a8-470b-b5ae-183ca5135fbe tempest-VolumesGetTest-1239150761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-07cc1c76-dfff-4161-9ba3-ccf09f0bc80a" returned: 0 in 0.355s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:32:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0d819b60-38a8-470b-b5ae-183ca5135fbe tempest-VolumesGetTest-1239150761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-07cc1c76-dfff-4161-9ba3-ccf09f0bc80a {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:32:11 devstack sudo[102489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-07cc1c76-dfff-4161-9ba3-ccf09f0bc80a Sep 15 16:32:11 devstack sudo[102489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:32:11 devstack sudo[102489]: pam_unix(sudo:session): session closed for user root Sep 15 16:32:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0d819b60-38a8-470b-b5ae-183ca5135fbe tempest-VolumesGetTest-1239150761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-07cc1c76-dfff-4161-9ba3-ccf09f0bc80a" returned: 0 in 0.243s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:32:11 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-0d819b60-38a8-470b-b5ae-183ca5135fbe tempest-VolumesGetTest-1239150761 None] Lock "cinder-quobyte-07cc1c76-dfff-4161-9ba3-ccf09f0bc80a" released by "delete_volume" :: held 0.638s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:32:11 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-0d819b60-38a8-470b-b5ae-183ca5135fbe tempest-VolumesGetTest-1239150761 None] Created reservations ['8d7838c6-9b6f-44fe-8b7b-1e0405c5dace', '8292710b-6652-4961-87eb-ae0e9b49939b', '79006038-1e1b-49b7-993a-b7d91bcedcf4', 'bdf2d7c3-9e75-4e63-8091-944599006928'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:32:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-0d819b60-38a8-470b-b5ae-183ca5135fbe tempest-VolumesGetTest-1239150761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:32:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-0d819b60-38a8-470b-b5ae-183ca5135fbe tempest-VolumesGetTest-1239150761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:32:11 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-0d819b60-38a8-470b-b5ae-183ca5135fbe tempest-VolumesGetTest-1239150761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:32:11 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-0d819b60-38a8-470b-b5ae-183ca5135fbe tempest-VolumesGetTest-1239150761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:32:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-0d819b60-38a8-470b-b5ae-183ca5135fbe tempest-VolumesGetTest-1239150761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:32:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0d819b60-38a8-470b-b5ae-183ca5135fbe tempest-VolumesGetTest-1239150761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:32:11 devstack sudo[102492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:32:11 devstack sudo[102492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:32:11 devstack sudo[102492]: pam_unix(sudo:session): session closed for user root Sep 15 16:32:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0d819b60-38a8-470b-b5ae-183ca5135fbe tempest-VolumesGetTest-1239150761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.239s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:32:11 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-0d819b60-38a8-470b-b5ae-183ca5135fbe tempest-VolumesGetTest-1239150761 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:32:11 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-0d819b60-38a8-470b-b5ae-183ca5135fbe tempest-VolumesGetTest-1239150761 None] Deleted volume successfully. Sep 15 16:32:11 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-0d819b60-38a8-470b-b5ae-183ca5135fbe tempest-VolumesGetTest-1239150761 None] Lock "cinder-07cc1c76-dfff-4161-9ba3-ccf09f0bc80a-delete_volume" released by "delete_volume" :: held 1.068s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:32:12 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-d4c5a69d-20ba-4041-9738-865980b42b05 tempest-VolumesGetTest-1239150761 None] Acquiring lock "cinder-b781428d-bc84-4d90-b4ed-fc69a4e6c358-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:32:12 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-d4c5a69d-20ba-4041-9738-865980b42b05 tempest-VolumesGetTest-1239150761 None] Lock "cinder-b781428d-bc84-4d90-b4ed-fc69a4e6c358-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:32:12 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-d4c5a69d-20ba-4041-9738-865980b42b05 tempest-VolumesGetTest-1239150761 None] Acquiring lock "cinder-quobyte-b781428d-bc84-4d90-b4ed-fc69a4e6c358" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:32:12 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-d4c5a69d-20ba-4041-9738-865980b42b05 tempest-VolumesGetTest-1239150761 None] Lock "cinder-quobyte-b781428d-bc84-4d90-b4ed-fc69a4e6c358" acquired by "delete_volume" :: waited 0.013s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:32:12 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[17cf75af-7095-400d-9a15-f0c8aee91b68]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:32:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d4c5a69d-20ba-4041-9738-865980b42b05 tempest-VolumesGetTest-1239150761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b781428d-bc84-4d90-b4ed-fc69a4e6c358 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:32:12 devstack sudo[102495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b781428d-bc84-4d90-b4ed-fc69a4e6c358 Sep 15 16:32:12 devstack sudo[102495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:32:12 devstack sudo[102495]: pam_unix(sudo:session): session closed for user root Sep 15 16:32:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d4c5a69d-20ba-4041-9738-865980b42b05 tempest-VolumesGetTest-1239150761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b781428d-bc84-4d90-b4ed-fc69a4e6c358" returned: 0 in 0.353s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:32:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d4c5a69d-20ba-4041-9738-865980b42b05 tempest-VolumesGetTest-1239150761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b781428d-bc84-4d90-b4ed-fc69a4e6c358 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:32:12 devstack sudo[102500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b781428d-bc84-4d90-b4ed-fc69a4e6c358 Sep 15 16:32:12 devstack sudo[102500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:32:12 devstack sudo[102500]: pam_unix(sudo:session): session closed for user root Sep 15 16:32:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d4c5a69d-20ba-4041-9738-865980b42b05 tempest-VolumesGetTest-1239150761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b781428d-bc84-4d90-b4ed-fc69a4e6c358" returned: 0 in 0.237s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:32:12 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-d4c5a69d-20ba-4041-9738-865980b42b05 tempest-VolumesGetTest-1239150761 None] Lock "cinder-quobyte-b781428d-bc84-4d90-b4ed-fc69a4e6c358" released by "delete_volume" :: held 0.650s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:32:12 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-d4c5a69d-20ba-4041-9738-865980b42b05 tempest-VolumesGetTest-1239150761 None] Created reservations ['bcc27aff-1baf-4659-a265-a48f7a2c7779', '10c50eb0-2ea0-40da-9990-0b4dc2b80deb', '58face22-4514-4cbe-85e1-2daebb951e69', '73bf2419-5271-43dc-9be7-07b2ebcc006b'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:32:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-d4c5a69d-20ba-4041-9738-865980b42b05 tempest-VolumesGetTest-1239150761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:32:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-d4c5a69d-20ba-4041-9738-865980b42b05 tempest-VolumesGetTest-1239150761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:32:12 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-d4c5a69d-20ba-4041-9738-865980b42b05 tempest-VolumesGetTest-1239150761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:32:12 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-d4c5a69d-20ba-4041-9738-865980b42b05 tempest-VolumesGetTest-1239150761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:32:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-d4c5a69d-20ba-4041-9738-865980b42b05 tempest-VolumesGetTest-1239150761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:32:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d4c5a69d-20ba-4041-9738-865980b42b05 tempest-VolumesGetTest-1239150761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:32:12 devstack sudo[102503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:32:12 devstack sudo[102503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:32:13 devstack sudo[102503]: pam_unix(sudo:session): session closed for user root Sep 15 16:32:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d4c5a69d-20ba-4041-9738-865980b42b05 tempest-VolumesGetTest-1239150761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.243s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:32:13 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-d4c5a69d-20ba-4041-9738-865980b42b05 tempest-VolumesGetTest-1239150761 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:32:13 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-d4c5a69d-20ba-4041-9738-865980b42b05 tempest-VolumesGetTest-1239150761 None] Deleted volume successfully. Sep 15 16:32:13 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-d4c5a69d-20ba-4041-9738-865980b42b05 tempest-VolumesGetTest-1239150761 None] Lock "cinder-b781428d-bc84-4d90-b4ed-fc69a4e6c358-delete_volume" released by "delete_volume" :: held 1.073s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:32:13 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ffee690-96e2-43bb-9cb5-672cdcb7d990 tempest-VolumesGetTest-1239150761 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:32:13 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-3ffee690-96e2-43bb-9cb5-672cdcb7d990 tempest-VolumesGetTest-1239150761 None] Flow 'volume_create_manager' (4df0d59b-accf-462e-bc44-d1c3d7feca14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:32:13 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-3ffee690-96e2-43bb-9cb5-672cdcb7d990 tempest-VolumesGetTest-1239150761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a6a6484-5d79-416f-9438-a90b80c5832e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:32:13 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-3ffee690-96e2-43bb-9cb5-672cdcb7d990 tempest-VolumesGetTest-1239150761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a6a6484-5d79-416f-9438-a90b80c5832e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:32:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1306488179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79b36d19-c0f3-4a71-b564-43c3256b0d78,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f5a0bb68482346e68fdb180432e510b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:32:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:32:14Z,use_quota=True,user_id='c565d0459d61428f8e3171809fd98282',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:32:13 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-3ffee690-96e2-43bb-9cb5-672cdcb7d990 tempest-VolumesGetTest-1239150761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e8759d8-847b-4c38-9d8c-e2de29216a74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:32:13 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-3ffee690-96e2-43bb-9cb5-672cdcb7d990 tempest-VolumesGetTest-1239150761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e8759d8-847b-4c38-9d8c-e2de29216a74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:32:13 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-3ffee690-96e2-43bb-9cb5-672cdcb7d990 tempest-VolumesGetTest-1239150761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fa05b31-4b1a-424c-84b2-e01d580ebf6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:32:13 devstack cinder-volume[86082]: DEBUG cinder.image.glance [None req-3ffee690-96e2-43bb-9cb5-672cdcb7d990 tempest-VolumesGetTest-1239150761 None] Creating Keystone auth plugin from conf {{(pid=86082) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 15 16:32:14 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-3ffee690-96e2-43bb-9cb5-672cdcb7d990 tempest-VolumesGetTest-1239150761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fa05b31-4b1a-424c-84b2-e01d580ebf6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '79b36d19-c0f3-4a71-b564-43c3256b0d78', 'volume_name': 'volume-79b36d19-c0f3-4a71-b564-43c3256b0d78', 'volume_size': 1, 'image_id': '0ea392d9-2af0-468e-bdc1-5e3f34bc52e6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0ea392d9-2af0-468e-bdc1-5e3f34bc52e6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e57b859e1a41428083b6d86ce51f5184', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0ea392d9-2af0-468e-bdc1-5e3f34bc52e6', 'created_at': datetime.datetime(2026, 9, 15, 14, 11, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 15, 14, 11, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0ea392d9-2af0-468e-bdc1-5e3f34bc52e6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:32:14 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-3ffee690-96e2-43bb-9cb5-672cdcb7d990 tempest-VolumesGetTest-1239150761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (298d0f17-bdc8-496b-a927-87a012f39fec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:32:14 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-3ffee690-96e2-43bb-9cb5-672cdcb7d990 tempest-VolumesGetTest-1239150761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (298d0f17-bdc8-496b-a927-87a012f39fec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:32:14 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-3ffee690-96e2-43bb-9cb5-672cdcb7d990 tempest-VolumesGetTest-1239150761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2aa370f0-b236-4854-a6e8-313a6c9ed166) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:32:14 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-3ffee690-96e2-43bb-9cb5-672cdcb7d990 tempest-VolumesGetTest-1239150761 None] Volume 79b36d19-c0f3-4a71-b564-43c3256b0d78: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-79b36d19-c0f3-4a71-b564-43c3256b0d78', 'volume_size': 1, 'image_id': '0ea392d9-2af0-468e-bdc1-5e3f34bc52e6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0ea392d9-2af0-468e-bdc1-5e3f34bc52e6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e57b859e1a41428083b6d86ce51f5184', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0ea392d9-2af0-468e-bdc1-5e3f34bc52e6', 'created_at': datetime.datetime(2026, 9, 15, 14, 11, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 15, 14, 11, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0ea392d9-2af0-468e-bdc1-5e3f34bc52e6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 15 16:32:14 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ffee690-96e2-43bb-9cb5-672cdcb7d990 tempest-VolumesGetTest-1239150761 None] Trying to clone 79b36d19-c0f3-4a71-b564-43c3256b0d78 from image 0ea392d9-2af0-468e-bdc1-5e3f34bc52e6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/0ea392d9-2af0-468e-bdc1-5e3f34bc52e6', 'metadata': {}}]). {{(pid=86082) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 15 16:32:14 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-3ffee690-96e2-43bb-9cb5-672cdcb7d990 tempest-VolumesGetTest-1239150761 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0ea392d9-2af0-468e-bdc1-5e3f34bc52e6_vx_1bfvudevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86082) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 15 16:32:14 devstack cinder-volume[86082]: INFO cinder.image.image_utils [None req-3ffee690-96e2-43bb-9cb5-672cdcb7d990 tempest-VolumesGetTest-1239150761 None] Image download 20.69 MB at 20.69 MB/s Sep 15 16:32:14 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[a31eaf40-2acd-472b-8fc8-9f6715a8c59c]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:32:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3ffee690-96e2-43bb-9cb5-672cdcb7d990 tempest-VolumesGetTest-1239150761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ea392d9-2af0-468e-bdc1-5e3f34bc52e6_vx_1bfvudevstack@QuobyteHD {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:32:14 devstack sudo[102507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ea392d9-2af0-468e-bdc1-5e3f34bc52e6_vx_1bfvudevstack@QuobyteHD Sep 15 16:32:14 devstack sudo[102507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:32:14 devstack sudo[102507]: pam_unix(sudo:session): session closed for user root Sep 15 16:32:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3ffee690-96e2-43bb-9cb5-672cdcb7d990 tempest-VolumesGetTest-1239150761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ea392d9-2af0-468e-bdc1-5e3f34bc52e6_vx_1bfvudevstack@QuobyteHD" returned: 0 in 0.316s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:32:14 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-3ffee690-96e2-43bb-9cb5-672cdcb7d990 tempest-VolumesGetTest-1239150761 None] Temporary image 0ea392d9-2af0-468e-bdc1-5e3f34bc52e6 is fetched for user c565d0459d61428f8e3171809fd98282. {{(pid=86082) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 15 16:32:14 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[494974f9-63f6-4413-81c5-e6f438740b5e]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:32:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3ffee690-96e2-43bb-9cb5-672cdcb7d990 tempest-VolumesGetTest-1239150761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ea392d9-2af0-468e-bdc1-5e3f34bc52e6_vx_1bfvudevstack@QuobyteHD {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:32:15 devstack sudo[102512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ea392d9-2af0-468e-bdc1-5e3f34bc52e6_vx_1bfvudevstack@QuobyteHD Sep 15 16:32:15 devstack sudo[102512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:32:15 devstack sudo[102512]: pam_unix(sudo:session): session closed for user root Sep 15 16:32:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3ffee690-96e2-43bb-9cb5-672cdcb7d990 tempest-VolumesGetTest-1239150761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ea392d9-2af0-468e-bdc1-5e3f34bc52e6_vx_1bfvudevstack@QuobyteHD" returned: 0 in 0.308s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:32:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-3ffee690-96e2-43bb-9cb5-672cdcb7d990 tempest-VolumesGetTest-1239150761 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:32:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-3ffee690-96e2-43bb-9cb5-672cdcb7d990 tempest-VolumesGetTest-1239150761 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:32:15 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-3ffee690-96e2-43bb-9cb5-672cdcb7d990 tempest-VolumesGetTest-1239150761 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:32:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1306488179',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79b36d19-c0f3-4a71-b564-43c3256b0d78,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='f5a0bb68482346e68fdb180432e510b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:32:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:32:14Z,use_quota=True,user_id='c565d0459d61428f8e3171809fd98282',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:32:15 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-3ffee690-96e2-43bb-9cb5-672cdcb7d990 tempest-VolumesGetTest-1239150761 None] Creating volume 79b36d19-c0f3-4a71-b564-43c3256b0d78 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:32:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-3ffee690-96e2-43bb-9cb5-672cdcb7d990 tempest-VolumesGetTest-1239150761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:32:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-3ffee690-96e2-43bb-9cb5-672cdcb7d990 tempest-VolumesGetTest-1239150761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:32:15 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-3ffee690-96e2-43bb-9cb5-672cdcb7d990 tempest-VolumesGetTest-1239150761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:32:15 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-3ffee690-96e2-43bb-9cb5-672cdcb7d990 tempest-VolumesGetTest-1239150761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:32:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-3ffee690-96e2-43bb-9cb5-672cdcb7d990 tempest-VolumesGetTest-1239150761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:32:15 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-3ffee690-96e2-43bb-9cb5-672cdcb7d990 tempest-VolumesGetTest-1239150761 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:32:15 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-3ffee690-96e2-43bb-9cb5-672cdcb7d990 tempest-VolumesGetTest-1239150761 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:32:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3ffee690-96e2-43bb-9cb5-672cdcb7d990 tempest-VolumesGetTest-1239150761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-79b36d19-c0f3-4a71-b564-43c3256b0d78 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:32:15 devstack sudo[102517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-79b36d19-c0f3-4a71-b564-43c3256b0d78 1073741824 Sep 15 16:32:15 devstack sudo[102517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:32:15 devstack sudo[102517]: pam_unix(sudo:session): session closed for user root Sep 15 16:32:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3ffee690-96e2-43bb-9cb5-672cdcb7d990 tempest-VolumesGetTest-1239150761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-79b36d19-c0f3-4a71-b564-43c3256b0d78 1073741824" returned: 0 in 0.405s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:32:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3ffee690-96e2-43bb-9cb5-672cdcb7d990 tempest-VolumesGetTest-1239150761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-79b36d19-c0f3-4a71-b564-43c3256b0d78 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:32:15 devstack sudo[102522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-79b36d19-c0f3-4a71-b564-43c3256b0d78 Sep 15 16:32:15 devstack sudo[102522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:32:15 devstack sudo[102522]: pam_unix(sudo:session): session closed for user root Sep 15 16:32:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3ffee690-96e2-43bb-9cb5-672cdcb7d990 tempest-VolumesGetTest-1239150761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-79b36d19-c0f3-4a71-b564-43c3256b0d78" returned: 0 in 0.230s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:32:15 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-3ffee690-96e2-43bb-9cb5-672cdcb7d990 tempest-VolumesGetTest-1239150761 None] <== create_volume: return (672ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:32:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-3ffee690-96e2-43bb-9cb5-672cdcb7d990 tempest-VolumesGetTest-1239150761 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.674s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:32:15 devstack cinder-volume[86082]: DEBUG cinder.volume.volume_utils [None req-3ffee690-96e2-43bb-9cb5-672cdcb7d990 tempest-VolumesGetTest-1239150761 None] Attempting download of 0ea392d9-2af0-468e-bdc1-5e3f34bc52e6 ((None, [{'url': 'file:///opt/stack/data/glance/images/0ea392d9-2af0-468e-bdc1-5e3f34bc52e6', 'metadata': {}}])) to volume 79b36d19-c0f3-4a71-b564-43c3256b0d78. {{(pid=86082) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 15 16:32:15 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[a661b1b9-f640-4528-84e6-2a82593fe0d0]: (4, 'raw') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:32:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3ffee690-96e2-43bb-9cb5-672cdcb7d990 tempest-VolumesGetTest-1239150761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0ea392d9-2af0-468e-bdc1-5e3f34bc52e6_vsm0v23n {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:32:16 devstack sudo[102525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0ea392d9-2af0-468e-bdc1-5e3f34bc52e6_vsm0v23n Sep 15 16:32:16 devstack sudo[102525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:32:16 devstack sudo[102525]: pam_unix(sudo:session): session closed for user root Sep 15 16:32:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3ffee690-96e2-43bb-9cb5-672cdcb7d990 tempest-VolumesGetTest-1239150761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0ea392d9-2af0-468e-bdc1-5e3f34bc52e6_vsm0v23n" returned: 0 in 0.329s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:32:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3ffee690-96e2-43bb-9cb5-672cdcb7d990 tempest-VolumesGetTest-1239150761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0ea392d9-2af0-468e-bdc1-5e3f34bc52e6_vsm0v23n {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:32:16 devstack sudo[102529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0ea392d9-2af0-468e-bdc1-5e3f34bc52e6_vsm0v23n Sep 15 16:32:16 devstack sudo[102529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:32:16 devstack sudo[102529]: pam_unix(sudo:session): session closed for user root Sep 15 16:32:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3ffee690-96e2-43bb-9cb5-672cdcb7d990 tempest-VolumesGetTest-1239150761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0ea392d9-2af0-468e-bdc1-5e3f34bc52e6_vsm0v23n" returned: 1 in 0.312s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:32:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3ffee690-96e2-43bb-9cb5-672cdcb7d990 tempest-VolumesGetTest-1239150761 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0ea392d9-2af0-468e-bdc1-5e3f34bc52e6_vsm0v23n' failed. Not Retrying. {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 15 16:32:16 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea526f10-bd59-495a-a0b8-f4afca582996]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:32:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3ffee690-96e2-43bb-9cb5-672cdcb7d990 tempest-VolumesGetTest-1239150761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ea392d9-2af0-468e-bdc1-5e3f34bc52e6_vx_1bfvudevstack@QuobyteHD {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:32:16 devstack sudo[102533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ea392d9-2af0-468e-bdc1-5e3f34bc52e6_vx_1bfvudevstack@QuobyteHD Sep 15 16:32:16 devstack sudo[102533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:32:16 devstack sudo[102533]: pam_unix(sudo:session): session closed for user root Sep 15 16:32:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3ffee690-96e2-43bb-9cb5-672cdcb7d990 tempest-VolumesGetTest-1239150761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ea392d9-2af0-468e-bdc1-5e3f34bc52e6_vx_1bfvudevstack@QuobyteHD" returned: 0 in 0.318s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:32:16 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-3ffee690-96e2-43bb-9cb5-672cdcb7d990 tempest-VolumesGetTest-1239150761 None] 0ea392d9-2af0-468e-bdc1-5e3f34bc52e6 was qcow2, converting to qcow2 {{(pid=86082) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 15 16:32:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3ffee690-96e2-43bb-9cb5-672cdcb7d990 tempest-VolumesGetTest-1239150761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0ea392d9-2af0-468e-bdc1-5e3f34bc52e6_vx_1bfvudevstack@QuobyteHD /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-79b36d19-c0f3-4a71-b564-43c3256b0d78 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:32:16 devstack sudo[102573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0ea392d9-2af0-468e-bdc1-5e3f34bc52e6_vx_1bfvudevstack@QuobyteHD /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-79b36d19-c0f3-4a71-b564-43c3256b0d78 Sep 15 16:32:16 devstack sudo[102573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:32:18 devstack sudo[102573]: pam_unix(sudo:session): session closed for user root Sep 15 16:32:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3ffee690-96e2-43bb-9cb5-672cdcb7d990 tempest-VolumesGetTest-1239150761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0ea392d9-2af0-468e-bdc1-5e3f34bc52e6_vx_1bfvudevstack@QuobyteHD /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-79b36d19-c0f3-4a71-b564-43c3256b0d78" returned: 0 in 1.698s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:32:18 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-3ffee690-96e2-43bb-9cb5-672cdcb7d990 tempest-VolumesGetTest-1239150761 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0ea392d9-2af0-468e-bdc1-5e3f34bc52e6_vx_1bfvudevstack@QuobyteHD, size 112.00 MB, duration 1.70 sec, destination /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-79b36d19-c0f3-4a71-b564-43c3256b0d78 {{(pid=86082) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 15 16:32:18 devstack cinder-volume[86082]: INFO cinder.image.image_utils [None req-3ffee690-96e2-43bb-9cb5-672cdcb7d990 tempest-VolumesGetTest-1239150761 None] Converted 112.00 MB image at 65.90 MB/s Sep 15 16:32:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3ffee690-96e2-43bb-9cb5-672cdcb7d990 tempest-VolumesGetTest-1239150761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-79b36d19-c0f3-4a71-b564-43c3256b0d78 1G {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:32:18 devstack sudo[102583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-79b36d19-c0f3-4a71-b564-43c3256b0d78 1G Sep 15 16:32:18 devstack sudo[102583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:32:18 devstack sudo[102583]: pam_unix(sudo:session): session closed for user root Sep 15 16:32:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3ffee690-96e2-43bb-9cb5-672cdcb7d990 tempest-VolumesGetTest-1239150761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-79b36d19-c0f3-4a71-b564-43c3256b0d78 1G" returned: 0 in 0.307s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:32:18 devstack cinder-volume[86082]: DEBUG cinder.volume.volume_utils [None req-3ffee690-96e2-43bb-9cb5-672cdcb7d990 tempest-VolumesGetTest-1239150761 None] Downloaded image 0ea392d9-2af0-468e-bdc1-5e3f34bc52e6 ((None, [{'url': 'file:///opt/stack/data/glance/images/0ea392d9-2af0-468e-bdc1-5e3f34bc52e6', 'metadata': {}}])) to volume 79b36d19-c0f3-4a71-b564-43c3256b0d78 successfully. {{(pid=86082) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 15 16:32:18 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-3ffee690-96e2-43bb-9cb5-672cdcb7d990 tempest-VolumesGetTest-1239150761 None] Temporary image 0ea392d9-2af0-468e-bdc1-5e3f34bc52e6 for user c565d0459d61428f8e3171809fd98282 is deleted. {{(pid=86082) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 15 16:32:18 devstack cinder-volume[86082]: DEBUG cinder.volume.volume_utils [None req-3ffee690-96e2-43bb-9cb5-672cdcb7d990 tempest-VolumesGetTest-1239150761 None] Marking volume 79b36d19-c0f3-4a71-b564-43c3256b0d78 as bootable. {{(pid=86082) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 15 16:32:18 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ffee690-96e2-43bb-9cb5-672cdcb7d990 tempest-VolumesGetTest-1239150761 None] Copying metadata from image 0ea392d9-2af0-468e-bdc1-5e3f34bc52e6 to 79b36d19-c0f3-4a71-b564-43c3256b0d78. {{(pid=86082) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 15 16:32:18 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ffee690-96e2-43bb-9cb5-672cdcb7d990 tempest-VolumesGetTest-1239150761 None] Creating volume glance metadata for volume 79b36d19-c0f3-4a71-b564-43c3256b0d78 backed by image 0ea392d9-2af0-468e-bdc1-5e3f34bc52e6 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '0ea392d9-2af0-468e-bdc1-5e3f34bc52e6', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86082) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 15 16:32:19 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-3ffee690-96e2-43bb-9cb5-672cdcb7d990 tempest-VolumesGetTest-1239150761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2aa370f0-b236-4854-a6e8-313a6c9ed166) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79b36d19-c0f3-4a71-b564-43c3256b0d78', 'volume_size': 1, 'image_id': '0ea392d9-2af0-468e-bdc1-5e3f34bc52e6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0ea392d9-2af0-468e-bdc1-5e3f34bc52e6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e57b859e1a41428083b6d86ce51f5184', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0ea392d9-2af0-468e-bdc1-5e3f34bc52e6', 'created_at': datetime.datetime(2026, 9, 15, 14, 11, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 15, 14, 11, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0ea392d9-2af0-468e-bdc1-5e3f34bc52e6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:32:19 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-3ffee690-96e2-43bb-9cb5-672cdcb7d990 tempest-VolumesGetTest-1239150761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b528740-404f-4538-8b01-6da630cc8349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:32:19 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-3ffee690-96e2-43bb-9cb5-672cdcb7d990 tempest-VolumesGetTest-1239150761 None] Volume volume-79b36d19-c0f3-4a71-b564-43c3256b0d78 (79b36d19-c0f3-4a71-b564-43c3256b0d78): created successfully Sep 15 16:32:19 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-3ffee690-96e2-43bb-9cb5-672cdcb7d990 tempest-VolumesGetTest-1239150761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b528740-404f-4538-8b01-6da630cc8349) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:32:19 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-3ffee690-96e2-43bb-9cb5-672cdcb7d990 tempest-VolumesGetTest-1239150761 None] Flow 'volume_create_manager' (4df0d59b-accf-462e-bc44-d1c3d7feca14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:32:19 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-3ffee690-96e2-43bb-9cb5-672cdcb7d990 tempest-VolumesGetTest-1239150761 None] Created volume successfully. Sep 15 16:32:20 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1c1db27-59fd-4c0d-b281-44b59eff2951 tempest-VolumesGetTest-1239150761 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:32:20 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c1c1db27-59fd-4c0d-b281-44b59eff2951 tempest-VolumesGetTest-1239150761 None] Flow 'volume_create_manager' (5b7843c0-a442-42e0-b977-e802794effe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:32:20 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c1c1db27-59fd-4c0d-b281-44b59eff2951 tempest-VolumesGetTest-1239150761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13ebbb09-1882-4d3e-a245-189ad90080a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:32:20 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c1c1db27-59fd-4c0d-b281-44b59eff2951 tempest-VolumesGetTest-1239150761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13ebbb09-1882-4d3e-a245-189ad90080a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:32:20Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1187666343',display_name='tempest-VolumesGetTest-Volume-488110628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdae35b5-6285-4911-b60f-958d037a7edc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5a0bb68482346e68fdb180432e510b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:32:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:32:21Z,use_quota=True,user_id='c565d0459d61428f8e3171809fd98282',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:32:20 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c1c1db27-59fd-4c0d-b281-44b59eff2951 tempest-VolumesGetTest-1239150761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd877660-26c6-4c1d-9d98-60702f5d65db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:32:20 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c1c1db27-59fd-4c0d-b281-44b59eff2951 tempest-VolumesGetTest-1239150761 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd877660-26c6-4c1d-9d98-60702f5d65db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:32:20 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c1c1db27-59fd-4c0d-b281-44b59eff2951 tempest-VolumesGetTest-1239150761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b248aa68-a435-48a5-acc0-a267778e6415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:32:20 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c1c1db27-59fd-4c0d-b281-44b59eff2951 tempest-VolumesGetTest-1239150761 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b248aa68-a435-48a5-acc0-a267778e6415) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bdae35b5-6285-4911-b60f-958d037a7edc', 'volume_name': 'volume-bdae35b5-6285-4911-b60f-958d037a7edc', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:32:20 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c1c1db27-59fd-4c0d-b281-44b59eff2951 tempest-VolumesGetTest-1239150761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (949c685b-8376-4882-9185-a54a643c4599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:32:20 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c1c1db27-59fd-4c0d-b281-44b59eff2951 tempest-VolumesGetTest-1239150761 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (949c685b-8376-4882-9185-a54a643c4599) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:32:20 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c1c1db27-59fd-4c0d-b281-44b59eff2951 tempest-VolumesGetTest-1239150761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (162c8e1a-e820-4f8a-81bc-c5801b0fab0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:32:20 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-c1c1db27-59fd-4c0d-b281-44b59eff2951 tempest-VolumesGetTest-1239150761 None] Volume bdae35b5-6285-4911-b60f-958d037a7edc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bdae35b5-6285-4911-b60f-958d037a7edc', 'volume_size': 1} Sep 15 16:32:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c1c1db27-59fd-4c0d-b281-44b59eff2951 tempest-VolumesGetTest-1239150761 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:32:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c1c1db27-59fd-4c0d-b281-44b59eff2951 tempest-VolumesGetTest-1239150761 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:32:20 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c1c1db27-59fd-4c0d-b281-44b59eff2951 tempest-VolumesGetTest-1239150761 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:32:20Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1187666343',display_name='tempest-VolumesGetTest-Volume-488110628',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdae35b5-6285-4911-b60f-958d037a7edc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5a0bb68482346e68fdb180432e510b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:32:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:32:21Z,use_quota=True,user_id='c565d0459d61428f8e3171809fd98282',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:32:20 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-c1c1db27-59fd-4c0d-b281-44b59eff2951 tempest-VolumesGetTest-1239150761 None] Creating volume bdae35b5-6285-4911-b60f-958d037a7edc {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:32:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c1c1db27-59fd-4c0d-b281-44b59eff2951 tempest-VolumesGetTest-1239150761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:32:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c1c1db27-59fd-4c0d-b281-44b59eff2951 tempest-VolumesGetTest-1239150761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:32:20 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c1c1db27-59fd-4c0d-b281-44b59eff2951 tempest-VolumesGetTest-1239150761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:32:20 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c1c1db27-59fd-4c0d-b281-44b59eff2951 tempest-VolumesGetTest-1239150761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:32:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c1c1db27-59fd-4c0d-b281-44b59eff2951 tempest-VolumesGetTest-1239150761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:32:20 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c1c1db27-59fd-4c0d-b281-44b59eff2951 tempest-VolumesGetTest-1239150761 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:32:20 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-c1c1db27-59fd-4c0d-b281-44b59eff2951 tempest-VolumesGetTest-1239150761 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:32:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c1c1db27-59fd-4c0d-b281-44b59eff2951 tempest-VolumesGetTest-1239150761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-bdae35b5-6285-4911-b60f-958d037a7edc 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:32:20 devstack sudo[102589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-bdae35b5-6285-4911-b60f-958d037a7edc 1073741824 Sep 15 16:32:20 devstack sudo[102589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:32:21 devstack sudo[102589]: pam_unix(sudo:session): session closed for user root Sep 15 16:32:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c1c1db27-59fd-4c0d-b281-44b59eff2951 tempest-VolumesGetTest-1239150761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-bdae35b5-6285-4911-b60f-958d037a7edc 1073741824" returned: 0 in 0.418s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:32:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c1c1db27-59fd-4c0d-b281-44b59eff2951 tempest-VolumesGetTest-1239150761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-bdae35b5-6285-4911-b60f-958d037a7edc {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:32:21 devstack sudo[102595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-bdae35b5-6285-4911-b60f-958d037a7edc Sep 15 16:32:21 devstack sudo[102595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:32:21 devstack sudo[102595]: pam_unix(sudo:session): session closed for user root Sep 15 16:32:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c1c1db27-59fd-4c0d-b281-44b59eff2951 tempest-VolumesGetTest-1239150761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-bdae35b5-6285-4911-b60f-958d037a7edc" returned: 0 in 0.235s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:32:21 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c1c1db27-59fd-4c0d-b281-44b59eff2951 tempest-VolumesGetTest-1239150761 None] <== create_volume: return (695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:32:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c1c1db27-59fd-4c0d-b281-44b59eff2951 tempest-VolumesGetTest-1239150761 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.698s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:32:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c1c1db27-59fd-4c0d-b281-44b59eff2951 tempest-VolumesGetTest-1239150761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (162c8e1a-e820-4f8a-81bc-c5801b0fab0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bdae35b5-6285-4911-b60f-958d037a7edc', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:32:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c1c1db27-59fd-4c0d-b281-44b59eff2951 tempest-VolumesGetTest-1239150761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55655b53-df3a-4fa8-988f-eb9c76eb85ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:32:21 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-c1c1db27-59fd-4c0d-b281-44b59eff2951 tempest-VolumesGetTest-1239150761 None] Volume volume-bdae35b5-6285-4911-b60f-958d037a7edc (bdae35b5-6285-4911-b60f-958d037a7edc): created successfully Sep 15 16:32:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c1c1db27-59fd-4c0d-b281-44b59eff2951 tempest-VolumesGetTest-1239150761 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55655b53-df3a-4fa8-988f-eb9c76eb85ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:32:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c1c1db27-59fd-4c0d-b281-44b59eff2951 tempest-VolumesGetTest-1239150761 None] Flow 'volume_create_manager' (5b7843c0-a442-42e0-b977-e802794effe3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:32:21 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-c1c1db27-59fd-4c0d-b281-44b59eff2951 tempest-VolumesGetTest-1239150761 None] Created volume successfully. Sep 15 16:32:21 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-4e81ebd0-ec5d-40b9-a650-02379c626d1f tempest-VolumesGetTest-1239150761 None] Acquiring lock "cinder-bdae35b5-6285-4911-b60f-958d037a7edc-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:32:21 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-4e81ebd0-ec5d-40b9-a650-02379c626d1f tempest-VolumesGetTest-1239150761 None] Lock "cinder-bdae35b5-6285-4911-b60f-958d037a7edc-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:32:21 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:SELECT=63,cinder:UPDATE=73,cinder:INSERT=23,cinder:DELETE=5 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 16:32:21 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-4e81ebd0-ec5d-40b9-a650-02379c626d1f tempest-VolumesGetTest-1239150761 None] Acquiring lock "cinder-quobyte-bdae35b5-6285-4911-b60f-958d037a7edc" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:32:21 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-4e81ebd0-ec5d-40b9-a650-02379c626d1f tempest-VolumesGetTest-1239150761 None] Lock "cinder-quobyte-bdae35b5-6285-4911-b60f-958d037a7edc" acquired by "delete_volume" :: waited 0.018s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:32:21 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[9553ebd2-d4f5-4ace-a2da-f44f0e833493]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:32:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4e81ebd0-ec5d-40b9-a650-02379c626d1f tempest-VolumesGetTest-1239150761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-bdae35b5-6285-4911-b60f-958d037a7edc {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:32:22 devstack sudo[102598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-bdae35b5-6285-4911-b60f-958d037a7edc Sep 15 16:32:22 devstack sudo[102598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:32:22 devstack sudo[102598]: pam_unix(sudo:session): session closed for user root Sep 15 16:32:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4e81ebd0-ec5d-40b9-a650-02379c626d1f tempest-VolumesGetTest-1239150761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-bdae35b5-6285-4911-b60f-958d037a7edc" returned: 0 in 0.356s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:32:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4e81ebd0-ec5d-40b9-a650-02379c626d1f tempest-VolumesGetTest-1239150761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-bdae35b5-6285-4911-b60f-958d037a7edc {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:32:22 devstack sudo[102603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-bdae35b5-6285-4911-b60f-958d037a7edc Sep 15 16:32:22 devstack sudo[102603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:32:22 devstack sudo[102603]: pam_unix(sudo:session): session closed for user root Sep 15 16:32:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4e81ebd0-ec5d-40b9-a650-02379c626d1f tempest-VolumesGetTest-1239150761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-bdae35b5-6285-4911-b60f-958d037a7edc" returned: 0 in 0.240s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:32:22 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-4e81ebd0-ec5d-40b9-a650-02379c626d1f tempest-VolumesGetTest-1239150761 None] Lock "cinder-quobyte-bdae35b5-6285-4911-b60f-958d037a7edc" released by "delete_volume" :: held 0.637s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:32:22 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-4e81ebd0-ec5d-40b9-a650-02379c626d1f tempest-VolumesGetTest-1239150761 None] Created reservations ['3a05318a-89ec-4312-955a-b5e08c661bf1', '98c949ed-02dd-4d5f-8051-9df4ae701cb7', '0f1fc5b6-d8a3-4a8e-8526-5db295e6cb8c', '125816a8-f3e4-479f-903e-38b8f9d18860'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:32:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-4e81ebd0-ec5d-40b9-a650-02379c626d1f tempest-VolumesGetTest-1239150761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:32:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-4e81ebd0-ec5d-40b9-a650-02379c626d1f tempest-VolumesGetTest-1239150761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:32:22 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-4e81ebd0-ec5d-40b9-a650-02379c626d1f tempest-VolumesGetTest-1239150761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:32:22 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-4e81ebd0-ec5d-40b9-a650-02379c626d1f tempest-VolumesGetTest-1239150761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:32:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-4e81ebd0-ec5d-40b9-a650-02379c626d1f tempest-VolumesGetTest-1239150761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:32:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4e81ebd0-ec5d-40b9-a650-02379c626d1f tempest-VolumesGetTest-1239150761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:32:22 devstack sudo[102606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:32:22 devstack sudo[102606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:32:22 devstack sudo[102606]: pam_unix(sudo:session): session closed for user root Sep 15 16:32:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4e81ebd0-ec5d-40b9-a650-02379c626d1f tempest-VolumesGetTest-1239150761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.234s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:32:22 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-4e81ebd0-ec5d-40b9-a650-02379c626d1f tempest-VolumesGetTest-1239150761 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:32:22 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-4e81ebd0-ec5d-40b9-a650-02379c626d1f tempest-VolumesGetTest-1239150761 None] Deleted volume successfully. Sep 15 16:32:22 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-4e81ebd0-ec5d-40b9-a650-02379c626d1f tempest-VolumesGetTest-1239150761 None] Lock "cinder-bdae35b5-6285-4911-b60f-958d037a7edc-delete_volume" released by "delete_volume" :: held 1.055s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:32:23 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-1323d590-acd6-4050-8526-78ec5a96db63 tempest-VolumesGetTest-1239150761 None] Acquiring lock "cinder-79b36d19-c0f3-4a71-b564-43c3256b0d78-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:32:23 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-1323d590-acd6-4050-8526-78ec5a96db63 tempest-VolumesGetTest-1239150761 None] Lock "cinder-79b36d19-c0f3-4a71-b564-43c3256b0d78-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:32:23 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-1323d590-acd6-4050-8526-78ec5a96db63 tempest-VolumesGetTest-1239150761 None] Acquiring lock "cinder-quobyte-79b36d19-c0f3-4a71-b564-43c3256b0d78" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:32:23 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-1323d590-acd6-4050-8526-78ec5a96db63 tempest-VolumesGetTest-1239150761 None] Lock "cinder-quobyte-79b36d19-c0f3-4a71-b564-43c3256b0d78" acquired by "delete_volume" :: waited 0.017s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:32:23 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7271119-4be5-43f6-b214-c616a4eb7fb0]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:32:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-1323d590-acd6-4050-8526-78ec5a96db63 tempest-VolumesGetTest-1239150761 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-79b36d19-c0f3-4a71-b564-43c3256b0d78 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:32:23 devstack sudo[102609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-79b36d19-c0f3-4a71-b564-43c3256b0d78 Sep 15 16:32:23 devstack sudo[102609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:32:23 devstack sudo[102609]: pam_unix(sudo:session): session closed for user root Sep 15 16:32:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-1323d590-acd6-4050-8526-78ec5a96db63 tempest-VolumesGetTest-1239150761 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-79b36d19-c0f3-4a71-b564-43c3256b0d78" returned: 0 in 0.355s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:32:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-1323d590-acd6-4050-8526-78ec5a96db63 tempest-VolumesGetTest-1239150761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-79b36d19-c0f3-4a71-b564-43c3256b0d78 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:32:23 devstack sudo[102614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-79b36d19-c0f3-4a71-b564-43c3256b0d78 Sep 15 16:32:23 devstack sudo[102614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:32:23 devstack sudo[102614]: pam_unix(sudo:session): session closed for user root Sep 15 16:32:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-1323d590-acd6-4050-8526-78ec5a96db63 tempest-VolumesGetTest-1239150761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-79b36d19-c0f3-4a71-b564-43c3256b0d78" returned: 0 in 0.240s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:32:23 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-1323d590-acd6-4050-8526-78ec5a96db63 tempest-VolumesGetTest-1239150761 None] Lock "cinder-quobyte-79b36d19-c0f3-4a71-b564-43c3256b0d78" released by "delete_volume" :: held 0.638s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:32:23 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-1323d590-acd6-4050-8526-78ec5a96db63 tempest-VolumesGetTest-1239150761 None] Created reservations ['13ccc9e6-c1bf-4b13-ba20-b6386fdbc7e3', '7f1aeed1-1cc3-4e7d-a481-5eb64947b4b9', '97d51571-4f9d-4244-ba88-fcccf26abdbc', '5b02a761-3814-40a7-94d5-8d99d175798b'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:32:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-1323d590-acd6-4050-8526-78ec5a96db63 tempest-VolumesGetTest-1239150761 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:32:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-1323d590-acd6-4050-8526-78ec5a96db63 tempest-VolumesGetTest-1239150761 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:32:23 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-1323d590-acd6-4050-8526-78ec5a96db63 tempest-VolumesGetTest-1239150761 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:32:23 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-1323d590-acd6-4050-8526-78ec5a96db63 tempest-VolumesGetTest-1239150761 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:32:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-1323d590-acd6-4050-8526-78ec5a96db63 tempest-VolumesGetTest-1239150761 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:32:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-1323d590-acd6-4050-8526-78ec5a96db63 tempest-VolumesGetTest-1239150761 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:32:23 devstack sudo[102617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:32:23 devstack sudo[102617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:32:24 devstack sudo[102617]: pam_unix(sudo:session): session closed for user root Sep 15 16:32:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-1323d590-acd6-4050-8526-78ec5a96db63 tempest-VolumesGetTest-1239150761 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.241s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:32:24 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-1323d590-acd6-4050-8526-78ec5a96db63 tempest-VolumesGetTest-1239150761 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:32:24 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-1323d590-acd6-4050-8526-78ec5a96db63 tempest-VolumesGetTest-1239150761 None] Deleted volume successfully. Sep 15 16:32:24 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-1323d590-acd6-4050-8526-78ec5a96db63 tempest-VolumesGetTest-1239150761 None] Lock "cinder-79b36d19-c0f3-4a71-b564-43c3256b0d78-delete_volume" released by "delete_volume" :: held 1.056s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:32:33 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:SELECT=7,cinder:INSERT=5,cinder:UPDATE=16,cinder:DELETE=1 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 16:32:34 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:SELECT=65,cinder:INSERT=26,cinder:UPDATE=90,cinder:DELETE=9 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 16:32:59 devstack cinder-volume[86082]: DEBUG oslo_service.periodic_task [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86082) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 15 16:32:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:32:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:32:59 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:32:59 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:32:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:32:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:32:59 devstack sudo[102723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:32:59 devstack sudo[102723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:33:00 devstack sudo[102723]: pam_unix(sudo:session): session closed for user root Sep 15 16:33:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.245s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:33:00 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:33:00 devstack cinder-volume[86082]: DEBUG oslo_service.periodic_task [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Running periodic task VolumeManager._thread_info {{(pid=86082) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 15 16:33:00 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] thread count: 28 {{(pid=86082) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 15 16:33:00 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] thread info: [<_MainThread(MainThread, started 124875935469696)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86082) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 15 16:33:17 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-83d7c306-04fd-4a43-a13d-fa6efc88a218 tempest-TestServerVolumeAttachScenarioOldVersion-1035578050 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:33:18 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-83d7c306-04fd-4a43-a13d-fa6efc88a218 tempest-TestServerVolumeAttachScenarioOldVersion-1035578050 None] Flow 'volume_create_manager' (64d15d95-34f5-4529-b948-b1728053dc51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:33:18 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-83d7c306-04fd-4a43-a13d-fa6efc88a218 tempest-TestServerVolumeAttachScenarioOldVersion-1035578050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c44076d-ca02-4696-9cc8-b3c80df0dcc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:33:18 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-83d7c306-04fd-4a43-a13d-fa6efc88a218 tempest-TestServerVolumeAttachScenarioOldVersion-1035578050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c44076d-ca02-4696-9cc8-b3c80df0dcc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:33:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-548928267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3d9838d-e9a5-45f7-8e16-63219bf970a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53865f93bc8442ff89a05aff267238ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:33:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:33:18Z,use_quota=True,user_id='8a094b87248c4691a2cfbb153d080b36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:33:18 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-83d7c306-04fd-4a43-a13d-fa6efc88a218 tempest-TestServerVolumeAttachScenarioOldVersion-1035578050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1b992ac-8a1c-4818-9c05-214d815e369c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:33:18 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-83d7c306-04fd-4a43-a13d-fa6efc88a218 tempest-TestServerVolumeAttachScenarioOldVersion-1035578050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1b992ac-8a1c-4818-9c05-214d815e369c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:33:18 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-83d7c306-04fd-4a43-a13d-fa6efc88a218 tempest-TestServerVolumeAttachScenarioOldVersion-1035578050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6aaaad0-e970-42a8-9a95-b8e3442ee451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:33:18 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-83d7c306-04fd-4a43-a13d-fa6efc88a218 tempest-TestServerVolumeAttachScenarioOldVersion-1035578050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6aaaad0-e970-42a8-9a95-b8e3442ee451) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3d9838d-e9a5-45f7-8e16-63219bf970a5', 'volume_name': 'volume-c3d9838d-e9a5-45f7-8e16-63219bf970a5', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:33:18 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-83d7c306-04fd-4a43-a13d-fa6efc88a218 tempest-TestServerVolumeAttachScenarioOldVersion-1035578050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fac81c0-dec8-4d7b-abf7-559950791d11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:33:18 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-83d7c306-04fd-4a43-a13d-fa6efc88a218 tempest-TestServerVolumeAttachScenarioOldVersion-1035578050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fac81c0-dec8-4d7b-abf7-559950791d11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:33:18 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-83d7c306-04fd-4a43-a13d-fa6efc88a218 tempest-TestServerVolumeAttachScenarioOldVersion-1035578050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b0bf3f7-f1e3-48f1-8ef5-9ce5dce096b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:33:18 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-83d7c306-04fd-4a43-a13d-fa6efc88a218 tempest-TestServerVolumeAttachScenarioOldVersion-1035578050 None] Volume c3d9838d-e9a5-45f7-8e16-63219bf970a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3d9838d-e9a5-45f7-8e16-63219bf970a5', 'volume_size': 1} Sep 15 16:33:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-83d7c306-04fd-4a43-a13d-fa6efc88a218 tempest-TestServerVolumeAttachScenarioOldVersion-1035578050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:33:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-83d7c306-04fd-4a43-a13d-fa6efc88a218 tempest-TestServerVolumeAttachScenarioOldVersion-1035578050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:33:18 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-83d7c306-04fd-4a43-a13d-fa6efc88a218 tempest-TestServerVolumeAttachScenarioOldVersion-1035578050 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:33:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-548928267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3d9838d-e9a5-45f7-8e16-63219bf970a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='53865f93bc8442ff89a05aff267238ca',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:33:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:33:18Z,use_quota=True,user_id='8a094b87248c4691a2cfbb153d080b36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:33:18 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-83d7c306-04fd-4a43-a13d-fa6efc88a218 tempest-TestServerVolumeAttachScenarioOldVersion-1035578050 None] Creating volume c3d9838d-e9a5-45f7-8e16-63219bf970a5 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:33:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-83d7c306-04fd-4a43-a13d-fa6efc88a218 tempest-TestServerVolumeAttachScenarioOldVersion-1035578050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:33:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-83d7c306-04fd-4a43-a13d-fa6efc88a218 tempest-TestServerVolumeAttachScenarioOldVersion-1035578050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:33:18 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-83d7c306-04fd-4a43-a13d-fa6efc88a218 tempest-TestServerVolumeAttachScenarioOldVersion-1035578050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:33:18 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-83d7c306-04fd-4a43-a13d-fa6efc88a218 tempest-TestServerVolumeAttachScenarioOldVersion-1035578050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:33:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-83d7c306-04fd-4a43-a13d-fa6efc88a218 tempest-TestServerVolumeAttachScenarioOldVersion-1035578050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:33:18 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-83d7c306-04fd-4a43-a13d-fa6efc88a218 tempest-TestServerVolumeAttachScenarioOldVersion-1035578050 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:33:18 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-83d7c306-04fd-4a43-a13d-fa6efc88a218 tempest-TestServerVolumeAttachScenarioOldVersion-1035578050 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:33:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-83d7c306-04fd-4a43-a13d-fa6efc88a218 tempest-TestServerVolumeAttachScenarioOldVersion-1035578050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c3d9838d-e9a5-45f7-8e16-63219bf970a5 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:33:18 devstack sudo[102784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c3d9838d-e9a5-45f7-8e16-63219bf970a5 1073741824 Sep 15 16:33:18 devstack sudo[102784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:33:18 devstack sudo[102784]: pam_unix(sudo:session): session closed for user root Sep 15 16:33:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-83d7c306-04fd-4a43-a13d-fa6efc88a218 tempest-TestServerVolumeAttachScenarioOldVersion-1035578050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c3d9838d-e9a5-45f7-8e16-63219bf970a5 1073741824" returned: 0 in 0.461s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:33:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-83d7c306-04fd-4a43-a13d-fa6efc88a218 tempest-TestServerVolumeAttachScenarioOldVersion-1035578050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c3d9838d-e9a5-45f7-8e16-63219bf970a5 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:33:18 devstack sudo[102789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c3d9838d-e9a5-45f7-8e16-63219bf970a5 Sep 15 16:33:18 devstack sudo[102789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:33:18 devstack sudo[102789]: pam_unix(sudo:session): session closed for user root Sep 15 16:33:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-83d7c306-04fd-4a43-a13d-fa6efc88a218 tempest-TestServerVolumeAttachScenarioOldVersion-1035578050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c3d9838d-e9a5-45f7-8e16-63219bf970a5" returned: 0 in 0.237s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:33:18 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-83d7c306-04fd-4a43-a13d-fa6efc88a218 tempest-TestServerVolumeAttachScenarioOldVersion-1035578050 None] <== create_volume: return (739ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:33:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-83d7c306-04fd-4a43-a13d-fa6efc88a218 tempest-TestServerVolumeAttachScenarioOldVersion-1035578050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.741s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:33:18 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-83d7c306-04fd-4a43-a13d-fa6efc88a218 tempest-TestServerVolumeAttachScenarioOldVersion-1035578050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b0bf3f7-f1e3-48f1-8ef5-9ce5dce096b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3d9838d-e9a5-45f7-8e16-63219bf970a5', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:33:18 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-83d7c306-04fd-4a43-a13d-fa6efc88a218 tempest-TestServerVolumeAttachScenarioOldVersion-1035578050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7f19a59-5104-4c81-b77f-94b4d5e0a3dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:33:18 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-83d7c306-04fd-4a43-a13d-fa6efc88a218 tempest-TestServerVolumeAttachScenarioOldVersion-1035578050 None] Volume volume-c3d9838d-e9a5-45f7-8e16-63219bf970a5 (c3d9838d-e9a5-45f7-8e16-63219bf970a5): created successfully Sep 15 16:33:18 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-83d7c306-04fd-4a43-a13d-fa6efc88a218 tempest-TestServerVolumeAttachScenarioOldVersion-1035578050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d7f19a59-5104-4c81-b77f-94b4d5e0a3dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:33:18 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-83d7c306-04fd-4a43-a13d-fa6efc88a218 tempest-TestServerVolumeAttachScenarioOldVersion-1035578050 None] Flow 'volume_create_manager' (64d15d95-34f5-4529-b948-b1728053dc51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:33:18 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-83d7c306-04fd-4a43-a13d-fa6efc88a218 tempest-TestServerVolumeAttachScenarioOldVersion-1035578050 None] Created volume successfully. Sep 15 16:33:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-d6e7a439-09e5-4b8c-baeb-5a6d7dcf8223 req-f58638c5-eba1-465c-81e6-68b2b2705a45 tempest-TestServerVolumeAttachScenarioOldVersion-1035578050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:33:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-d6e7a439-09e5-4b8c-baeb-5a6d7dcf8223 req-f58638c5-eba1-465c-81e6-68b2b2705a45 tempest-TestServerVolumeAttachScenarioOldVersion-1035578050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:33:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-d6e7a439-09e5-4b8c-baeb-5a6d7dcf8223 req-f58638c5-eba1-465c-81e6-68b2b2705a45 tempest-TestServerVolumeAttachScenarioOldVersion-1035578050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:33:19 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-d6e7a439-09e5-4b8c-baeb-5a6d7dcf8223 req-f58638c5-eba1-465c-81e6-68b2b2705a45 tempest-TestServerVolumeAttachScenarioOldVersion-1035578050 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a', 'name': 'volume-c3d9838d-e9a5-45f7-8e16-63219bf970a5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ef22e222-8411-49f9-a8e8-636e0d726ecb', 'enforce_multipath': True} {{(pid=86082) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 15 16:33:19 devstack cinder-volume[86082]: INFO cinder.volume.manager [req-d6e7a439-09e5-4b8c-baeb-5a6d7dcf8223 req-f58638c5-eba1-465c-81e6-68b2b2705a45 tempest-TestServerVolumeAttachScenarioOldVersion-1035578050 None] attachment_update completed successfully. Sep 15 16:33:21 devstack cinder-volume[86082]: INFO cinder.volume.manager [req-05c672f4-6cdb-44a6-8034-e1c11d39f297 req-a4dfd8cc-d57d-48cf-b7ba-4c2c3797eb74 tempest-TestServerVolumeAttachScenarioOldVersion-1035578050 None] Terminate volume connection completed successfully. Sep 15 16:33:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-05c672f4-6cdb-44a6-8034-e1c11d39f297 req-a4dfd8cc-d57d-48cf-b7ba-4c2c3797eb74 tempest-TestServerVolumeAttachScenarioOldVersion-1035578050 None] Deleting attachment ef22e222-8411-49f9-a8e8-636e0d726ecb. {{(pid=86082) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 15 16:33:22 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-529e0246-d1db-4ece-aaab-820efea9252a tempest-TestServerVolumeAttachScenarioOldVersion-1035578050 None] Acquiring lock "cinder-c3d9838d-e9a5-45f7-8e16-63219bf970a5-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:33:22 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-529e0246-d1db-4ece-aaab-820efea9252a tempest-TestServerVolumeAttachScenarioOldVersion-1035578050 None] Lock "cinder-c3d9838d-e9a5-45f7-8e16-63219bf970a5-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:33:22 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-529e0246-d1db-4ece-aaab-820efea9252a tempest-TestServerVolumeAttachScenarioOldVersion-1035578050 None] Acquiring lock "cinder-quobyte-c3d9838d-e9a5-45f7-8e16-63219bf970a5" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:33:22 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-529e0246-d1db-4ece-aaab-820efea9252a tempest-TestServerVolumeAttachScenarioOldVersion-1035578050 None] Lock "cinder-quobyte-c3d9838d-e9a5-45f7-8e16-63219bf970a5" acquired by "delete_volume" :: waited 0.016s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:33:22 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[a269e3d6-77da-4fd1-aa1c-0a46d62978f7]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:33:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-529e0246-d1db-4ece-aaab-820efea9252a tempest-TestServerVolumeAttachScenarioOldVersion-1035578050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c3d9838d-e9a5-45f7-8e16-63219bf970a5 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:33:22 devstack sudo[103244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c3d9838d-e9a5-45f7-8e16-63219bf970a5 Sep 15 16:33:22 devstack sudo[103244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:33:23 devstack sudo[103244]: pam_unix(sudo:session): session closed for user root Sep 15 16:33:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-529e0246-d1db-4ece-aaab-820efea9252a tempest-TestServerVolumeAttachScenarioOldVersion-1035578050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c3d9838d-e9a5-45f7-8e16-63219bf970a5" returned: 0 in 0.356s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:33:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-529e0246-d1db-4ece-aaab-820efea9252a tempest-TestServerVolumeAttachScenarioOldVersion-1035578050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c3d9838d-e9a5-45f7-8e16-63219bf970a5 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:33:23 devstack sudo[103249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c3d9838d-e9a5-45f7-8e16-63219bf970a5 Sep 15 16:33:23 devstack sudo[103249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:33:23 devstack sudo[103249]: pam_unix(sudo:session): session closed for user root Sep 15 16:33:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-529e0246-d1db-4ece-aaab-820efea9252a tempest-TestServerVolumeAttachScenarioOldVersion-1035578050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c3d9838d-e9a5-45f7-8e16-63219bf970a5" returned: 0 in 0.240s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:33:23 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-529e0246-d1db-4ece-aaab-820efea9252a tempest-TestServerVolumeAttachScenarioOldVersion-1035578050 None] Lock "cinder-quobyte-c3d9838d-e9a5-45f7-8e16-63219bf970a5" released by "delete_volume" :: held 0.642s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:33:23 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-529e0246-d1db-4ece-aaab-820efea9252a tempest-TestServerVolumeAttachScenarioOldVersion-1035578050 None] Created reservations ['46312edf-746d-4e21-a209-4ab395861a79', '23dffd37-5e04-410d-98a4-556e868adaa7', 'b1a8fa87-3b2e-4622-9327-edfc13e3b4ee', '3fb46c40-be7d-4334-92fd-c3f2c0c36367'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:33:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-529e0246-d1db-4ece-aaab-820efea9252a tempest-TestServerVolumeAttachScenarioOldVersion-1035578050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:33:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-529e0246-d1db-4ece-aaab-820efea9252a tempest-TestServerVolumeAttachScenarioOldVersion-1035578050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:33:23 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-529e0246-d1db-4ece-aaab-820efea9252a tempest-TestServerVolumeAttachScenarioOldVersion-1035578050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:33:23 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-529e0246-d1db-4ece-aaab-820efea9252a tempest-TestServerVolumeAttachScenarioOldVersion-1035578050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:33:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-529e0246-d1db-4ece-aaab-820efea9252a tempest-TestServerVolumeAttachScenarioOldVersion-1035578050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:33:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-529e0246-d1db-4ece-aaab-820efea9252a tempest-TestServerVolumeAttachScenarioOldVersion-1035578050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:33:23 devstack sudo[103252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:33:23 devstack sudo[103252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:33:23 devstack sudo[103252]: pam_unix(sudo:session): session closed for user root Sep 15 16:33:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-529e0246-d1db-4ece-aaab-820efea9252a tempest-TestServerVolumeAttachScenarioOldVersion-1035578050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.235s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:33:23 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-529e0246-d1db-4ece-aaab-820efea9252a tempest-TestServerVolumeAttachScenarioOldVersion-1035578050 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:33:23 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-529e0246-d1db-4ece-aaab-820efea9252a tempest-TestServerVolumeAttachScenarioOldVersion-1035578050 None] Deleted volume successfully. Sep 15 16:33:23 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-529e0246-d1db-4ece-aaab-820efea9252a tempest-TestServerVolumeAttachScenarioOldVersion-1035578050 None] Lock "cinder-c3d9838d-e9a5-45f7-8e16-63219bf970a5-delete_volume" released by "delete_volume" :: held 1.062s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:33:33 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:UPDATE=11,cinder:SELECT=11,cinder:DELETE=1,cinder:INSERT=2 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 16:33:33 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:SELECT=18,cinder:INSERT=3,cinder:UPDATE=14,cinder:DELETE=1 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 16:33:51 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:SELECT=1 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 16:33:51 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:UPDATE=1 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 16:33:59 devstack cinder-volume[86082]: DEBUG oslo_service.periodic_task [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86082) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 15 16:33:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:33:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:33:59 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:33:59 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:33:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:33:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:33:59 devstack sudo[103299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:33:59 devstack sudo[103299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:34:00 devstack sudo[103299]: pam_unix(sudo:session): session closed for user root Sep 15 16:34:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.258s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:34:00 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:34:00 devstack cinder-volume[86082]: DEBUG oslo_service.periodic_task [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Running periodic task VolumeManager._thread_info {{(pid=86082) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 15 16:34:00 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] thread count: 28 {{(pid=86082) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 15 16:34:00 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] thread info: [<_MainThread(MainThread, started 124875935469696)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86082) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 15 16:34:00 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a33a3b0-d3f5-4ed3-bba2-984b80f3a9f9 tempest-TestShelveInstance-772359569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:34:00 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9a33a3b0-d3f5-4ed3-bba2-984b80f3a9f9 tempest-TestShelveInstance-772359569 None] Flow 'volume_create_manager' (92f2c02a-7064-4c2e-b4fe-015bccccd790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:34:01 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9a33a3b0-d3f5-4ed3-bba2-984b80f3a9f9 tempest-TestShelveInstance-772359569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (405e2703-a7c3-4c95-84f5-ecd25309af7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:34:01 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9a33a3b0-d3f5-4ed3-bba2-984b80f3a9f9 tempest-TestShelveInstance-772359569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (405e2703-a7c3-4c95-84f5-ecd25309af7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:34:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-454433372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=333eafd6-1a8c-4d22-9cec-0494b9ee19c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a4e721d607c4fc7abe365901ce4549f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:34:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:34:01Z,use_quota=True,user_id='642e9489641d423891853f4dc66fb9b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:34:01 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9a33a3b0-d3f5-4ed3-bba2-984b80f3a9f9 tempest-TestShelveInstance-772359569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f24c2459-1ce4-4acc-80c1-161b55767003) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:34:01 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9a33a3b0-d3f5-4ed3-bba2-984b80f3a9f9 tempest-TestShelveInstance-772359569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f24c2459-1ce4-4acc-80c1-161b55767003) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:34:01 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9a33a3b0-d3f5-4ed3-bba2-984b80f3a9f9 tempest-TestShelveInstance-772359569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35ceed7f-4135-46ff-88a0-e21cdc75b6c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:34:01 devstack cinder-volume[86082]: DEBUG cinder.image.glance [None req-9a33a3b0-d3f5-4ed3-bba2-984b80f3a9f9 tempest-TestShelveInstance-772359569 None] Creating Keystone auth plugin from conf {{(pid=86082) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 15 16:34:01 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9a33a3b0-d3f5-4ed3-bba2-984b80f3a9f9 tempest-TestShelveInstance-772359569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (35ceed7f-4135-46ff-88a0-e21cdc75b6c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '333eafd6-1a8c-4d22-9cec-0494b9ee19c0', 'volume_name': 'volume-333eafd6-1a8c-4d22-9cec-0494b9ee19c0', 'volume_size': 1, 'image_id': '0ea392d9-2af0-468e-bdc1-5e3f34bc52e6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0ea392d9-2af0-468e-bdc1-5e3f34bc52e6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e57b859e1a41428083b6d86ce51f5184', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0ea392d9-2af0-468e-bdc1-5e3f34bc52e6', 'created_at': datetime.datetime(2026, 9, 15, 14, 11, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 15, 14, 11, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0ea392d9-2af0-468e-bdc1-5e3f34bc52e6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:34:01 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9a33a3b0-d3f5-4ed3-bba2-984b80f3a9f9 tempest-TestShelveInstance-772359569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2f2412f-5ffa-4cac-a961-ae7af7998a48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:34:01 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9a33a3b0-d3f5-4ed3-bba2-984b80f3a9f9 tempest-TestShelveInstance-772359569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2f2412f-5ffa-4cac-a961-ae7af7998a48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:34:01 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9a33a3b0-d3f5-4ed3-bba2-984b80f3a9f9 tempest-TestShelveInstance-772359569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74e02276-6fa2-4578-ac62-31048124dd90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:34:01 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-9a33a3b0-d3f5-4ed3-bba2-984b80f3a9f9 tempest-TestShelveInstance-772359569 None] Volume 333eafd6-1a8c-4d22-9cec-0494b9ee19c0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-333eafd6-1a8c-4d22-9cec-0494b9ee19c0', 'volume_size': 1, 'image_id': '0ea392d9-2af0-468e-bdc1-5e3f34bc52e6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0ea392d9-2af0-468e-bdc1-5e3f34bc52e6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e57b859e1a41428083b6d86ce51f5184', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0ea392d9-2af0-468e-bdc1-5e3f34bc52e6', 'created_at': datetime.datetime(2026, 9, 15, 14, 11, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 15, 14, 11, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0ea392d9-2af0-468e-bdc1-5e3f34bc52e6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 15 16:34:01 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a33a3b0-d3f5-4ed3-bba2-984b80f3a9f9 tempest-TestShelveInstance-772359569 None] Trying to clone 333eafd6-1a8c-4d22-9cec-0494b9ee19c0 from image 0ea392d9-2af0-468e-bdc1-5e3f34bc52e6 at location (None, [{'url': 'file:///opt/stack/data/glance/images/0ea392d9-2af0-468e-bdc1-5e3f34bc52e6', 'metadata': {}}]). {{(pid=86082) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 15 16:34:01 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-9a33a3b0-d3f5-4ed3-bba2-984b80f3a9f9 tempest-TestShelveInstance-772359569 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0ea392d9-2af0-468e-bdc1-5e3f34bc52e6_9lp3_qkadevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86082) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 15 16:34:01 devstack cinder-volume[86082]: INFO cinder.image.image_utils [None req-9a33a3b0-d3f5-4ed3-bba2-984b80f3a9f9 tempest-TestShelveInstance-772359569 None] Image download 20.69 MB at 20.69 MB/s Sep 15 16:34:01 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[d419f4c8-0a41-4fb5-a529-8b4fab2fca84]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:34:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9a33a3b0-d3f5-4ed3-bba2-984b80f3a9f9 tempest-TestShelveInstance-772359569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ea392d9-2af0-468e-bdc1-5e3f34bc52e6_9lp3_qkadevstack@QuobyteHD {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:34:01 devstack sudo[103303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ea392d9-2af0-468e-bdc1-5e3f34bc52e6_9lp3_qkadevstack@QuobyteHD Sep 15 16:34:01 devstack sudo[103303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:34:02 devstack sudo[103303]: pam_unix(sudo:session): session closed for user root Sep 15 16:34:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9a33a3b0-d3f5-4ed3-bba2-984b80f3a9f9 tempest-TestShelveInstance-772359569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ea392d9-2af0-468e-bdc1-5e3f34bc52e6_9lp3_qkadevstack@QuobyteHD" returned: 0 in 0.339s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:34:02 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-9a33a3b0-d3f5-4ed3-bba2-984b80f3a9f9 tempest-TestShelveInstance-772359569 None] Temporary image 0ea392d9-2af0-468e-bdc1-5e3f34bc52e6 is fetched for user 642e9489641d423891853f4dc66fb9b3. {{(pid=86082) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 15 16:34:02 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7c172ae-9a17-4ccd-b0ad-e47bd3a65659]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:34:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9a33a3b0-d3f5-4ed3-bba2-984b80f3a9f9 tempest-TestShelveInstance-772359569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ea392d9-2af0-468e-bdc1-5e3f34bc52e6_9lp3_qkadevstack@QuobyteHD {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:34:02 devstack sudo[103308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ea392d9-2af0-468e-bdc1-5e3f34bc52e6_9lp3_qkadevstack@QuobyteHD Sep 15 16:34:02 devstack sudo[103308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:34:02 devstack sudo[103308]: pam_unix(sudo:session): session closed for user root Sep 15 16:34:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9a33a3b0-d3f5-4ed3-bba2-984b80f3a9f9 tempest-TestShelveInstance-772359569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ea392d9-2af0-468e-bdc1-5e3f34bc52e6_9lp3_qkadevstack@QuobyteHD" returned: 0 in 0.323s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:34:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-9a33a3b0-d3f5-4ed3-bba2-984b80f3a9f9 tempest-TestShelveInstance-772359569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:34:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-9a33a3b0-d3f5-4ed3-bba2-984b80f3a9f9 tempest-TestShelveInstance-772359569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:34:02 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-9a33a3b0-d3f5-4ed3-bba2-984b80f3a9f9 tempest-TestShelveInstance-772359569 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:34:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-454433372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=333eafd6-1a8c-4d22-9cec-0494b9ee19c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a4e721d607c4fc7abe365901ce4549f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:34:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:34:01Z,use_quota=True,user_id='642e9489641d423891853f4dc66fb9b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:34:02 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-9a33a3b0-d3f5-4ed3-bba2-984b80f3a9f9 tempest-TestShelveInstance-772359569 None] Creating volume 333eafd6-1a8c-4d22-9cec-0494b9ee19c0 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:34:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-9a33a3b0-d3f5-4ed3-bba2-984b80f3a9f9 tempest-TestShelveInstance-772359569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:34:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-9a33a3b0-d3f5-4ed3-bba2-984b80f3a9f9 tempest-TestShelveInstance-772359569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:34:02 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-9a33a3b0-d3f5-4ed3-bba2-984b80f3a9f9 tempest-TestShelveInstance-772359569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:34:02 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-9a33a3b0-d3f5-4ed3-bba2-984b80f3a9f9 tempest-TestShelveInstance-772359569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:34:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-9a33a3b0-d3f5-4ed3-bba2-984b80f3a9f9 tempest-TestShelveInstance-772359569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:34:02 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-9a33a3b0-d3f5-4ed3-bba2-984b80f3a9f9 tempest-TestShelveInstance-772359569 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:34:02 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-9a33a3b0-d3f5-4ed3-bba2-984b80f3a9f9 tempest-TestShelveInstance-772359569 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:34:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9a33a3b0-d3f5-4ed3-bba2-984b80f3a9f9 tempest-TestShelveInstance-772359569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-333eafd6-1a8c-4d22-9cec-0494b9ee19c0 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:34:02 devstack sudo[103313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-333eafd6-1a8c-4d22-9cec-0494b9ee19c0 1073741824 Sep 15 16:34:02 devstack sudo[103313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:34:03 devstack sudo[103313]: pam_unix(sudo:session): session closed for user root Sep 15 16:34:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9a33a3b0-d3f5-4ed3-bba2-984b80f3a9f9 tempest-TestShelveInstance-772359569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-333eafd6-1a8c-4d22-9cec-0494b9ee19c0 1073741824" returned: 0 in 0.425s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:34:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9a33a3b0-d3f5-4ed3-bba2-984b80f3a9f9 tempest-TestShelveInstance-772359569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-333eafd6-1a8c-4d22-9cec-0494b9ee19c0 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:34:03 devstack sudo[103318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-333eafd6-1a8c-4d22-9cec-0494b9ee19c0 Sep 15 16:34:03 devstack sudo[103318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:34:03 devstack sudo[103318]: pam_unix(sudo:session): session closed for user root Sep 15 16:34:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9a33a3b0-d3f5-4ed3-bba2-984b80f3a9f9 tempest-TestShelveInstance-772359569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-333eafd6-1a8c-4d22-9cec-0494b9ee19c0" returned: 0 in 0.253s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:34:03 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-9a33a3b0-d3f5-4ed3-bba2-984b80f3a9f9 tempest-TestShelveInstance-772359569 None] <== create_volume: return (721ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:34:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-9a33a3b0-d3f5-4ed3-bba2-984b80f3a9f9 tempest-TestShelveInstance-772359569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.726s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:34:03 devstack cinder-volume[86082]: DEBUG cinder.volume.volume_utils [None req-9a33a3b0-d3f5-4ed3-bba2-984b80f3a9f9 tempest-TestShelveInstance-772359569 None] Attempting download of 0ea392d9-2af0-468e-bdc1-5e3f34bc52e6 ((None, [{'url': 'file:///opt/stack/data/glance/images/0ea392d9-2af0-468e-bdc1-5e3f34bc52e6', 'metadata': {}}])) to volume 333eafd6-1a8c-4d22-9cec-0494b9ee19c0. {{(pid=86082) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 15 16:34:03 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[04f62640-36c3-491c-813d-f931ead22bd0]: (4, 'raw') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:34:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9a33a3b0-d3f5-4ed3-bba2-984b80f3a9f9 tempest-TestShelveInstance-772359569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0ea392d9-2af0-468e-bdc1-5e3f34bc52e6_39d2dmq6 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:34:03 devstack sudo[103321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0ea392d9-2af0-468e-bdc1-5e3f34bc52e6_39d2dmq6 Sep 15 16:34:03 devstack sudo[103321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:34:03 devstack sudo[103321]: pam_unix(sudo:session): session closed for user root Sep 15 16:34:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9a33a3b0-d3f5-4ed3-bba2-984b80f3a9f9 tempest-TestShelveInstance-772359569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0ea392d9-2af0-468e-bdc1-5e3f34bc52e6_39d2dmq6" returned: 0 in 0.325s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:34:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9a33a3b0-d3f5-4ed3-bba2-984b80f3a9f9 tempest-TestShelveInstance-772359569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0ea392d9-2af0-468e-bdc1-5e3f34bc52e6_39d2dmq6 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:34:03 devstack sudo[103325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0ea392d9-2af0-468e-bdc1-5e3f34bc52e6_39d2dmq6 Sep 15 16:34:03 devstack sudo[103325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:34:04 devstack sudo[103325]: pam_unix(sudo:session): session closed for user root Sep 15 16:34:04 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9a33a3b0-d3f5-4ed3-bba2-984b80f3a9f9 tempest-TestShelveInstance-772359569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0ea392d9-2af0-468e-bdc1-5e3f34bc52e6_39d2dmq6" returned: 1 in 0.315s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:34:04 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9a33a3b0-d3f5-4ed3-bba2-984b80f3a9f9 tempest-TestShelveInstance-772359569 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0ea392d9-2af0-468e-bdc1-5e3f34bc52e6_39d2dmq6' failed. Not Retrying. {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 15 16:34:04 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e2ba2aa-a10e-45ed-8cc7-6a4b7b11dd0e]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:34:04 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9a33a3b0-d3f5-4ed3-bba2-984b80f3a9f9 tempest-TestShelveInstance-772359569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ea392d9-2af0-468e-bdc1-5e3f34bc52e6_9lp3_qkadevstack@QuobyteHD {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:34:04 devstack sudo[103329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ea392d9-2af0-468e-bdc1-5e3f34bc52e6_9lp3_qkadevstack@QuobyteHD Sep 15 16:34:04 devstack sudo[103329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:34:04 devstack sudo[103329]: pam_unix(sudo:session): session closed for user root Sep 15 16:34:04 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9a33a3b0-d3f5-4ed3-bba2-984b80f3a9f9 tempest-TestShelveInstance-772359569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0ea392d9-2af0-468e-bdc1-5e3f34bc52e6_9lp3_qkadevstack@QuobyteHD" returned: 0 in 0.325s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:34:04 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-9a33a3b0-d3f5-4ed3-bba2-984b80f3a9f9 tempest-TestShelveInstance-772359569 None] 0ea392d9-2af0-468e-bdc1-5e3f34bc52e6 was qcow2, converting to qcow2 {{(pid=86082) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 15 16:34:04 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9a33a3b0-d3f5-4ed3-bba2-984b80f3a9f9 tempest-TestShelveInstance-772359569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0ea392d9-2af0-468e-bdc1-5e3f34bc52e6_9lp3_qkadevstack@QuobyteHD /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-333eafd6-1a8c-4d22-9cec-0494b9ee19c0 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:34:04 devstack sudo[103334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0ea392d9-2af0-468e-bdc1-5e3f34bc52e6_9lp3_qkadevstack@QuobyteHD /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-333eafd6-1a8c-4d22-9cec-0494b9ee19c0 Sep 15 16:34:04 devstack sudo[103334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:34:06 devstack sudo[103334]: pam_unix(sudo:session): session closed for user root Sep 15 16:34:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9a33a3b0-d3f5-4ed3-bba2-984b80f3a9f9 tempest-TestShelveInstance-772359569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0ea392d9-2af0-468e-bdc1-5e3f34bc52e6_9lp3_qkadevstack@QuobyteHD /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-333eafd6-1a8c-4d22-9cec-0494b9ee19c0" returned: 0 in 1.764s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:34:06 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-9a33a3b0-d3f5-4ed3-bba2-984b80f3a9f9 tempest-TestShelveInstance-772359569 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0ea392d9-2af0-468e-bdc1-5e3f34bc52e6_9lp3_qkadevstack@QuobyteHD, size 112.00 MB, duration 1.77 sec, destination /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-333eafd6-1a8c-4d22-9cec-0494b9ee19c0 {{(pid=86082) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 15 16:34:06 devstack cinder-volume[86082]: INFO cinder.image.image_utils [None req-9a33a3b0-d3f5-4ed3-bba2-984b80f3a9f9 tempest-TestShelveInstance-772359569 None] Converted 112.00 MB image at 63.43 MB/s Sep 15 16:34:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9a33a3b0-d3f5-4ed3-bba2-984b80f3a9f9 tempest-TestShelveInstance-772359569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-333eafd6-1a8c-4d22-9cec-0494b9ee19c0 1G {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:34:06 devstack sudo[103342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-333eafd6-1a8c-4d22-9cec-0494b9ee19c0 1G Sep 15 16:34:06 devstack sudo[103342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:34:06 devstack sudo[103342]: pam_unix(sudo:session): session closed for user root Sep 15 16:34:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9a33a3b0-d3f5-4ed3-bba2-984b80f3a9f9 tempest-TestShelveInstance-772359569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-333eafd6-1a8c-4d22-9cec-0494b9ee19c0 1G" returned: 0 in 0.319s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:34:06 devstack cinder-volume[86082]: DEBUG cinder.volume.volume_utils [None req-9a33a3b0-d3f5-4ed3-bba2-984b80f3a9f9 tempest-TestShelveInstance-772359569 None] Downloaded image 0ea392d9-2af0-468e-bdc1-5e3f34bc52e6 ((None, [{'url': 'file:///opt/stack/data/glance/images/0ea392d9-2af0-468e-bdc1-5e3f34bc52e6', 'metadata': {}}])) to volume 333eafd6-1a8c-4d22-9cec-0494b9ee19c0 successfully. {{(pid=86082) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 15 16:34:06 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-9a33a3b0-d3f5-4ed3-bba2-984b80f3a9f9 tempest-TestShelveInstance-772359569 None] Temporary image 0ea392d9-2af0-468e-bdc1-5e3f34bc52e6 for user 642e9489641d423891853f4dc66fb9b3 is deleted. {{(pid=86082) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 15 16:34:06 devstack cinder-volume[86082]: DEBUG cinder.volume.volume_utils [None req-9a33a3b0-d3f5-4ed3-bba2-984b80f3a9f9 tempest-TestShelveInstance-772359569 None] Marking volume 333eafd6-1a8c-4d22-9cec-0494b9ee19c0 as bootable. {{(pid=86082) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 15 16:34:06 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a33a3b0-d3f5-4ed3-bba2-984b80f3a9f9 tempest-TestShelveInstance-772359569 None] Copying metadata from image 0ea392d9-2af0-468e-bdc1-5e3f34bc52e6 to 333eafd6-1a8c-4d22-9cec-0494b9ee19c0. {{(pid=86082) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 15 16:34:06 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a33a3b0-d3f5-4ed3-bba2-984b80f3a9f9 tempest-TestShelveInstance-772359569 None] Creating volume glance metadata for volume 333eafd6-1a8c-4d22-9cec-0494b9ee19c0 backed by image 0ea392d9-2af0-468e-bdc1-5e3f34bc52e6 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '0ea392d9-2af0-468e-bdc1-5e3f34bc52e6', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86082) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 15 16:34:06 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9a33a3b0-d3f5-4ed3-bba2-984b80f3a9f9 tempest-TestShelveInstance-772359569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74e02276-6fa2-4578-ac62-31048124dd90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-333eafd6-1a8c-4d22-9cec-0494b9ee19c0', 'volume_size': 1, 'image_id': '0ea392d9-2af0-468e-bdc1-5e3f34bc52e6', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0ea392d9-2af0-468e-bdc1-5e3f34bc52e6', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'e57b859e1a41428083b6d86ce51f5184', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0ea392d9-2af0-468e-bdc1-5e3f34bc52e6', 'created_at': datetime.datetime(2026, 9, 15, 14, 11, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 15, 14, 11, 7, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0ea392d9-2af0-468e-bdc1-5e3f34bc52e6/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:34:06 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9a33a3b0-d3f5-4ed3-bba2-984b80f3a9f9 tempest-TestShelveInstance-772359569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e825b4b-1f31-40d9-ae74-e28d608fbbab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:34:06 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-9a33a3b0-d3f5-4ed3-bba2-984b80f3a9f9 tempest-TestShelveInstance-772359569 None] Volume volume-333eafd6-1a8c-4d22-9cec-0494b9ee19c0 (333eafd6-1a8c-4d22-9cec-0494b9ee19c0): created successfully Sep 15 16:34:06 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9a33a3b0-d3f5-4ed3-bba2-984b80f3a9f9 tempest-TestShelveInstance-772359569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e825b4b-1f31-40d9-ae74-e28d608fbbab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:34:06 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9a33a3b0-d3f5-4ed3-bba2-984b80f3a9f9 tempest-TestShelveInstance-772359569 None] Flow 'volume_create_manager' (92f2c02a-7064-4c2e-b4fe-015bccccd790) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:34:06 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-9a33a3b0-d3f5-4ed3-bba2-984b80f3a9f9 tempest-TestShelveInstance-772359569 None] Created volume successfully. Sep 15 16:34:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-5d9f0dd3-0d44-434a-a1ca-09f6023f4d2b req-57835078-15e1-4c8e-a708-489cfdf4db0a tempest-TestShelveInstance-772359569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:34:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-5d9f0dd3-0d44-434a-a1ca-09f6023f4d2b req-57835078-15e1-4c8e-a708-489cfdf4db0a tempest-TestShelveInstance-772359569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:34:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-5d9f0dd3-0d44-434a-a1ca-09f6023f4d2b req-57835078-15e1-4c8e-a708-489cfdf4db0a tempest-TestShelveInstance-772359569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:34:09 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-5d9f0dd3-0d44-434a-a1ca-09f6023f4d2b req-57835078-15e1-4c8e-a708-489cfdf4db0a tempest-TestShelveInstance-772359569 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a', 'name': 'volume-333eafd6-1a8c-4d22-9cec-0494b9ee19c0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f80a89f0-26b9-4ce7-93c6-301ce8f073e0', 'enforce_multipath': True} {{(pid=86082) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 15 16:34:09 devstack cinder-volume[86082]: INFO cinder.volume.manager [req-5d9f0dd3-0d44-434a-a1ca-09f6023f4d2b req-57835078-15e1-4c8e-a708-489cfdf4db0a tempest-TestShelveInstance-772359569 None] attachment_update completed successfully. Sep 15 16:34:19 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:SELECT=15,cinder:UPDATE=6,cinder:INSERT=4,cinder:DELETE=1 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 16:34:19 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:SELECT=17,cinder:UPDATE=6,cinder:INSERT=10 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 16:34:55 devstack cinder-volume[86082]: INFO cinder.volume.manager [req-0d5947fc-e38a-4b74-9f9f-c7015ff2ed06 req-8f29e6c2-0a9c-4b88-89a7-f0a398118d80 tempest-TestShelveInstance-772359569 None] Terminate volume connection completed successfully. Sep 15 16:34:55 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-0d5947fc-e38a-4b74-9f9f-c7015ff2ed06 req-8f29e6c2-0a9c-4b88-89a7-f0a398118d80 tempest-TestShelveInstance-772359569 None] Deleting attachment f80a89f0-26b9-4ce7-93c6-301ce8f073e0. {{(pid=86082) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 15 16:34:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-540bb34d-ced5-442c-afc4-938388e75ae8 req-be189bdb-25ea-441c-ae93-49fcda392d8b tempest-TestShelveInstance-772359569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:34:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-540bb34d-ced5-442c-afc4-938388e75ae8 req-be189bdb-25ea-441c-ae93-49fcda392d8b tempest-TestShelveInstance-772359569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:34:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-540bb34d-ced5-442c-afc4-938388e75ae8 req-be189bdb-25ea-441c-ae93-49fcda392d8b tempest-TestShelveInstance-772359569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.010s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:34:57 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-540bb34d-ced5-442c-afc4-938388e75ae8 req-be189bdb-25ea-441c-ae93-49fcda392d8b tempest-TestShelveInstance-772359569 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a', 'name': 'volume-333eafd6-1a8c-4d22-9cec-0494b9ee19c0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5fa943aa-6845-433e-b6c9-1c3aac595aa3', 'enforce_multipath': True} {{(pid=86082) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 15 16:34:57 devstack cinder-volume[86082]: INFO cinder.volume.manager [req-540bb34d-ced5-442c-afc4-938388e75ae8 req-be189bdb-25ea-441c-ae93-49fcda392d8b tempest-TestShelveInstance-772359569 None] attachment_update completed successfully. Sep 15 16:34:59 devstack cinder-volume[86082]: DEBUG oslo_service.periodic_task [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86082) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 15 16:34:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:34:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:34:59 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:34:59 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:34:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:34:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:34:59 devstack sudo[104110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:34:59 devstack sudo[104110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:35:00 devstack sudo[104110]: pam_unix(sudo:session): session closed for user root Sep 15 16:35:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.347s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:35:00 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:35:00 devstack cinder-volume[86082]: DEBUG oslo_service.periodic_task [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Running periodic task VolumeManager._thread_info {{(pid=86082) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 15 16:35:00 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] thread count: 28 {{(pid=86082) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 15 16:35:00 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] thread info: [<_MainThread(MainThread, started 124875935469696)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86082) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 15 16:35:07 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 16:35:07 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 16:35:26 devstack cinder-volume[86082]: INFO cinder.volume.manager [req-7432ccc1-8cf2-482a-929a-a24b0524c7aa req-594e830c-9392-46d2-b523-7957c90fed4c tempest-TestShelveInstance-772359569 None] Terminate volume connection completed successfully. Sep 15 16:35:26 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-7432ccc1-8cf2-482a-929a-a24b0524c7aa req-594e830c-9392-46d2-b523-7957c90fed4c tempest-TestShelveInstance-772359569 None] Deleting attachment 5fa943aa-6845-433e-b6c9-1c3aac595aa3. {{(pid=86082) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 15 16:35:26 devstack cinder-volume[86082]: DEBUG cinder.coordination [req-7432ccc1-8cf2-482a-929a-a24b0524c7aa req-42cf0279-2e3c-45b0-ba8d-3e5633c66a9c tempest-TestShelveInstance-772359569 None] Acquiring lock "cinder-333eafd6-1a8c-4d22-9cec-0494b9ee19c0-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:35:26 devstack cinder-volume[86082]: DEBUG cinder.coordination [req-7432ccc1-8cf2-482a-929a-a24b0524c7aa req-42cf0279-2e3c-45b0-ba8d-3e5633c66a9c tempest-TestShelveInstance-772359569 None] Lock "cinder-333eafd6-1a8c-4d22-9cec-0494b9ee19c0-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:35:26 devstack cinder-volume[86082]: DEBUG cinder.coordination [req-7432ccc1-8cf2-482a-929a-a24b0524c7aa req-42cf0279-2e3c-45b0-ba8d-3e5633c66a9c tempest-TestShelveInstance-772359569 None] Acquiring lock "cinder-quobyte-333eafd6-1a8c-4d22-9cec-0494b9ee19c0" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:35:26 devstack cinder-volume[86082]: DEBUG cinder.coordination [req-7432ccc1-8cf2-482a-929a-a24b0524c7aa req-42cf0279-2e3c-45b0-ba8d-3e5633c66a9c tempest-TestShelveInstance-772359569 None] Lock "cinder-quobyte-333eafd6-1a8c-4d22-9cec-0494b9ee19c0" acquired by "delete_volume" :: waited 0.019s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:35:26 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[5680711c-1a36-4c2f-87ba-6e75d2f8eaec]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:35:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [req-7432ccc1-8cf2-482a-929a-a24b0524c7aa req-42cf0279-2e3c-45b0-ba8d-3e5633c66a9c tempest-TestShelveInstance-772359569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-333eafd6-1a8c-4d22-9cec-0494b9ee19c0 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:35:26 devstack sudo[104568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-333eafd6-1a8c-4d22-9cec-0494b9ee19c0 Sep 15 16:35:26 devstack sudo[104568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:35:26 devstack sudo[104568]: pam_unix(sudo:session): session closed for user root Sep 15 16:35:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [req-7432ccc1-8cf2-482a-929a-a24b0524c7aa req-42cf0279-2e3c-45b0-ba8d-3e5633c66a9c tempest-TestShelveInstance-772359569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-333eafd6-1a8c-4d22-9cec-0494b9ee19c0" returned: 0 in 0.394s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:35:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [req-7432ccc1-8cf2-482a-929a-a24b0524c7aa req-42cf0279-2e3c-45b0-ba8d-3e5633c66a9c tempest-TestShelveInstance-772359569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-333eafd6-1a8c-4d22-9cec-0494b9ee19c0 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:35:27 devstack sudo[104574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-333eafd6-1a8c-4d22-9cec-0494b9ee19c0 Sep 15 16:35:27 devstack sudo[104574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:35:27 devstack sudo[104574]: pam_unix(sudo:session): session closed for user root Sep 15 16:35:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [req-7432ccc1-8cf2-482a-929a-a24b0524c7aa req-42cf0279-2e3c-45b0-ba8d-3e5633c66a9c tempest-TestShelveInstance-772359569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-333eafd6-1a8c-4d22-9cec-0494b9ee19c0" returned: 0 in 0.249s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:35:27 devstack cinder-volume[86082]: DEBUG cinder.coordination [req-7432ccc1-8cf2-482a-929a-a24b0524c7aa req-42cf0279-2e3c-45b0-ba8d-3e5633c66a9c tempest-TestShelveInstance-772359569 None] Lock "cinder-quobyte-333eafd6-1a8c-4d22-9cec-0494b9ee19c0" released by "delete_volume" :: held 0.691s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:35:27 devstack cinder-volume[86082]: DEBUG cinder.quota [req-7432ccc1-8cf2-482a-929a-a24b0524c7aa req-42cf0279-2e3c-45b0-ba8d-3e5633c66a9c tempest-TestShelveInstance-772359569 None] Created reservations ['a5f66a63-1098-43a5-a342-8f6dce747dee', '39ac1354-764e-4a07-8acb-08992f6d91f8', 'c7bd77a9-e208-4732-9c41-8ab64951869c', 'd9f669c8-b912-4622-a27b-d9705e8672a1'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:35:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-7432ccc1-8cf2-482a-929a-a24b0524c7aa req-42cf0279-2e3c-45b0-ba8d-3e5633c66a9c tempest-TestShelveInstance-772359569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:35:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-7432ccc1-8cf2-482a-929a-a24b0524c7aa req-42cf0279-2e3c-45b0-ba8d-3e5633c66a9c tempest-TestShelveInstance-772359569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:35:27 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [req-7432ccc1-8cf2-482a-929a-a24b0524c7aa req-42cf0279-2e3c-45b0-ba8d-3e5633c66a9c tempest-TestShelveInstance-772359569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:35:27 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [req-7432ccc1-8cf2-482a-929a-a24b0524c7aa req-42cf0279-2e3c-45b0-ba8d-3e5633c66a9c tempest-TestShelveInstance-772359569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:35:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-7432ccc1-8cf2-482a-929a-a24b0524c7aa req-42cf0279-2e3c-45b0-ba8d-3e5633c66a9c tempest-TestShelveInstance-772359569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:35:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [req-7432ccc1-8cf2-482a-929a-a24b0524c7aa req-42cf0279-2e3c-45b0-ba8d-3e5633c66a9c tempest-TestShelveInstance-772359569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:35:27 devstack sudo[104577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:35:27 devstack sudo[104577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:35:27 devstack sudo[104577]: pam_unix(sudo:session): session closed for user root Sep 15 16:35:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [req-7432ccc1-8cf2-482a-929a-a24b0524c7aa req-42cf0279-2e3c-45b0-ba8d-3e5633c66a9c tempest-TestShelveInstance-772359569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.256s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:35:27 devstack cinder-volume[86082]: DEBUG cinder.manager [req-7432ccc1-8cf2-482a-929a-a24b0524c7aa req-42cf0279-2e3c-45b0-ba8d-3e5633c66a9c tempest-TestShelveInstance-772359569 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:35:27 devstack cinder-volume[86082]: INFO cinder.volume.manager [req-7432ccc1-8cf2-482a-929a-a24b0524c7aa req-42cf0279-2e3c-45b0-ba8d-3e5633c66a9c tempest-TestShelveInstance-772359569 None] Deleted volume successfully. Sep 15 16:35:27 devstack cinder-volume[86082]: DEBUG cinder.coordination [req-7432ccc1-8cf2-482a-929a-a24b0524c7aa req-42cf0279-2e3c-45b0-ba8d-3e5633c66a9c tempest-TestShelveInstance-772359569 None] Lock "cinder-333eafd6-1a8c-4d22-9cec-0494b9ee19c0-delete_volume" released by "delete_volume" :: held 1.140s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:35:37 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:SELECT=6,cinder:INSERT=2,cinder:UPDATE=7 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 16:35:37 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:SELECT=6,cinder:UPDATE=9,cinder:INSERT=2,cinder:DELETE=1 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 16:35:51 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:SELECT=1 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 16:35:51 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:UPDATE=1 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 16:35:58 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1574038-5a82-4388-acfa-ef06a9a57cd0 tempest-TestImageHashVerification-1285557730 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:35:58 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f1574038-5a82-4388-acfa-ef06a9a57cd0 tempest-TestImageHashVerification-1285557730 None] Flow 'volume_create_manager' (141fc773-4770-47de-ac43-b690b249f7d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:35:58 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f1574038-5a82-4388-acfa-ef06a9a57cd0 tempest-TestImageHashVerification-1285557730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (298cefbf-cb48-42aa-9161-899954ed6bab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:35:58 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f1574038-5a82-4388-acfa-ef06a9a57cd0 tempest-TestImageHashVerification-1285557730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (298cefbf-cb48-42aa-9161-899954ed6bab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:35:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-182845577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b8349f9-0145-418f-a6cc-7ff4fac8381c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3042ecb869924831856d851786a50c85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:35:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:35:58Z,use_quota=True,user_id='9838d7a11d9f4df5b27be8b72ffd577c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:35:58 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f1574038-5a82-4388-acfa-ef06a9a57cd0 tempest-TestImageHashVerification-1285557730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49ab663d-6deb-4d3d-9a24-d716c0e23f30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:35:58 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f1574038-5a82-4388-acfa-ef06a9a57cd0 tempest-TestImageHashVerification-1285557730 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49ab663d-6deb-4d3d-9a24-d716c0e23f30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:35:58 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f1574038-5a82-4388-acfa-ef06a9a57cd0 tempest-TestImageHashVerification-1285557730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5e11547-4038-471f-b9d1-509af31c0be3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:35:58 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f1574038-5a82-4388-acfa-ef06a9a57cd0 tempest-TestImageHashVerification-1285557730 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5e11547-4038-471f-b9d1-509af31c0be3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b8349f9-0145-418f-a6cc-7ff4fac8381c', 'volume_name': 'volume-0b8349f9-0145-418f-a6cc-7ff4fac8381c', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:35:58 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f1574038-5a82-4388-acfa-ef06a9a57cd0 tempest-TestImageHashVerification-1285557730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9186d559-32a6-461a-b365-41764ba48a60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:35:58 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f1574038-5a82-4388-acfa-ef06a9a57cd0 tempest-TestImageHashVerification-1285557730 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9186d559-32a6-461a-b365-41764ba48a60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:35:58 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f1574038-5a82-4388-acfa-ef06a9a57cd0 tempest-TestImageHashVerification-1285557730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5376286-3b11-4917-a25b-2a20d1cc3d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:35:58 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-f1574038-5a82-4388-acfa-ef06a9a57cd0 tempest-TestImageHashVerification-1285557730 None] Volume 0b8349f9-0145-418f-a6cc-7ff4fac8381c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b8349f9-0145-418f-a6cc-7ff4fac8381c', 'volume_size': 1} Sep 15 16:35:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f1574038-5a82-4388-acfa-ef06a9a57cd0 tempest-TestImageHashVerification-1285557730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:35:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f1574038-5a82-4388-acfa-ef06a9a57cd0 tempest-TestImageHashVerification-1285557730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:35:58 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-f1574038-5a82-4388-acfa-ef06a9a57cd0 tempest-TestImageHashVerification-1285557730 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:35:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-182845577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b8349f9-0145-418f-a6cc-7ff4fac8381c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3042ecb869924831856d851786a50c85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:35:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:35:58Z,use_quota=True,user_id='9838d7a11d9f4df5b27be8b72ffd577c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:35:58 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-f1574038-5a82-4388-acfa-ef06a9a57cd0 tempest-TestImageHashVerification-1285557730 None] Creating volume 0b8349f9-0145-418f-a6cc-7ff4fac8381c {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:35:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f1574038-5a82-4388-acfa-ef06a9a57cd0 tempest-TestImageHashVerification-1285557730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:35:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f1574038-5a82-4388-acfa-ef06a9a57cd0 tempest-TestImageHashVerification-1285557730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:35:58 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-f1574038-5a82-4388-acfa-ef06a9a57cd0 tempest-TestImageHashVerification-1285557730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:35:58 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-f1574038-5a82-4388-acfa-ef06a9a57cd0 tempest-TestImageHashVerification-1285557730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:35:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f1574038-5a82-4388-acfa-ef06a9a57cd0 tempest-TestImageHashVerification-1285557730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:35:58 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-f1574038-5a82-4388-acfa-ef06a9a57cd0 tempest-TestImageHashVerification-1285557730 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:35:58 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-f1574038-5a82-4388-acfa-ef06a9a57cd0 tempest-TestImageHashVerification-1285557730 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:35:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f1574038-5a82-4388-acfa-ef06a9a57cd0 tempest-TestImageHashVerification-1285557730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0b8349f9-0145-418f-a6cc-7ff4fac8381c 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:35:58 devstack sudo[104600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0b8349f9-0145-418f-a6cc-7ff4fac8381c 1073741824 Sep 15 16:35:58 devstack sudo[104600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:35:58 devstack sudo[104600]: pam_unix(sudo:session): session closed for user root Sep 15 16:35:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f1574038-5a82-4388-acfa-ef06a9a57cd0 tempest-TestImageHashVerification-1285557730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0b8349f9-0145-418f-a6cc-7ff4fac8381c 1073741824" returned: 0 in 0.427s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:35:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f1574038-5a82-4388-acfa-ef06a9a57cd0 tempest-TestImageHashVerification-1285557730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0b8349f9-0145-418f-a6cc-7ff4fac8381c {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:35:58 devstack sudo[104606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0b8349f9-0145-418f-a6cc-7ff4fac8381c Sep 15 16:35:58 devstack sudo[104606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:35:58 devstack sudo[104606]: pam_unix(sudo:session): session closed for user root Sep 15 16:35:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f1574038-5a82-4388-acfa-ef06a9a57cd0 tempest-TestImageHashVerification-1285557730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0b8349f9-0145-418f-a6cc-7ff4fac8381c" returned: 0 in 0.247s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:35:58 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-f1574038-5a82-4388-acfa-ef06a9a57cd0 tempest-TestImageHashVerification-1285557730 None] <== create_volume: return (722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:35:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f1574038-5a82-4388-acfa-ef06a9a57cd0 tempest-TestImageHashVerification-1285557730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.724s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:35:58 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f1574038-5a82-4388-acfa-ef06a9a57cd0 tempest-TestImageHashVerification-1285557730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5376286-3b11-4917-a25b-2a20d1cc3d9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b8349f9-0145-418f-a6cc-7ff4fac8381c', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:35:58 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f1574038-5a82-4388-acfa-ef06a9a57cd0 tempest-TestImageHashVerification-1285557730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a00ffad-3a64-4ecb-a265-0a3c60b4c9f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:35:58 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-f1574038-5a82-4388-acfa-ef06a9a57cd0 tempest-TestImageHashVerification-1285557730 None] Volume volume-0b8349f9-0145-418f-a6cc-7ff4fac8381c (0b8349f9-0145-418f-a6cc-7ff4fac8381c): created successfully Sep 15 16:35:58 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f1574038-5a82-4388-acfa-ef06a9a57cd0 tempest-TestImageHashVerification-1285557730 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a00ffad-3a64-4ecb-a265-0a3c60b4c9f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:35:58 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f1574038-5a82-4388-acfa-ef06a9a57cd0 tempest-TestImageHashVerification-1285557730 None] Flow 'volume_create_manager' (141fc773-4770-47de-ac43-b690b249f7d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:35:58 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-f1574038-5a82-4388-acfa-ef06a9a57cd0 tempest-TestImageHashVerification-1285557730 None] Created volume successfully. Sep 15 16:35:59 devstack cinder-volume[86082]: DEBUG oslo_service.periodic_task [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86082) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 15 16:35:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:35:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:35:59 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:35:59 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:35:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:35:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:35:59 devstack sudo[104609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:35:59 devstack sudo[104609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:36:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-7d942caf-34ef-42a5-9679-f7c23c6cabb9 tempest-TestImageHashVerification-1285557730 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:36:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-7d942caf-34ef-42a5-9679-f7c23c6cabb9 tempest-TestImageHashVerification-1285557730 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:36:00 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0cb69c9-351c-4e25-8a4c-e8ec28fa805c]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:36:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7d942caf-34ef-42a5-9679-f7c23c6cabb9 tempest-TestImageHashVerification-1285557730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0b8349f9-0145-418f-a6cc-7ff4fac8381c {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:36:00 devstack sudo[104609]: pam_unix(sudo:session): session closed for user root Sep 15 16:36:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.259s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:36:00 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:36:00 devstack cinder-volume[86082]: DEBUG oslo_service.periodic_task [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Running periodic task VolumeManager._thread_info {{(pid=86082) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 15 16:36:00 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] thread count: 28 {{(pid=86082) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 15 16:36:00 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] thread info: [<_MainThread(MainThread, started 124875935469696)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86082) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 15 16:36:00 devstack sudo[104611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0b8349f9-0145-418f-a6cc-7ff4fac8381c Sep 15 16:36:00 devstack sudo[104611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:36:00 devstack sudo[104611]: pam_unix(sudo:session): session closed for user root Sep 15 16:36:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7d942caf-34ef-42a5-9679-f7c23c6cabb9 tempest-TestImageHashVerification-1285557730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0b8349f9-0145-418f-a6cc-7ff4fac8381c" returned: 0 in 0.362s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:36:00 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[70bff672-bd43-4347-a6d4-413a7daf2b74]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:36:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7d942caf-34ef-42a5-9679-f7c23c6cabb9 tempest-TestImageHashVerification-1285557730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0b8349f9-0145-418f-a6cc-7ff4fac8381c {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:36:00 devstack sudo[104617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0b8349f9-0145-418f-a6cc-7ff4fac8381c Sep 15 16:36:00 devstack sudo[104617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:36:00 devstack sudo[104617]: pam_unix(sudo:session): session closed for user root Sep 15 16:36:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7d942caf-34ef-42a5-9679-f7c23c6cabb9 tempest-TestImageHashVerification-1285557730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0b8349f9-0145-418f-a6cc-7ff4fac8381c" returned: 0 in 0.357s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:36:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7d942caf-34ef-42a5-9679-f7c23c6cabb9 tempest-TestImageHashVerification-1285557730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0b8349f9-0145-418f-a6cc-7ff4fac8381c /opt/stack/data/cinder/conversion/0b8349f9-0145-418f-a6cc-7ff4fac8381c.temp_image.30c1987f-63a1-471d-9796-ee763ac11098012mfnjo.img {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:36:00 devstack sudo[104622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0b8349f9-0145-418f-a6cc-7ff4fac8381c /opt/stack/data/cinder/conversion/0b8349f9-0145-418f-a6cc-7ff4fac8381c.temp_image.30c1987f-63a1-471d-9796-ee763ac11098012mfnjo.img Sep 15 16:36:00 devstack sudo[104622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:36:06 devstack sudo[104622]: pam_unix(sudo:session): session closed for user root Sep 15 16:36:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7d942caf-34ef-42a5-9679-f7c23c6cabb9 tempest-TestImageHashVerification-1285557730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0b8349f9-0145-418f-a6cc-7ff4fac8381c /opt/stack/data/cinder/conversion/0b8349f9-0145-418f-a6cc-7ff4fac8381c.temp_image.30c1987f-63a1-471d-9796-ee763ac11098012mfnjo.img" returned: 0 in 5.788s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:36:06 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1c2ebe1-a685-49bf-a6b1-747e0df28e31]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:36:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7d942caf-34ef-42a5-9679-f7c23c6cabb9 tempest-TestImageHashVerification-1285557730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0b8349f9-0145-418f-a6cc-7ff4fac8381c {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:36:06 devstack sudo[104636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0b8349f9-0145-418f-a6cc-7ff4fac8381c Sep 15 16:36:06 devstack sudo[104636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:36:07 devstack sudo[104636]: pam_unix(sudo:session): session closed for user root Sep 15 16:36:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7d942caf-34ef-42a5-9679-f7c23c6cabb9 tempest-TestImageHashVerification-1285557730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0b8349f9-0145-418f-a6cc-7ff4fac8381c" returned: 0 in 0.532s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:36:07 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-7d942caf-34ef-42a5-9679-f7c23c6cabb9 tempest-TestImageHashVerification-1285557730 None] Image conversion details: src /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0b8349f9-0145-418f-a6cc-7ff4fac8381c, size 1024.00 MB, duration 5.79 sec, destination /opt/stack/data/cinder/conversion/0b8349f9-0145-418f-a6cc-7ff4fac8381c.temp_image.30c1987f-63a1-471d-9796-ee763ac11098012mfnjo.img {{(pid=86082) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 15 16:36:07 devstack cinder-volume[86082]: INFO cinder.image.image_utils [None req-7d942caf-34ef-42a5-9679-f7c23c6cabb9 tempest-TestImageHashVerification-1285557730 None] Converted 1024.00 MB image at 176.89 MB/s Sep 15 16:36:07 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-7d942caf-34ef-42a5-9679-f7c23c6cabb9 tempest-TestImageHashVerification-1285557730 None] 30c1987f-63a1-471d-9796-ee763ac11098 was raw, no need to convert to raw {{(pid=86082) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 15 16:36:17 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:SELECT=4,cinder:UPDATE=3,cinder:INSERT=1 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 16:36:17 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:UPDATE=3,cinder:SELECT=3,cinder:DELETE=1 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 16:36:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-7d942caf-34ef-42a5-9679-f7c23c6cabb9 tempest-TestImageHashVerification-1285557730 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 24.953s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:36:24 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7d942caf-34ef-42a5-9679-f7c23c6cabb9 tempest-TestImageHashVerification-1285557730 None] Uploaded volume to glance image-id: 30c1987f-63a1-471d-9796-ee763ac11098. {{(pid=86082) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 15 16:36:24 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-7d942caf-34ef-42a5-9679-f7c23c6cabb9 tempest-TestImageHashVerification-1285557730 None] Copy volume to image completed successfully. Sep 15 16:36:26 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-68bb342b-08be-4345-987a-eed613fc82ea tempest-TestImageHashVerification-1285557730 None] Acquiring lock "cinder-0b8349f9-0145-418f-a6cc-7ff4fac8381c-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:36:26 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-68bb342b-08be-4345-987a-eed613fc82ea tempest-TestImageHashVerification-1285557730 None] Lock "cinder-0b8349f9-0145-418f-a6cc-7ff4fac8381c-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:36:26 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-68bb342b-08be-4345-987a-eed613fc82ea tempest-TestImageHashVerification-1285557730 None] Acquiring lock "cinder-quobyte-0b8349f9-0145-418f-a6cc-7ff4fac8381c" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:36:26 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-68bb342b-08be-4345-987a-eed613fc82ea tempest-TestImageHashVerification-1285557730 None] Lock "cinder-quobyte-0b8349f9-0145-418f-a6cc-7ff4fac8381c" acquired by "delete_volume" :: waited 0.016s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:36:26 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbda4357-0e64-47a0-9578-3cfdc10e3bcb]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:36:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-68bb342b-08be-4345-987a-eed613fc82ea tempest-TestImageHashVerification-1285557730 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0b8349f9-0145-418f-a6cc-7ff4fac8381c {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:36:26 devstack sudo[104679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0b8349f9-0145-418f-a6cc-7ff4fac8381c Sep 15 16:36:26 devstack sudo[104679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:36:26 devstack sudo[104679]: pam_unix(sudo:session): session closed for user root Sep 15 16:36:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-68bb342b-08be-4345-987a-eed613fc82ea tempest-TestImageHashVerification-1285557730 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0b8349f9-0145-418f-a6cc-7ff4fac8381c" returned: 0 in 0.353s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:36:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-68bb342b-08be-4345-987a-eed613fc82ea tempest-TestImageHashVerification-1285557730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0b8349f9-0145-418f-a6cc-7ff4fac8381c {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:36:26 devstack sudo[104684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0b8349f9-0145-418f-a6cc-7ff4fac8381c Sep 15 16:36:26 devstack sudo[104684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:36:27 devstack sudo[104684]: pam_unix(sudo:session): session closed for user root Sep 15 16:36:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-68bb342b-08be-4345-987a-eed613fc82ea tempest-TestImageHashVerification-1285557730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0b8349f9-0145-418f-a6cc-7ff4fac8381c" returned: 0 in 0.235s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:36:27 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-68bb342b-08be-4345-987a-eed613fc82ea tempest-TestImageHashVerification-1285557730 None] Lock "cinder-quobyte-0b8349f9-0145-418f-a6cc-7ff4fac8381c" released by "delete_volume" :: held 0.625s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:36:27 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-68bb342b-08be-4345-987a-eed613fc82ea tempest-TestImageHashVerification-1285557730 None] Created reservations ['baab05e4-0464-4ba2-916a-e0bd0d98cf2e', 'cd74375f-83ed-4f05-b523-2f1186f5aca9', 'c751ed7d-1e54-4826-9fd1-88cad17f119a', 'df1fa3ae-dda6-411b-8395-bca227269ffb'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:36:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-68bb342b-08be-4345-987a-eed613fc82ea tempest-TestImageHashVerification-1285557730 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:36:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-68bb342b-08be-4345-987a-eed613fc82ea tempest-TestImageHashVerification-1285557730 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:36:27 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-68bb342b-08be-4345-987a-eed613fc82ea tempest-TestImageHashVerification-1285557730 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:36:27 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-68bb342b-08be-4345-987a-eed613fc82ea tempest-TestImageHashVerification-1285557730 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:36:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-68bb342b-08be-4345-987a-eed613fc82ea tempest-TestImageHashVerification-1285557730 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:36:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-68bb342b-08be-4345-987a-eed613fc82ea tempest-TestImageHashVerification-1285557730 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:36:27 devstack sudo[104688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:36:27 devstack sudo[104688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:36:27 devstack sudo[104688]: pam_unix(sudo:session): session closed for user root Sep 15 16:36:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-68bb342b-08be-4345-987a-eed613fc82ea tempest-TestImageHashVerification-1285557730 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.240s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:36:27 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-68bb342b-08be-4345-987a-eed613fc82ea tempest-TestImageHashVerification-1285557730 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:36:27 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-68bb342b-08be-4345-987a-eed613fc82ea tempest-TestImageHashVerification-1285557730 None] Deleted volume successfully. Sep 15 16:36:27 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-68bb342b-08be-4345-987a-eed613fc82ea tempest-TestImageHashVerification-1285557730 None] Lock "cinder-0b8349f9-0145-418f-a6cc-7ff4fac8381c-delete_volume" released by "delete_volume" :: held 1.046s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:36:37 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:SELECT=6,cinder:UPDATE=10,cinder:INSERT=1 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 16:36:37 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:SELECT=5,cinder:UPDATE=7,cinder:INSERT=3,cinder:DELETE=1 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 16:36:58 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-09a690f1-e62d-4dba-aac1-cb40016d0565 tempest-TestStampPattern-2006421157 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:36:58 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-09a690f1-e62d-4dba-aac1-cb40016d0565 tempest-TestStampPattern-2006421157 None] Flow 'volume_create_manager' (cfa79373-3a75-4b13-a49e-1b7fbc0688ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:36:58 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-09a690f1-e62d-4dba-aac1-cb40016d0565 tempest-TestStampPattern-2006421157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fe8f7d3-eddb-49f7-a2f0-9f6b81df582b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:36:58 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-09a690f1-e62d-4dba-aac1-cb40016d0565 tempest-TestStampPattern-2006421157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fe8f7d3-eddb-49f7-a2f0-9f6b81df582b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:36:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1266592230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a80d3fc2-5596-4d40-883c-299ae83ece80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9496d0e68704b6ca75f52650153cd2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:36:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:36:59Z,use_quota=True,user_id='43a5936967b04c33a2d450bf87b43ca4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:36:58 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-09a690f1-e62d-4dba-aac1-cb40016d0565 tempest-TestStampPattern-2006421157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02a8ffde-0205-489e-954b-6b1dc633d6f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:36:58 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-09a690f1-e62d-4dba-aac1-cb40016d0565 tempest-TestStampPattern-2006421157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02a8ffde-0205-489e-954b-6b1dc633d6f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:36:58 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-09a690f1-e62d-4dba-aac1-cb40016d0565 tempest-TestStampPattern-2006421157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c38088f-42cc-4a9d-ae71-4991d7c5df9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:36:58 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-09a690f1-e62d-4dba-aac1-cb40016d0565 tempest-TestStampPattern-2006421157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c38088f-42cc-4a9d-ae71-4991d7c5df9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a80d3fc2-5596-4d40-883c-299ae83ece80', 'volume_name': 'volume-a80d3fc2-5596-4d40-883c-299ae83ece80', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:36:58 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-09a690f1-e62d-4dba-aac1-cb40016d0565 tempest-TestStampPattern-2006421157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10dc0ffb-70f6-4ba8-acdb-b47a67e731f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:36:58 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-09a690f1-e62d-4dba-aac1-cb40016d0565 tempest-TestStampPattern-2006421157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10dc0ffb-70f6-4ba8-acdb-b47a67e731f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:36:58 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-09a690f1-e62d-4dba-aac1-cb40016d0565 tempest-TestStampPattern-2006421157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (417734d5-c923-440e-9e01-ffa12f0f7255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:36:58 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-09a690f1-e62d-4dba-aac1-cb40016d0565 tempest-TestStampPattern-2006421157 None] Volume a80d3fc2-5596-4d40-883c-299ae83ece80: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a80d3fc2-5596-4d40-883c-299ae83ece80', 'volume_size': 1} Sep 15 16:36:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-09a690f1-e62d-4dba-aac1-cb40016d0565 tempest-TestStampPattern-2006421157 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:36:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-09a690f1-e62d-4dba-aac1-cb40016d0565 tempest-TestStampPattern-2006421157 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:36:58 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-09a690f1-e62d-4dba-aac1-cb40016d0565 tempest-TestStampPattern-2006421157 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:36:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1266592230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a80d3fc2-5596-4d40-883c-299ae83ece80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9496d0e68704b6ca75f52650153cd2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:36:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:36:59Z,use_quota=True,user_id='43a5936967b04c33a2d450bf87b43ca4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:36:58 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-09a690f1-e62d-4dba-aac1-cb40016d0565 tempest-TestStampPattern-2006421157 None] Creating volume a80d3fc2-5596-4d40-883c-299ae83ece80 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:36:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-09a690f1-e62d-4dba-aac1-cb40016d0565 tempest-TestStampPattern-2006421157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:36:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-09a690f1-e62d-4dba-aac1-cb40016d0565 tempest-TestStampPattern-2006421157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:36:58 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-09a690f1-e62d-4dba-aac1-cb40016d0565 tempest-TestStampPattern-2006421157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:36:58 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-09a690f1-e62d-4dba-aac1-cb40016d0565 tempest-TestStampPattern-2006421157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:36:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-09a690f1-e62d-4dba-aac1-cb40016d0565 tempest-TestStampPattern-2006421157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:36:58 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-09a690f1-e62d-4dba-aac1-cb40016d0565 tempest-TestStampPattern-2006421157 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:36:58 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-09a690f1-e62d-4dba-aac1-cb40016d0565 tempest-TestStampPattern-2006421157 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:36:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-09a690f1-e62d-4dba-aac1-cb40016d0565 tempest-TestStampPattern-2006421157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a80d3fc2-5596-4d40-883c-299ae83ece80 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:36:59 devstack sudo[104712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a80d3fc2-5596-4d40-883c-299ae83ece80 1073741824 Sep 15 16:36:59 devstack sudo[104712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:36:59 devstack sudo[104712]: pam_unix(sudo:session): session closed for user root Sep 15 16:36:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-09a690f1-e62d-4dba-aac1-cb40016d0565 tempest-TestStampPattern-2006421157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a80d3fc2-5596-4d40-883c-299ae83ece80 1073741824" returned: 0 in 0.488s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:36:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-09a690f1-e62d-4dba-aac1-cb40016d0565 tempest-TestStampPattern-2006421157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a80d3fc2-5596-4d40-883c-299ae83ece80 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:36:59 devstack sudo[104718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a80d3fc2-5596-4d40-883c-299ae83ece80 Sep 15 16:36:59 devstack sudo[104718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:36:59 devstack sudo[104718]: pam_unix(sudo:session): session closed for user root Sep 15 16:36:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-09a690f1-e62d-4dba-aac1-cb40016d0565 tempest-TestStampPattern-2006421157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a80d3fc2-5596-4d40-883c-299ae83ece80" returned: 0 in 0.269s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:36:59 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-09a690f1-e62d-4dba-aac1-cb40016d0565 tempest-TestStampPattern-2006421157 None] <== create_volume: return (803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:36:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-09a690f1-e62d-4dba-aac1-cb40016d0565 tempest-TestStampPattern-2006421157 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.806s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:36:59 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-09a690f1-e62d-4dba-aac1-cb40016d0565 tempest-TestStampPattern-2006421157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (417734d5-c923-440e-9e01-ffa12f0f7255) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a80d3fc2-5596-4d40-883c-299ae83ece80', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:36:59 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-09a690f1-e62d-4dba-aac1-cb40016d0565 tempest-TestStampPattern-2006421157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9aa6155-1dea-4545-833f-f4c27c83640a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:36:59 devstack cinder-volume[86082]: DEBUG oslo_service.periodic_task [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86082) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 15 16:36:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:36:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:36:59 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:36:59 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:36:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:36:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:36:59 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-09a690f1-e62d-4dba-aac1-cb40016d0565 tempest-TestStampPattern-2006421157 None] Volume volume-a80d3fc2-5596-4d40-883c-299ae83ece80 (a80d3fc2-5596-4d40-883c-299ae83ece80): created successfully Sep 15 16:36:59 devstack sudo[104724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:36:59 devstack sudo[104724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:36:59 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-09a690f1-e62d-4dba-aac1-cb40016d0565 tempest-TestStampPattern-2006421157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b9aa6155-1dea-4545-833f-f4c27c83640a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:36:59 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-09a690f1-e62d-4dba-aac1-cb40016d0565 tempest-TestStampPattern-2006421157 None] Flow 'volume_create_manager' (cfa79373-3a75-4b13-a49e-1b7fbc0688ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:36:59 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-09a690f1-e62d-4dba-aac1-cb40016d0565 tempest-TestStampPattern-2006421157 None] Created volume successfully. Sep 15 16:37:00 devstack sudo[104724]: pam_unix(sudo:session): session closed for user root Sep 15 16:37:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.267s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:37:00 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:37:00 devstack cinder-volume[86082]: DEBUG oslo_service.periodic_task [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Running periodic task VolumeManager._thread_info {{(pid=86082) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 15 16:37:00 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] thread count: 28 {{(pid=86082) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 15 16:37:00 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] thread info: [<_MainThread(MainThread, started 124875935469696)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86082) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 15 16:37:09 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:SELECT=3,cinder:UPDATE=3 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 16:37:09 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:UPDATE=3,cinder:SELECT=1,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 16:37:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-795e3d6b-de88-4d2a-9446-470f99e116df req-666fce34-43b6-46db-a22d-fa82d061feae tempest-TestStampPattern-2006421157 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:37:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-795e3d6b-de88-4d2a-9446-470f99e116df req-666fce34-43b6-46db-a22d-fa82d061feae tempest-TestStampPattern-2006421157 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:37:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-795e3d6b-de88-4d2a-9446-470f99e116df req-666fce34-43b6-46db-a22d-fa82d061feae tempest-TestStampPattern-2006421157 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:37:28 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-795e3d6b-de88-4d2a-9446-470f99e116df req-666fce34-43b6-46db-a22d-fa82d061feae tempest-TestStampPattern-2006421157 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a', 'name': 'volume-a80d3fc2-5596-4d40-883c-299ae83ece80', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '97c9fac6-d308-46fe-96ac-879feeea7d06', 'enforce_multipath': True} {{(pid=86082) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 15 16:37:28 devstack cinder-volume[86082]: INFO cinder.volume.manager [req-795e3d6b-de88-4d2a-9446-470f99e116df req-666fce34-43b6-46db-a22d-fa82d061feae tempest-TestStampPattern-2006421157 None] attachment_update completed successfully. Sep 15 16:37:32 devstack cinder-volume[86082]: INFO cinder.volume.manager [req-84957063-0dc5-476c-9e0a-43f89fe71247 req-72ad67b8-4db4-4d87-9b0f-062a84146b3b tempest-TestStampPattern-2006421157 None] Terminate volume connection completed successfully. Sep 15 16:37:32 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-84957063-0dc5-476c-9e0a-43f89fe71247 req-72ad67b8-4db4-4d87-9b0f-062a84146b3b tempest-TestStampPattern-2006421157 None] Deleting attachment 97c9fac6-d308-46fe-96ac-879feeea7d06. {{(pid=86082) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 15 16:37:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-089155e9-e6b6-441d-84f0-221332a288e5 tempest-TestStampPattern-2006421157 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:37:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-089155e9-e6b6-441d-84f0-221332a288e5 tempest-TestStampPattern-2006421157 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:37:33 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-089155e9-e6b6-441d-84f0-221332a288e5 tempest-TestStampPattern-2006421157 None] Creating offline snapshot 25f80510-4b01-4208-884c-659f1d76722a of volume a80d3fc2-5596-4d40-883c-299ae83ece80 {{(pid=86082) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 15 16:37:33 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[652e207a-3401-40b4-866f-4cdba7cc7b2d]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:37:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-089155e9-e6b6-441d-84f0-221332a288e5 tempest-TestStampPattern-2006421157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a80d3fc2-5596-4d40-883c-299ae83ece80 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:37:34 devstack sudo[105355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a80d3fc2-5596-4d40-883c-299ae83ece80 Sep 15 16:37:34 devstack sudo[105355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:37:34 devstack sudo[105355]: pam_unix(sudo:session): session closed for user root Sep 15 16:37:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-089155e9-e6b6-441d-84f0-221332a288e5 tempest-TestStampPattern-2006421157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a80d3fc2-5596-4d40-883c-299ae83ece80" returned: 0 in 0.362s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:37:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-089155e9-e6b6-441d-84f0-221332a288e5 tempest-TestStampPattern-2006421157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a80d3fc2-5596-4d40-883c-299ae83ece80,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a80d3fc2-5596-4d40-883c-299ae83ece80.25f80510-4b01-4208-884c-659f1d76722a 1G {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:37:34 devstack sudo[105360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a80d3fc2-5596-4d40-883c-299ae83ece80,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a80d3fc2-5596-4d40-883c-299ae83ece80.25f80510-4b01-4208-884c-659f1d76722a 1G Sep 15 16:37:34 devstack sudo[105360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:37:34 devstack sudo[105360]: pam_unix(sudo:session): session closed for user root Sep 15 16:37:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-089155e9-e6b6-441d-84f0-221332a288e5 tempest-TestStampPattern-2006421157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a80d3fc2-5596-4d40-883c-299ae83ece80,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a80d3fc2-5596-4d40-883c-299ae83ece80.25f80510-4b01-4208-884c-659f1d76722a 1G" returned: 0 in 0.382s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:37:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-089155e9-e6b6-441d-84f0-221332a288e5 tempest-TestStampPattern-2006421157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a80d3fc2-5596-4d40-883c-299ae83ece80 -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a80d3fc2-5596-4d40-883c-299ae83ece80.25f80510-4b01-4208-884c-659f1d76722a {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:37:34 devstack sudo[105366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a80d3fc2-5596-4d40-883c-299ae83ece80 -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a80d3fc2-5596-4d40-883c-299ae83ece80.25f80510-4b01-4208-884c-659f1d76722a Sep 15 16:37:34 devstack sudo[105366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:37:34 devstack sudo[105366]: pam_unix(sudo:session): session closed for user root Sep 15 16:37:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-089155e9-e6b6-441d-84f0-221332a288e5 tempest-TestStampPattern-2006421157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a80d3fc2-5596-4d40-883c-299ae83ece80 -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a80d3fc2-5596-4d40-883c-299ae83ece80.25f80510-4b01-4208-884c-659f1d76722a" returned: 0 in 0.287s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:37:34 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-089155e9-e6b6-441d-84f0-221332a288e5 tempest-TestStampPattern-2006421157 None] /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a80d3fc2-5596-4d40-883c-299ae83ece80.25f80510-4b01-4208-884c-659f1d76722a is being set with open permissions: ugo+rw Sep 15 16:37:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-089155e9-e6b6-441d-84f0-221332a288e5 tempest-TestStampPattern-2006421157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a80d3fc2-5596-4d40-883c-299ae83ece80.25f80510-4b01-4208-884c-659f1d76722a {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:37:34 devstack sudo[105371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a80d3fc2-5596-4d40-883c-299ae83ece80.25f80510-4b01-4208-884c-659f1d76722a Sep 15 16:37:34 devstack sudo[105371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:37:35 devstack sudo[105371]: pam_unix(sudo:session): session closed for user root Sep 15 16:37:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-089155e9-e6b6-441d-84f0-221332a288e5 tempest-TestStampPattern-2006421157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a80d3fc2-5596-4d40-883c-299ae83ece80.25f80510-4b01-4208-884c-659f1d76722a" returned: 0 in 0.237s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:37:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-089155e9-e6b6-441d-84f0-221332a288e5 tempest-TestStampPattern-2006421157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a80d3fc2-5596-4d40-883c-299ae83ece80.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:37:35 devstack sudo[105374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a80d3fc2-5596-4d40-883c-299ae83ece80.info Sep 15 16:37:35 devstack sudo[105374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:37:35 devstack sudo[105374]: pam_unix(sudo:session): session closed for user root Sep 15 16:37:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-089155e9-e6b6-441d-84f0-221332a288e5 tempest-TestStampPattern-2006421157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a80d3fc2-5596-4d40-883c-299ae83ece80.info" returned: 0 in 0.256s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:37:35 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-089155e9-e6b6-441d-84f0-221332a288e5 tempest-TestStampPattern-2006421157 None] /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a80d3fc2-5596-4d40-883c-299ae83ece80.info is being set with open permissions: ugo+rw Sep 15 16:37:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-089155e9-e6b6-441d-84f0-221332a288e5 tempest-TestStampPattern-2006421157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a80d3fc2-5596-4d40-883c-299ae83ece80.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:37:35 devstack sudo[105377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a80d3fc2-5596-4d40-883c-299ae83ece80.info Sep 15 16:37:35 devstack sudo[105377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:37:35 devstack sudo[105377]: pam_unix(sudo:session): session closed for user root Sep 15 16:37:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-089155e9-e6b6-441d-84f0-221332a288e5 tempest-TestStampPattern-2006421157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a80d3fc2-5596-4d40-883c-299ae83ece80.info" returned: 0 in 0.239s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:37:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-089155e9-e6b6-441d-84f0-221332a288e5 tempest-TestStampPattern-2006421157 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.854s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:37:35 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-089155e9-e6b6-441d-84f0-221332a288e5 tempest-TestStampPattern-2006421157 None] Create snapshot completed successfully Sep 15 16:37:42 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-22914030-0f41-44eb-b26a-3d702e7bcd41 tempest-TestStampPattern-2006421157 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:37:42 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-22914030-0f41-44eb-b26a-3d702e7bcd41 tempest-TestStampPattern-2006421157 None] Flow 'volume_create_manager' (e83b9d85-ee98-4a03-900d-7ce553dc5013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:37:42 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-22914030-0f41-44eb-b26a-3d702e7bcd41 tempest-TestStampPattern-2006421157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dddb2ab-c9f8-49b9-b44c-3177ae5a2ab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:37:42 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-22914030-0f41-44eb-b26a-3d702e7bcd41 tempest-TestStampPattern-2006421157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dddb2ab-c9f8-49b9-b44c-3177ae5a2ab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:37:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-166126852',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1363ed81-aee8-481d-9279-55b4d50afaa0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9496d0e68704b6ca75f52650153cd2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:37:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=25f80510-4b01-4208-884c-659f1d76722a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:37:43Z,use_quota=True,user_id='43a5936967b04c33a2d450bf87b43ca4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:37:42 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-22914030-0f41-44eb-b26a-3d702e7bcd41 tempest-TestStampPattern-2006421157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df72f553-178a-41f1-9601-64d9cb546697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:37:42 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-22914030-0f41-44eb-b26a-3d702e7bcd41 tempest-TestStampPattern-2006421157 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df72f553-178a-41f1-9601-64d9cb546697) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:37:42 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-22914030-0f41-44eb-b26a-3d702e7bcd41 tempest-TestStampPattern-2006421157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b66da999-a139-49e0-92de-25537bdba117) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:37:42 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-22914030-0f41-44eb-b26a-3d702e7bcd41 tempest-TestStampPattern-2006421157 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b66da999-a139-49e0-92de-25537bdba117) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1363ed81-aee8-481d-9279-55b4d50afaa0', 'volume_name': 'volume-1363ed81-aee8-481d-9279-55b4d50afaa0', 'volume_size': 1, 'snapshot_id': '25f80510-4b01-4208-884c-659f1d76722a'}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:37:42 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-22914030-0f41-44eb-b26a-3d702e7bcd41 tempest-TestStampPattern-2006421157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02de53dc-6b73-4627-8897-cd395c4f2d06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:37:42 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-22914030-0f41-44eb-b26a-3d702e7bcd41 tempest-TestStampPattern-2006421157 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02de53dc-6b73-4627-8897-cd395c4f2d06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:37:42 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-22914030-0f41-44eb-b26a-3d702e7bcd41 tempest-TestStampPattern-2006421157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9aad2c5-82c0-497e-8e45-3c68cc5cf467) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:37:42 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-22914030-0f41-44eb-b26a-3d702e7bcd41 tempest-TestStampPattern-2006421157 None] Volume 1363ed81-aee8-481d-9279-55b4d50afaa0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1363ed81-aee8-481d-9279-55b4d50afaa0', 'volume_size': 1, 'snapshot_id': '25f80510-4b01-4208-884c-659f1d76722a'} Sep 15 16:37:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-22914030-0f41-44eb-b26a-3d702e7bcd41 tempest-TestStampPattern-2006421157 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:37:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-22914030-0f41-44eb-b26a-3d702e7bcd41 tempest-TestStampPattern-2006421157 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:37:42 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-22914030-0f41-44eb-b26a-3d702e7bcd41 tempest-TestStampPattern-2006421157 None] Acquiring lock "cinder-quobyte-25f80510-4b01-4208-884c-659f1d76722a-1363ed81-aee8-481d-9279-55b4d50afaa0" by "_create_volume_from_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:37:42 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-22914030-0f41-44eb-b26a-3d702e7bcd41 tempest-TestStampPattern-2006421157 None] Lock "cinder-quobyte-25f80510-4b01-4208-884c-659f1d76722a-1363ed81-aee8-481d-9279-55b4d50afaa0" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:37:42 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-22914030-0f41-44eb-b26a-3d702e7bcd41 tempest-TestStampPattern-2006421157 None] Creating volume 1363ed81-aee8-481d-9279-55b4d50afaa0 from snapshot 25f80510-4b01-4208-884c-659f1d76722a {{(pid=86082) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 15 16:37:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-22914030-0f41-44eb-b26a-3d702e7bcd41 tempest-TestStampPattern-2006421157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:37:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-22914030-0f41-44eb-b26a-3d702e7bcd41 tempest-TestStampPattern-2006421157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:37:42 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-22914030-0f41-44eb-b26a-3d702e7bcd41 tempest-TestStampPattern-2006421157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:37:42 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-22914030-0f41-44eb-b26a-3d702e7bcd41 tempest-TestStampPattern-2006421157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:37:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-22914030-0f41-44eb-b26a-3d702e7bcd41 tempest-TestStampPattern-2006421157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:37:42 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-22914030-0f41-44eb-b26a-3d702e7bcd41 tempest-TestStampPattern-2006421157 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:37:42 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-22914030-0f41-44eb-b26a-3d702e7bcd41 tempest-TestStampPattern-2006421157 None] Acquiring lock "cinder-quobyte-1363ed81-aee8-481d-9279-55b4d50afaa0" by "_copy_volume_from_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:37:42 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-22914030-0f41-44eb-b26a-3d702e7bcd41 tempest-TestStampPattern-2006421157 None] Lock "cinder-quobyte-1363ed81-aee8-481d-9279-55b4d50afaa0" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:37:42 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-22914030-0f41-44eb-b26a-3d702e7bcd41 tempest-TestStampPattern-2006421157 None] snapshot: 25f80510-4b01-4208-884c-659f1d76722a, volume: 1363ed81-aee8-481d-9279-55b4d50afaa0, {{(pid=86082) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 15 16:37:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-22914030-0f41-44eb-b26a-3d702e7bcd41 tempest-TestStampPattern-2006421157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:37:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-22914030-0f41-44eb-b26a-3d702e7bcd41 tempest-TestStampPattern-2006421157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:37:42 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-22914030-0f41-44eb-b26a-3d702e7bcd41 tempest-TestStampPattern-2006421157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:37:42 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-22914030-0f41-44eb-b26a-3d702e7bcd41 tempest-TestStampPattern-2006421157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:37:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-22914030-0f41-44eb-b26a-3d702e7bcd41 tempest-TestStampPattern-2006421157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:37:42 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[4298e250-5ce4-467e-94e2-94ed9e9d1da3]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:37:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-22914030-0f41-44eb-b26a-3d702e7bcd41 tempest-TestStampPattern-2006421157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a80d3fc2-5596-4d40-883c-299ae83ece80.25f80510-4b01-4208-884c-659f1d76722a {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:37:42 devstack sudo[105408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a80d3fc2-5596-4d40-883c-299ae83ece80.25f80510-4b01-4208-884c-659f1d76722a Sep 15 16:37:42 devstack sudo[105408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:37:43 devstack sudo[105408]: pam_unix(sudo:session): session closed for user root Sep 15 16:37:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-22914030-0f41-44eb-b26a-3d702e7bcd41 tempest-TestStampPattern-2006421157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a80d3fc2-5596-4d40-883c-299ae83ece80.25f80510-4b01-4208-884c-659f1d76722a" returned: 0 in 0.407s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:37:43 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-22914030-0f41-44eb-b26a-3d702e7bcd41 tempest-TestStampPattern-2006421157 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a80d3fc2-5596-4d40-883c-299ae83ece80(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 16:37:43 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cd485d4-1230-4953-8955-c206a5b18388]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:37:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-22914030-0f41-44eb-b26a-3d702e7bcd41 tempest-TestStampPattern-2006421157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a80d3fc2-5596-4d40-883c-299ae83ece80 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:37:43 devstack sudo[105414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a80d3fc2-5596-4d40-883c-299ae83ece80 Sep 15 16:37:43 devstack sudo[105414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:37:43 devstack sudo[105414]: pam_unix(sudo:session): session closed for user root Sep 15 16:37:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-22914030-0f41-44eb-b26a-3d702e7bcd41 tempest-TestStampPattern-2006421157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a80d3fc2-5596-4d40-883c-299ae83ece80" returned: 0 in 0.398s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:37:43 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-22914030-0f41-44eb-b26a-3d702e7bcd41 tempest-TestStampPattern-2006421157 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a80d3fc2-5596-4d40-883c-299ae83ece80 {{(pid=86082) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 15 16:37:43 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-22914030-0f41-44eb-b26a-3d702e7bcd41 tempest-TestStampPattern-2006421157 None] Creating direct copy from snapshot {{(pid=86082) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 15 16:37:43 devstack cinder-volume[86082]: DEBUG cinder.utils [None req-22914030-0f41-44eb-b26a-3d702e7bcd41 tempest-TestStampPattern-2006421157 None] Path /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1363ed81-aee8-481d-9279-55b4d50afaa0 not found in is_blk_device check {{(pid=86082) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 15 16:37:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-22914030-0f41-44eb-b26a-3d702e7bcd41 tempest-TestStampPattern-2006421157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a80d3fc2-5596-4d40-883c-299ae83ece80 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1363ed81-aee8-481d-9279-55b4d50afaa0 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:37:43 devstack sudo[105422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a80d3fc2-5596-4d40-883c-299ae83ece80 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1363ed81-aee8-481d-9279-55b4d50afaa0 Sep 15 16:37:43 devstack sudo[105422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:37:52 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:SELECT=15,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 16:37:52 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:SELECT=12,cinder:UPDATE=6,cinder:INSERT=1 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 16:37:52 devstack sudo[105422]: pam_unix(sudo:session): session closed for user root Sep 15 16:37:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-22914030-0f41-44eb-b26a-3d702e7bcd41 tempest-TestStampPattern-2006421157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a80d3fc2-5596-4d40-883c-299ae83ece80 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1363ed81-aee8-481d-9279-55b4d50afaa0" returned: 0 in 9.253s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:37:52 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-22914030-0f41-44eb-b26a-3d702e7bcd41 tempest-TestStampPattern-2006421157 None] Image conversion details: src /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a80d3fc2-5596-4d40-883c-299ae83ece80, size 1024.00 MB, duration 9.25 sec, destination /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1363ed81-aee8-481d-9279-55b4d50afaa0 {{(pid=86082) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 15 16:37:52 devstack cinder-volume[86082]: INFO cinder.image.image_utils [None req-22914030-0f41-44eb-b26a-3d702e7bcd41 tempest-TestStampPattern-2006421157 None] Converted 1024.00 MB image at 110.66 MB/s Sep 15 16:37:52 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-22914030-0f41-44eb-b26a-3d702e7bcd41 tempest-TestStampPattern-2006421157 None] /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1363ed81-aee8-481d-9279-55b4d50afaa0 is being set with open permissions: ugo+rw Sep 15 16:37:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-22914030-0f41-44eb-b26a-3d702e7bcd41 tempest-TestStampPattern-2006421157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1363ed81-aee8-481d-9279-55b4d50afaa0 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:37:52 devstack sudo[105518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1363ed81-aee8-481d-9279-55b4d50afaa0 Sep 15 16:37:52 devstack sudo[105518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:37:53 devstack sudo[105518]: pam_unix(sudo:session): session closed for user root Sep 15 16:37:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-22914030-0f41-44eb-b26a-3d702e7bcd41 tempest-TestStampPattern-2006421157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1363ed81-aee8-481d-9279-55b4d50afaa0" returned: 0 in 0.248s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:37:53 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-22914030-0f41-44eb-b26a-3d702e7bcd41 tempest-TestStampPattern-2006421157 None] Lock "cinder-quobyte-1363ed81-aee8-481d-9279-55b4d50afaa0" released by "_copy_volume_from_snapshot" :: held 10.464s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:37:53 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-22914030-0f41-44eb-b26a-3d702e7bcd41 tempest-TestStampPattern-2006421157 None] Lock "cinder-quobyte-25f80510-4b01-4208-884c-659f1d76722a-1363ed81-aee8-481d-9279-55b4d50afaa0" released by "_create_volume_from_snapshot" :: held 10.530s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:37:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-22914030-0f41-44eb-b26a-3d702e7bcd41 tempest-TestStampPattern-2006421157 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.545s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:37:53 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-22914030-0f41-44eb-b26a-3d702e7bcd41 tempest-TestStampPattern-2006421157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9aad2c5-82c0-497e-8e45-3c68cc5cf467) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1363ed81-aee8-481d-9279-55b4d50afaa0', 'volume_size': 1, 'snapshot_id': '25f80510-4b01-4208-884c-659f1d76722a'}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:37:53 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-22914030-0f41-44eb-b26a-3d702e7bcd41 tempest-TestStampPattern-2006421157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e347862b-732e-424e-b9e9-b5827e504dc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:37:53 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-22914030-0f41-44eb-b26a-3d702e7bcd41 tempest-TestStampPattern-2006421157 None] Volume volume-1363ed81-aee8-481d-9279-55b4d50afaa0 (1363ed81-aee8-481d-9279-55b4d50afaa0): created successfully Sep 15 16:37:53 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-22914030-0f41-44eb-b26a-3d702e7bcd41 tempest-TestStampPattern-2006421157 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e347862b-732e-424e-b9e9-b5827e504dc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:37:53 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-22914030-0f41-44eb-b26a-3d702e7bcd41 tempest-TestStampPattern-2006421157 None] Flow 'volume_create_manager' (e83b9d85-ee98-4a03-900d-7ce553dc5013) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:37:53 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-22914030-0f41-44eb-b26a-3d702e7bcd41 tempest-TestStampPattern-2006421157 None] Created volume successfully. Sep 15 16:37:59 devstack cinder-volume[86082]: DEBUG oslo_service.periodic_task [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Running periodic task VolumeManager._thread_info {{(pid=86082) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 15 16:37:59 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] thread count: 28 {{(pid=86082) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 15 16:37:59 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] thread info: [<_MainThread(MainThread, started 124875935469696)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86082) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 15 16:38:03 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:SELECT=2,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 16:38:03 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:UPDATE=3,cinder:SELECT=1,cinder:DELETE=1 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 16:38:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-ca36b3c4-ef59-476d-92cb-5d97f469a149 req-cb48df30-34a7-4f86-bb3a-d5c55c05fd46 tempest-TestStampPattern-2006421157 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:38:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-ca36b3c4-ef59-476d-92cb-5d97f469a149 req-cb48df30-34a7-4f86-bb3a-d5c55c05fd46 tempest-TestStampPattern-2006421157 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:38:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [req-ca36b3c4-ef59-476d-92cb-5d97f469a149 req-cb48df30-34a7-4f86-bb3a-d5c55c05fd46 tempest-TestStampPattern-2006421157 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.011s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:38:19 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-ca36b3c4-ef59-476d-92cb-5d97f469a149 req-cb48df30-34a7-4f86-bb3a-d5c55c05fd46 tempest-TestStampPattern-2006421157 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a', 'name': 'volume-1363ed81-aee8-481d-9279-55b4d50afaa0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '14884371-d82a-42da-8639-27028232671c', 'enforce_multipath': True} {{(pid=86082) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 15 16:38:19 devstack cinder-volume[86082]: INFO cinder.volume.manager [req-ca36b3c4-ef59-476d-92cb-5d97f469a149 req-cb48df30-34a7-4f86-bb3a-d5c55c05fd46 tempest-TestStampPattern-2006421157 None] attachment_update completed successfully. Sep 15 16:38:21 devstack cinder-volume[86082]: INFO cinder.volume.manager [req-9ed4ebb6-4cf2-4ae3-bb71-a90fedb64957 req-cb20aedc-16bf-43bf-a6fb-b839dfa2c0a2 tempest-TestStampPattern-2006421157 None] Terminate volume connection completed successfully. Sep 15 16:38:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [req-9ed4ebb6-4cf2-4ae3-bb71-a90fedb64957 req-cb20aedc-16bf-43bf-a6fb-b839dfa2c0a2 tempest-TestStampPattern-2006421157 None] Deleting attachment 14884371-d82a-42da-8639-27028232671c. {{(pid=86082) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 15 16:38:26 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-04cce6f7-2833-4c64-8a58-a550399bd59c tempest-TestStampPattern-2006421157 None] Acquiring lock "cinder-1363ed81-aee8-481d-9279-55b4d50afaa0-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:38:26 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-04cce6f7-2833-4c64-8a58-a550399bd59c tempest-TestStampPattern-2006421157 None] Lock "cinder-1363ed81-aee8-481d-9279-55b4d50afaa0-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:38:26 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-04cce6f7-2833-4c64-8a58-a550399bd59c tempest-TestStampPattern-2006421157 None] Acquiring lock "cinder-quobyte-1363ed81-aee8-481d-9279-55b4d50afaa0" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:38:26 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-04cce6f7-2833-4c64-8a58-a550399bd59c tempest-TestStampPattern-2006421157 None] Lock "cinder-quobyte-1363ed81-aee8-481d-9279-55b4d50afaa0" acquired by "delete_volume" :: waited 0.015s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:38:26 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[42896b67-70a1-4045-bbb6-26cc61fbd895]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:38:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-04cce6f7-2833-4c64-8a58-a550399bd59c tempest-TestStampPattern-2006421157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1363ed81-aee8-481d-9279-55b4d50afaa0 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:38:26 devstack sudo[106074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1363ed81-aee8-481d-9279-55b4d50afaa0 Sep 15 16:38:26 devstack sudo[106074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:38:26 devstack sudo[106074]: pam_unix(sudo:session): session closed for user root Sep 15 16:38:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-04cce6f7-2833-4c64-8a58-a550399bd59c tempest-TestStampPattern-2006421157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1363ed81-aee8-481d-9279-55b4d50afaa0" returned: 0 in 0.355s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:38:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-04cce6f7-2833-4c64-8a58-a550399bd59c tempest-TestStampPattern-2006421157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1363ed81-aee8-481d-9279-55b4d50afaa0 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:38:26 devstack sudo[106079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1363ed81-aee8-481d-9279-55b4d50afaa0 Sep 15 16:38:26 devstack sudo[106079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:38:26 devstack sudo[106079]: pam_unix(sudo:session): session closed for user root Sep 15 16:38:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-04cce6f7-2833-4c64-8a58-a550399bd59c tempest-TestStampPattern-2006421157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1363ed81-aee8-481d-9279-55b4d50afaa0" returned: 0 in 0.248s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:38:26 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-04cce6f7-2833-4c64-8a58-a550399bd59c tempest-TestStampPattern-2006421157 None] Lock "cinder-quobyte-1363ed81-aee8-481d-9279-55b4d50afaa0" released by "delete_volume" :: held 0.645s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:38:26 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-04cce6f7-2833-4c64-8a58-a550399bd59c tempest-TestStampPattern-2006421157 None] Created reservations ['b947fc98-ca01-4af9-8623-fb58c0b7130c', 'e10b8d19-5531-4811-a678-4f7e55317cfa', 'b7fcfc83-d32d-484e-af4c-20a3dce3da7c', '8de89e0d-03f0-49b4-b5b7-aa1cb415d886'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:38:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-04cce6f7-2833-4c64-8a58-a550399bd59c tempest-TestStampPattern-2006421157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:38:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-04cce6f7-2833-4c64-8a58-a550399bd59c tempest-TestStampPattern-2006421157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:38:26 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-04cce6f7-2833-4c64-8a58-a550399bd59c tempest-TestStampPattern-2006421157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:38:26 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-04cce6f7-2833-4c64-8a58-a550399bd59c tempest-TestStampPattern-2006421157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:38:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-04cce6f7-2833-4c64-8a58-a550399bd59c tempest-TestStampPattern-2006421157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:38:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-04cce6f7-2833-4c64-8a58-a550399bd59c tempest-TestStampPattern-2006421157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:38:26 devstack sudo[106082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:38:26 devstack sudo[106082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:38:27 devstack sudo[106082]: pam_unix(sudo:session): session closed for user root Sep 15 16:38:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-04cce6f7-2833-4c64-8a58-a550399bd59c tempest-TestStampPattern-2006421157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.238s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:38:27 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-04cce6f7-2833-4c64-8a58-a550399bd59c tempest-TestStampPattern-2006421157 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:38:27 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-04cce6f7-2833-4c64-8a58-a550399bd59c tempest-TestStampPattern-2006421157 None] Deleted volume successfully. Sep 15 16:38:27 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-04cce6f7-2833-4c64-8a58-a550399bd59c tempest-TestStampPattern-2006421157 None] Lock "cinder-1363ed81-aee8-481d-9279-55b4d50afaa0-delete_volume" released by "delete_volume" :: held 1.070s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:38:27 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-ed3e6572-8949-4007-8af3-bea73afdae21 tempest-TestStampPattern-2006421157 None] Acquiring lock "cinder-25f80510-4b01-4208-884c-659f1d76722a-delete_snapshot" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:38:27 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-ed3e6572-8949-4007-8af3-bea73afdae21 tempest-TestStampPattern-2006421157 None] Lock "cinder-25f80510-4b01-4208-884c-659f1d76722a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:38:27 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-ed3e6572-8949-4007-8af3-bea73afdae21 tempest-TestStampPattern-2006421157 None] Acquiring lock "cinder-quobyte-a80d3fc2-5596-4d40-883c-299ae83ece80" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:38:27 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-ed3e6572-8949-4007-8af3-bea73afdae21 tempest-TestStampPattern-2006421157 None] Lock "cinder-quobyte-a80d3fc2-5596-4d40-883c-299ae83ece80" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:38:27 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-ed3e6572-8949-4007-8af3-bea73afdae21 tempest-TestStampPattern-2006421157 None] Acquiring lock "cinder-quobyte-25f80510-4b01-4208-884c-659f1d76722a" by "_delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:38:27 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-ed3e6572-8949-4007-8af3-bea73afdae21 tempest-TestStampPattern-2006421157 None] Lock "cinder-quobyte-25f80510-4b01-4208-884c-659f1d76722a" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:38:27 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-ed3e6572-8949-4007-8af3-bea73afdae21 tempest-TestStampPattern-2006421157 None] Deleting offline snapshot 25f80510-4b01-4208-884c-659f1d76722a of volume a80d3fc2-5596-4d40-883c-299ae83ece80 {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 15 16:38:27 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-ed3e6572-8949-4007-8af3-bea73afdae21 tempest-TestStampPattern-2006421157 None] snapshot_file for this snap is: volume-a80d3fc2-5596-4d40-883c-299ae83ece80.25f80510-4b01-4208-884c-659f1d76722a {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 15 16:38:27 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdded7ea-56d1-4f00-b2fa-ce28cd4efb22]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:38:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ed3e6572-8949-4007-8af3-bea73afdae21 tempest-TestStampPattern-2006421157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a80d3fc2-5596-4d40-883c-299ae83ece80.25f80510-4b01-4208-884c-659f1d76722a {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:38:27 devstack sudo[106086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a80d3fc2-5596-4d40-883c-299ae83ece80.25f80510-4b01-4208-884c-659f1d76722a Sep 15 16:38:27 devstack sudo[106086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:38:27 devstack sudo[106086]: pam_unix(sudo:session): session closed for user root Sep 15 16:38:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ed3e6572-8949-4007-8af3-bea73afdae21 tempest-TestStampPattern-2006421157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a80d3fc2-5596-4d40-883c-299ae83ece80.25f80510-4b01-4208-884c-659f1d76722a" returned: 0 in 0.357s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:38:27 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-ed3e6572-8949-4007-8af3-bea73afdae21 tempest-TestStampPattern-2006421157 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a80d3fc2-5596-4d40-883c-299ae83ece80(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 16:38:27 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba7d8019-fc7b-407a-80f5-f336421d83e9]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:38:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ed3e6572-8949-4007-8af3-bea73afdae21 tempest-TestStampPattern-2006421157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a80d3fc2-5596-4d40-883c-299ae83ece80 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:38:28 devstack sudo[106091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a80d3fc2-5596-4d40-883c-299ae83ece80 Sep 15 16:38:28 devstack sudo[106091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:38:28 devstack sudo[106091]: pam_unix(sudo:session): session closed for user root Sep 15 16:38:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ed3e6572-8949-4007-8af3-bea73afdae21 tempest-TestStampPattern-2006421157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a80d3fc2-5596-4d40-883c-299ae83ece80" returned: 0 in 0.520s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:38:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ed3e6572-8949-4007-8af3-bea73afdae21 tempest-TestStampPattern-2006421157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a80d3fc2-5596-4d40-883c-299ae83ece80.25f80510-4b01-4208-884c-659f1d76722a {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:38:28 devstack sudo[106096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a80d3fc2-5596-4d40-883c-299ae83ece80.25f80510-4b01-4208-884c-659f1d76722a Sep 15 16:38:28 devstack sudo[106096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:38:28 devstack sudo[106096]: pam_unix(sudo:session): session closed for user root Sep 15 16:38:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ed3e6572-8949-4007-8af3-bea73afdae21 tempest-TestStampPattern-2006421157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a80d3fc2-5596-4d40-883c-299ae83ece80.25f80510-4b01-4208-884c-659f1d76722a" returned: 0 in 0.326s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:38:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ed3e6572-8949-4007-8af3-bea73afdae21 tempest-TestStampPattern-2006421157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a80d3fc2-5596-4d40-883c-299ae83ece80.25f80510-4b01-4208-884c-659f1d76722a {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:38:28 devstack sudo[106101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a80d3fc2-5596-4d40-883c-299ae83ece80.25f80510-4b01-4208-884c-659f1d76722a Sep 15 16:38:28 devstack sudo[106101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:38:29 devstack sudo[106101]: pam_unix(sudo:session): session closed for user root Sep 15 16:38:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ed3e6572-8949-4007-8af3-bea73afdae21 tempest-TestStampPattern-2006421157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a80d3fc2-5596-4d40-883c-299ae83ece80.25f80510-4b01-4208-884c-659f1d76722a" returned: 0 in 0.242s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:38:29 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-ed3e6572-8949-4007-8af3-bea73afdae21 tempest-TestStampPattern-2006421157 None] Lock "cinder-quobyte-25f80510-4b01-4208-884c-659f1d76722a" released by "_delete_snapshot" :: held 1.552s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:38:29 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-ed3e6572-8949-4007-8af3-bea73afdae21 tempest-TestStampPattern-2006421157 None] Lock "cinder-quobyte-a80d3fc2-5596-4d40-883c-299ae83ece80" released by "delete_snapshot" :: held 1.573s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:38:29 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-ed3e6572-8949-4007-8af3-bea73afdae21 tempest-TestStampPattern-2006421157 None] Created reservations ['c4f4553c-abec-4a21-b089-57c15bb5f48f', '796d9dee-eb16-4e1a-a0e7-e45d0b4c045b', '3f3f1488-d7c6-4e80-ace6-0c95a3aba448', '1395deab-068e-40e8-b709-078915afdb71'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:38:29 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-ed3e6572-8949-4007-8af3-bea73afdae21 tempest-TestStampPattern-2006421157 None] Delete snapshot completed successfully. Sep 15 16:38:29 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-ed3e6572-8949-4007-8af3-bea73afdae21 tempest-TestStampPattern-2006421157 None] Lock "cinder-25f80510-4b01-4208-884c-659f1d76722a-delete_snapshot" released by "delete_snapshot" :: held 1.692s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:38:33 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-0225f871-7b54-41f7-aee2-14edfd26e05f tempest-TestStampPattern-2006421157 None] Acquiring lock "cinder-a80d3fc2-5596-4d40-883c-299ae83ece80-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:38:33 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-0225f871-7b54-41f7-aee2-14edfd26e05f tempest-TestStampPattern-2006421157 None] Lock "cinder-a80d3fc2-5596-4d40-883c-299ae83ece80-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:38:33 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-0225f871-7b54-41f7-aee2-14edfd26e05f tempest-TestStampPattern-2006421157 None] Acquiring lock "cinder-quobyte-a80d3fc2-5596-4d40-883c-299ae83ece80" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:38:33 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-0225f871-7b54-41f7-aee2-14edfd26e05f tempest-TestStampPattern-2006421157 None] Lock "cinder-quobyte-a80d3fc2-5596-4d40-883c-299ae83ece80" acquired by "delete_volume" :: waited 0.013s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:38:33 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[d83806f9-940b-406e-aeb1-464649c9a001]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:38:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0225f871-7b54-41f7-aee2-14edfd26e05f tempest-TestStampPattern-2006421157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a80d3fc2-5596-4d40-883c-299ae83ece80 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:38:34 devstack sudo[106137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a80d3fc2-5596-4d40-883c-299ae83ece80 Sep 15 16:38:34 devstack sudo[106137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:38:34 devstack sudo[106137]: pam_unix(sudo:session): session closed for user root Sep 15 16:38:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0225f871-7b54-41f7-aee2-14edfd26e05f tempest-TestStampPattern-2006421157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a80d3fc2-5596-4d40-883c-299ae83ece80" returned: 0 in 0.371s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:38:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0225f871-7b54-41f7-aee2-14edfd26e05f tempest-TestStampPattern-2006421157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a80d3fc2-5596-4d40-883c-299ae83ece80 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:38:34 devstack sudo[106142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a80d3fc2-5596-4d40-883c-299ae83ece80 Sep 15 16:38:34 devstack sudo[106142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:38:34 devstack sudo[106142]: pam_unix(sudo:session): session closed for user root Sep 15 16:38:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0225f871-7b54-41f7-aee2-14edfd26e05f tempest-TestStampPattern-2006421157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a80d3fc2-5596-4d40-883c-299ae83ece80" returned: 0 in 0.241s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:38:34 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-0225f871-7b54-41f7-aee2-14edfd26e05f tempest-TestStampPattern-2006421157 None] Lock "cinder-quobyte-a80d3fc2-5596-4d40-883c-299ae83ece80" released by "delete_volume" :: held 0.675s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:38:34 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-0225f871-7b54-41f7-aee2-14edfd26e05f tempest-TestStampPattern-2006421157 None] Created reservations ['cea4ba3e-73b7-4e14-adda-db0da443258c', '02a3c512-02ce-4f57-8349-5e9332d1c196', 'e51b65d4-6ed7-493d-aa0b-a13a2712ed43', 'a532cfe1-5ab9-4928-9fc9-eca3bc799834'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:38:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-0225f871-7b54-41f7-aee2-14edfd26e05f tempest-TestStampPattern-2006421157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:38:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-0225f871-7b54-41f7-aee2-14edfd26e05f tempest-TestStampPattern-2006421157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:38:34 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-0225f871-7b54-41f7-aee2-14edfd26e05f tempest-TestStampPattern-2006421157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:38:34 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-0225f871-7b54-41f7-aee2-14edfd26e05f tempest-TestStampPattern-2006421157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:38:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-0225f871-7b54-41f7-aee2-14edfd26e05f tempest-TestStampPattern-2006421157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:38:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0225f871-7b54-41f7-aee2-14edfd26e05f tempest-TestStampPattern-2006421157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:38:34 devstack sudo[106145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:38:34 devstack sudo[106145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:38:34 devstack sudo[106145]: pam_unix(sudo:session): session closed for user root Sep 15 16:38:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0225f871-7b54-41f7-aee2-14edfd26e05f tempest-TestStampPattern-2006421157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.245s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:38:34 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-0225f871-7b54-41f7-aee2-14edfd26e05f tempest-TestStampPattern-2006421157 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:38:34 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-0225f871-7b54-41f7-aee2-14edfd26e05f tempest-TestStampPattern-2006421157 None] Deleted volume successfully. Sep 15 16:38:35 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-0225f871-7b54-41f7-aee2-14edfd26e05f tempest-TestStampPattern-2006421157 None] Lock "cinder-a80d3fc2-5596-4d40-883c-299ae83ece80-delete_volume" released by "delete_volume" :: held 1.121s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:38:44 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:SELECT=24,cinder:UPDATE=25,cinder:INSERT=6 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 16:38:44 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:SELECT=22,cinder:UPDATE=21,cinder:INSERT=6,cinder:DELETE=2 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 16:38:46 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-32b50e77-ca12-4331-89fa-2b3974a953c9 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:38:46 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-32b50e77-ca12-4331-89fa-2b3974a953c9 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Flow 'volume_create_manager' (e75e9758-f3b2-4567-bf32-3a3f6df04707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:38:46 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-32b50e77-ca12-4331-89fa-2b3974a953c9 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d95b484-2139-4383-932f-0d67194bb52f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:38:46 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-32b50e77-ca12-4331-89fa-2b3974a953c9 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d95b484-2139-4383-932f-0d67194bb52f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:38:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2043554638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6af77401-0a99-44aa-95cc-2de328c58079,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d35061545f849a0a4138bccedd85678',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:38:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:38:46Z,use_quota=True,user_id='8809b203c2064f18b94bf0135868cb97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:38:46 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-32b50e77-ca12-4331-89fa-2b3974a953c9 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c1cc98d-703f-48e2-a552-61ba2946674d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:38:46 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-32b50e77-ca12-4331-89fa-2b3974a953c9 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c1cc98d-703f-48e2-a552-61ba2946674d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:38:46 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-32b50e77-ca12-4331-89fa-2b3974a953c9 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3c1359d-abff-497c-8d23-d51dad6ea6ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:38:46 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-32b50e77-ca12-4331-89fa-2b3974a953c9 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3c1359d-abff-497c-8d23-d51dad6ea6ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6af77401-0a99-44aa-95cc-2de328c58079', 'volume_name': 'volume-6af77401-0a99-44aa-95cc-2de328c58079', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:38:46 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-32b50e77-ca12-4331-89fa-2b3974a953c9 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6469c4f9-c23e-4d47-90e0-01a7c50b8c1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:38:46 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-32b50e77-ca12-4331-89fa-2b3974a953c9 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6469c4f9-c23e-4d47-90e0-01a7c50b8c1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:38:46 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-32b50e77-ca12-4331-89fa-2b3974a953c9 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dffd33fb-4fa5-48de-b615-ee1fc8a1d05e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:38:46 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-32b50e77-ca12-4331-89fa-2b3974a953c9 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Volume 6af77401-0a99-44aa-95cc-2de328c58079: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6af77401-0a99-44aa-95cc-2de328c58079', 'volume_size': 1} Sep 15 16:38:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-32b50e77-ca12-4331-89fa-2b3974a953c9 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:38:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-32b50e77-ca12-4331-89fa-2b3974a953c9 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:38:46 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-32b50e77-ca12-4331-89fa-2b3974a953c9 tempest-CreateVolumesFromSnapshotTest-1375330957 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:38:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2043554638',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6af77401-0a99-44aa-95cc-2de328c58079,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d35061545f849a0a4138bccedd85678',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:38:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:38:46Z,use_quota=True,user_id='8809b203c2064f18b94bf0135868cb97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:38:46 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-32b50e77-ca12-4331-89fa-2b3974a953c9 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Creating volume 6af77401-0a99-44aa-95cc-2de328c58079 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:38:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-32b50e77-ca12-4331-89fa-2b3974a953c9 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:38:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-32b50e77-ca12-4331-89fa-2b3974a953c9 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:38:46 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-32b50e77-ca12-4331-89fa-2b3974a953c9 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:38:46 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-32b50e77-ca12-4331-89fa-2b3974a953c9 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:38:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-32b50e77-ca12-4331-89fa-2b3974a953c9 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:38:46 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-32b50e77-ca12-4331-89fa-2b3974a953c9 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:38:46 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-32b50e77-ca12-4331-89fa-2b3974a953c9 tempest-CreateVolumesFromSnapshotTest-1375330957 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:38:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-32b50e77-ca12-4331-89fa-2b3974a953c9 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6af77401-0a99-44aa-95cc-2de328c58079 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:38:46 devstack sudo[106155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6af77401-0a99-44aa-95cc-2de328c58079 1073741824 Sep 15 16:38:46 devstack sudo[106155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:38:46 devstack sudo[106155]: pam_unix(sudo:session): session closed for user root Sep 15 16:38:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-32b50e77-ca12-4331-89fa-2b3974a953c9 tempest-CreateVolumesFromSnapshotTest-1375330957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6af77401-0a99-44aa-95cc-2de328c58079 1073741824" returned: 0 in 0.412s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:38:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-32b50e77-ca12-4331-89fa-2b3974a953c9 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6af77401-0a99-44aa-95cc-2de328c58079 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:38:46 devstack sudo[106161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6af77401-0a99-44aa-95cc-2de328c58079 Sep 15 16:38:46 devstack sudo[106161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:38:47 devstack sudo[106161]: pam_unix(sudo:session): session closed for user root Sep 15 16:38:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-32b50e77-ca12-4331-89fa-2b3974a953c9 tempest-CreateVolumesFromSnapshotTest-1375330957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6af77401-0a99-44aa-95cc-2de328c58079" returned: 0 in 0.238s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:38:47 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-32b50e77-ca12-4331-89fa-2b3974a953c9 tempest-CreateVolumesFromSnapshotTest-1375330957 None] <== create_volume: return (695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:38:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-32b50e77-ca12-4331-89fa-2b3974a953c9 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.698s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:38:47 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-32b50e77-ca12-4331-89fa-2b3974a953c9 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dffd33fb-4fa5-48de-b615-ee1fc8a1d05e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6af77401-0a99-44aa-95cc-2de328c58079', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:38:47 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-32b50e77-ca12-4331-89fa-2b3974a953c9 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df6c6106-f7be-4b3d-bac8-e53d44352fa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:38:47 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-32b50e77-ca12-4331-89fa-2b3974a953c9 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Volume volume-6af77401-0a99-44aa-95cc-2de328c58079 (6af77401-0a99-44aa-95cc-2de328c58079): created successfully Sep 15 16:38:47 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-32b50e77-ca12-4331-89fa-2b3974a953c9 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df6c6106-f7be-4b3d-bac8-e53d44352fa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:38:47 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-32b50e77-ca12-4331-89fa-2b3974a953c9 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Flow 'volume_create_manager' (e75e9758-f3b2-4567-bf32-3a3f6df04707) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:38:47 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-32b50e77-ca12-4331-89fa-2b3974a953c9 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Created volume successfully. Sep 15 16:38:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-1315ba9c-1671-4906-9514-cc7b78bc8f2d tempest-CreateVolumesFromSnapshotTest-1375330957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:38:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-1315ba9c-1671-4906-9514-cc7b78bc8f2d tempest-CreateVolumesFromSnapshotTest-1375330957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:38:47 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-1315ba9c-1671-4906-9514-cc7b78bc8f2d tempest-CreateVolumesFromSnapshotTest-1375330957 None] Creating offline snapshot 98152841-9697-430f-b656-5ce6c47dc711 of volume 6af77401-0a99-44aa-95cc-2de328c58079 {{(pid=86082) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 15 16:38:47 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[71e59224-ee47-4b4d-a564-891b3bea8e4e]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:38:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-1315ba9c-1671-4906-9514-cc7b78bc8f2d tempest-CreateVolumesFromSnapshotTest-1375330957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6af77401-0a99-44aa-95cc-2de328c58079 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:38:47 devstack sudo[106165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6af77401-0a99-44aa-95cc-2de328c58079 Sep 15 16:38:47 devstack sudo[106165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:38:47 devstack sudo[106165]: pam_unix(sudo:session): session closed for user root Sep 15 16:38:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-1315ba9c-1671-4906-9514-cc7b78bc8f2d tempest-CreateVolumesFromSnapshotTest-1375330957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6af77401-0a99-44aa-95cc-2de328c58079" returned: 0 in 0.357s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:38:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-1315ba9c-1671-4906-9514-cc7b78bc8f2d tempest-CreateVolumesFromSnapshotTest-1375330957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6af77401-0a99-44aa-95cc-2de328c58079,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6af77401-0a99-44aa-95cc-2de328c58079.98152841-9697-430f-b656-5ce6c47dc711 1G {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:38:47 devstack sudo[106170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6af77401-0a99-44aa-95cc-2de328c58079,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6af77401-0a99-44aa-95cc-2de328c58079.98152841-9697-430f-b656-5ce6c47dc711 1G Sep 15 16:38:47 devstack sudo[106170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:38:48 devstack sudo[106170]: pam_unix(sudo:session): session closed for user root Sep 15 16:38:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-1315ba9c-1671-4906-9514-cc7b78bc8f2d tempest-CreateVolumesFromSnapshotTest-1375330957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6af77401-0a99-44aa-95cc-2de328c58079,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6af77401-0a99-44aa-95cc-2de328c58079.98152841-9697-430f-b656-5ce6c47dc711 1G" returned: 0 in 0.391s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:38:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-1315ba9c-1671-4906-9514-cc7b78bc8f2d tempest-CreateVolumesFromSnapshotTest-1375330957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6af77401-0a99-44aa-95cc-2de328c58079 -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6af77401-0a99-44aa-95cc-2de328c58079.98152841-9697-430f-b656-5ce6c47dc711 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:38:48 devstack sudo[106176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6af77401-0a99-44aa-95cc-2de328c58079 -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6af77401-0a99-44aa-95cc-2de328c58079.98152841-9697-430f-b656-5ce6c47dc711 Sep 15 16:38:48 devstack sudo[106176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:38:48 devstack sudo[106176]: pam_unix(sudo:session): session closed for user root Sep 15 16:38:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-1315ba9c-1671-4906-9514-cc7b78bc8f2d tempest-CreateVolumesFromSnapshotTest-1375330957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6af77401-0a99-44aa-95cc-2de328c58079 -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6af77401-0a99-44aa-95cc-2de328c58079.98152841-9697-430f-b656-5ce6c47dc711" returned: 0 in 0.290s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:38:48 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-1315ba9c-1671-4906-9514-cc7b78bc8f2d tempest-CreateVolumesFromSnapshotTest-1375330957 None] /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6af77401-0a99-44aa-95cc-2de328c58079.98152841-9697-430f-b656-5ce6c47dc711 is being set with open permissions: ugo+rw Sep 15 16:38:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-1315ba9c-1671-4906-9514-cc7b78bc8f2d tempest-CreateVolumesFromSnapshotTest-1375330957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6af77401-0a99-44aa-95cc-2de328c58079.98152841-9697-430f-b656-5ce6c47dc711 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:38:48 devstack sudo[106181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6af77401-0a99-44aa-95cc-2de328c58079.98152841-9697-430f-b656-5ce6c47dc711 Sep 15 16:38:48 devstack sudo[106181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:38:48 devstack sudo[106181]: pam_unix(sudo:session): session closed for user root Sep 15 16:38:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-1315ba9c-1671-4906-9514-cc7b78bc8f2d tempest-CreateVolumesFromSnapshotTest-1375330957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6af77401-0a99-44aa-95cc-2de328c58079.98152841-9697-430f-b656-5ce6c47dc711" returned: 0 in 0.243s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:38:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-1315ba9c-1671-4906-9514-cc7b78bc8f2d tempest-CreateVolumesFromSnapshotTest-1375330957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6af77401-0a99-44aa-95cc-2de328c58079.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:38:48 devstack sudo[106184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6af77401-0a99-44aa-95cc-2de328c58079.info Sep 15 16:38:48 devstack sudo[106184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:38:49 devstack sudo[106184]: pam_unix(sudo:session): session closed for user root Sep 15 16:38:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-1315ba9c-1671-4906-9514-cc7b78bc8f2d tempest-CreateVolumesFromSnapshotTest-1375330957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6af77401-0a99-44aa-95cc-2de328c58079.info" returned: 0 in 0.241s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:38:49 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-1315ba9c-1671-4906-9514-cc7b78bc8f2d tempest-CreateVolumesFromSnapshotTest-1375330957 None] /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6af77401-0a99-44aa-95cc-2de328c58079.info is being set with open permissions: ugo+rw Sep 15 16:38:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-1315ba9c-1671-4906-9514-cc7b78bc8f2d tempest-CreateVolumesFromSnapshotTest-1375330957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6af77401-0a99-44aa-95cc-2de328c58079.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:38:49 devstack sudo[106187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6af77401-0a99-44aa-95cc-2de328c58079.info Sep 15 16:38:49 devstack sudo[106187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:38:49 devstack sudo[106187]: pam_unix(sudo:session): session closed for user root Sep 15 16:38:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-1315ba9c-1671-4906-9514-cc7b78bc8f2d tempest-CreateVolumesFromSnapshotTest-1375330957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6af77401-0a99-44aa-95cc-2de328c58079.info" returned: 0 in 0.235s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:38:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-1315ba9c-1671-4906-9514-cc7b78bc8f2d tempest-CreateVolumesFromSnapshotTest-1375330957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.853s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:38:49 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-1315ba9c-1671-4906-9514-cc7b78bc8f2d tempest-CreateVolumesFromSnapshotTest-1375330957 None] Create snapshot completed successfully Sep 15 16:38:49 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-314fb3e1-f237-4c08-bc0e-4796b07486d6 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:38:49 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-314fb3e1-f237-4c08-bc0e-4796b07486d6 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Flow 'volume_create_manager' (a77ed856-03ed-4f9d-90e3-a87ad1513dec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:38:49 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-314fb3e1-f237-4c08-bc0e-4796b07486d6 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78f78e60-0978-4e28-b7d8-15ab28cab3e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:38:49 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-314fb3e1-f237-4c08-bc0e-4796b07486d6 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78f78e60-0978-4e28-b7d8-15ab28cab3e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:38:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-653069239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12f69d56-895d-4ccb-8bd7-b75a44009dda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d35061545f849a0a4138bccedd85678',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:38:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:38:50Z,use_quota=True,user_id='8809b203c2064f18b94bf0135868cb97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:38:49 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-314fb3e1-f237-4c08-bc0e-4796b07486d6 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (127de7bc-868b-4a45-9d83-014568b923f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:38:50 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-314fb3e1-f237-4c08-bc0e-4796b07486d6 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (127de7bc-868b-4a45-9d83-014568b923f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:38:50 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-314fb3e1-f237-4c08-bc0e-4796b07486d6 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6380012-b630-4d4d-8ada-7a322890e654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:38:50 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-314fb3e1-f237-4c08-bc0e-4796b07486d6 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6380012-b630-4d4d-8ada-7a322890e654) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '12f69d56-895d-4ccb-8bd7-b75a44009dda', 'volume_name': 'volume-12f69d56-895d-4ccb-8bd7-b75a44009dda', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:38:50 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-314fb3e1-f237-4c08-bc0e-4796b07486d6 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b6a2df6-42ea-4bdc-b00e-3d5c912417ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:38:50 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-314fb3e1-f237-4c08-bc0e-4796b07486d6 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b6a2df6-42ea-4bdc-b00e-3d5c912417ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:38:50 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-314fb3e1-f237-4c08-bc0e-4796b07486d6 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49b3fcc1-491a-4fc3-9f19-f27f8e0abc3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:38:50 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-314fb3e1-f237-4c08-bc0e-4796b07486d6 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Volume 12f69d56-895d-4ccb-8bd7-b75a44009dda: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-12f69d56-895d-4ccb-8bd7-b75a44009dda', 'volume_size': 1} Sep 15 16:38:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-314fb3e1-f237-4c08-bc0e-4796b07486d6 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:38:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-314fb3e1-f237-4c08-bc0e-4796b07486d6 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:38:50 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-314fb3e1-f237-4c08-bc0e-4796b07486d6 tempest-CreateVolumesFromSnapshotTest-1375330957 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:38:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-653069239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=12f69d56-895d-4ccb-8bd7-b75a44009dda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d35061545f849a0a4138bccedd85678',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:38:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:38:50Z,use_quota=True,user_id='8809b203c2064f18b94bf0135868cb97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:38:50 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-314fb3e1-f237-4c08-bc0e-4796b07486d6 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Creating volume 12f69d56-895d-4ccb-8bd7-b75a44009dda {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:38:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-314fb3e1-f237-4c08-bc0e-4796b07486d6 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:38:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-314fb3e1-f237-4c08-bc0e-4796b07486d6 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:38:50 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-314fb3e1-f237-4c08-bc0e-4796b07486d6 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:38:50 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-314fb3e1-f237-4c08-bc0e-4796b07486d6 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:38:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-314fb3e1-f237-4c08-bc0e-4796b07486d6 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:38:50 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-314fb3e1-f237-4c08-bc0e-4796b07486d6 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:38:50 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-314fb3e1-f237-4c08-bc0e-4796b07486d6 tempest-CreateVolumesFromSnapshotTest-1375330957 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:38:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-314fb3e1-f237-4c08-bc0e-4796b07486d6 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-12f69d56-895d-4ccb-8bd7-b75a44009dda 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:38:50 devstack sudo[106190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-12f69d56-895d-4ccb-8bd7-b75a44009dda 1073741824 Sep 15 16:38:50 devstack sudo[106190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:38:50 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-28854ef3-a0c8-4c4d-bff8-541b30187894 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:38:50 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-28854ef3-a0c8-4c4d-bff8-541b30187894 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Flow 'volume_create_manager' (ed07684a-0e72-43e7-9553-211bb72b68d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:38:50 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-28854ef3-a0c8-4c4d-bff8-541b30187894 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26e47e92-e466-4f94-9745-17b833c9700d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:38:50 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-28854ef3-a0c8-4c4d-bff8-541b30187894 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26e47e92-e466-4f94-9745-17b833c9700d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:38:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1684362896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ff6d337-3fc5-4c0a-b075-252639fb871b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d35061545f849a0a4138bccedd85678',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:38:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:38:50Z,use_quota=True,user_id='8809b203c2064f18b94bf0135868cb97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:38:50 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-28854ef3-a0c8-4c4d-bff8-541b30187894 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a197884-cc8a-4290-879e-ad5225a094bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:38:50 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-28854ef3-a0c8-4c4d-bff8-541b30187894 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a197884-cc8a-4290-879e-ad5225a094bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:38:50 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-28854ef3-a0c8-4c4d-bff8-541b30187894 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ec048c4-fb2c-47f3-a504-53eedc1c576d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:38:50 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-28854ef3-a0c8-4c4d-bff8-541b30187894 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ec048c4-fb2c-47f3-a504-53eedc1c576d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ff6d337-3fc5-4c0a-b075-252639fb871b', 'volume_name': 'volume-5ff6d337-3fc5-4c0a-b075-252639fb871b', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:38:50 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-28854ef3-a0c8-4c4d-bff8-541b30187894 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d597be6-7e80-4d57-87bc-3d05df17c7df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:38:50 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-28854ef3-a0c8-4c4d-bff8-541b30187894 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1d597be6-7e80-4d57-87bc-3d05df17c7df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:38:50 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-28854ef3-a0c8-4c4d-bff8-541b30187894 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e5a6e01-7098-47b3-a57d-3e398aef160e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:38:50 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-28854ef3-a0c8-4c4d-bff8-541b30187894 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Volume 5ff6d337-3fc5-4c0a-b075-252639fb871b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ff6d337-3fc5-4c0a-b075-252639fb871b', 'volume_size': 1} Sep 15 16:38:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-28854ef3-a0c8-4c4d-bff8-541b30187894 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:38:50 devstack sudo[106190]: pam_unix(sudo:session): session closed for user root Sep 15 16:38:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-314fb3e1-f237-4c08-bc0e-4796b07486d6 tempest-CreateVolumesFromSnapshotTest-1375330957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-12f69d56-895d-4ccb-8bd7-b75a44009dda 1073741824" returned: 0 in 0.514s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:38:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-314fb3e1-f237-4c08-bc0e-4796b07486d6 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-12f69d56-895d-4ccb-8bd7-b75a44009dda {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:38:50 devstack sudo[106196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-12f69d56-895d-4ccb-8bd7-b75a44009dda Sep 15 16:38:50 devstack sudo[106196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:38:50 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-478801e1-829f-4ee4-9e60-fdca9d5f31b2 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:38:50 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-478801e1-829f-4ee4-9e60-fdca9d5f31b2 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Flow 'volume_create_manager' (c686150e-e1f0-4617-b919-9e6ef97c7e24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:38:50 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-478801e1-829f-4ee4-9e60-fdca9d5f31b2 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de196a41-0405-4d39-85a0-5f115f175b14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:38:50 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-478801e1-829f-4ee4-9e60-fdca9d5f31b2 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de196a41-0405-4d39-85a0-5f115f175b14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:38:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-130094782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a809b2d1-f4c1-468a-84dc-254cfe38351c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d35061545f849a0a4138bccedd85678',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:38:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:38:51Z,use_quota=True,user_id='8809b203c2064f18b94bf0135868cb97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:38:50 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-478801e1-829f-4ee4-9e60-fdca9d5f31b2 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a97a81a-e192-4a4a-a1cf-09d4b6580ed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:38:50 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-478801e1-829f-4ee4-9e60-fdca9d5f31b2 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a97a81a-e192-4a4a-a1cf-09d4b6580ed8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:38:50 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-478801e1-829f-4ee4-9e60-fdca9d5f31b2 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c892c2e3-f630-4879-9003-672b50f20659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:38:50 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-478801e1-829f-4ee4-9e60-fdca9d5f31b2 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c892c2e3-f630-4879-9003-672b50f20659) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a809b2d1-f4c1-468a-84dc-254cfe38351c', 'volume_name': 'volume-a809b2d1-f4c1-468a-84dc-254cfe38351c', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:38:50 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-478801e1-829f-4ee4-9e60-fdca9d5f31b2 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f54f2ef8-e63c-4f60-85e0-161b02a37d00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:38:50 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-478801e1-829f-4ee4-9e60-fdca9d5f31b2 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f54f2ef8-e63c-4f60-85e0-161b02a37d00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:38:50 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-478801e1-829f-4ee4-9e60-fdca9d5f31b2 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a4dc686-96b8-477c-a9c3-ec7e54c47a23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:38:50 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-478801e1-829f-4ee4-9e60-fdca9d5f31b2 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Volume a809b2d1-f4c1-468a-84dc-254cfe38351c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a809b2d1-f4c1-468a-84dc-254cfe38351c', 'volume_size': 1} Sep 15 16:38:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-478801e1-829f-4ee4-9e60-fdca9d5f31b2 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:38:50 devstack sudo[106196]: pam_unix(sudo:session): session closed for user root Sep 15 16:38:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-314fb3e1-f237-4c08-bc0e-4796b07486d6 tempest-CreateVolumesFromSnapshotTest-1375330957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-12f69d56-895d-4ccb-8bd7-b75a44009dda" returned: 0 in 0.303s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:38:50 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-314fb3e1-f237-4c08-bc0e-4796b07486d6 tempest-CreateVolumesFromSnapshotTest-1375330957 None] <== create_volume: return (871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:38:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-314fb3e1-f237-4c08-bc0e-4796b07486d6 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.873s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:38:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-28854ef3-a0c8-4c4d-bff8-541b30187894 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.508s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:38:50 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-28854ef3-a0c8-4c4d-bff8-541b30187894 tempest-CreateVolumesFromSnapshotTest-1375330957 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:38:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1684362896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ff6d337-3fc5-4c0a-b075-252639fb871b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d35061545f849a0a4138bccedd85678',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:38:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:38:50Z,use_quota=True,user_id='8809b203c2064f18b94bf0135868cb97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:38:50 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-28854ef3-a0c8-4c4d-bff8-541b30187894 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Creating volume 5ff6d337-3fc5-4c0a-b075-252639fb871b {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:38:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-28854ef3-a0c8-4c4d-bff8-541b30187894 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:38:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-28854ef3-a0c8-4c4d-bff8-541b30187894 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:38:50 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-28854ef3-a0c8-4c4d-bff8-541b30187894 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:38:50 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-28854ef3-a0c8-4c4d-bff8-541b30187894 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:38:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-28854ef3-a0c8-4c4d-bff8-541b30187894 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:38:50 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-28854ef3-a0c8-4c4d-bff8-541b30187894 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:38:50 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-28854ef3-a0c8-4c4d-bff8-541b30187894 tempest-CreateVolumesFromSnapshotTest-1375330957 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:38:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-28854ef3-a0c8-4c4d-bff8-541b30187894 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-5ff6d337-3fc5-4c0a-b075-252639fb871b 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:38:50 devstack sudo[106201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-5ff6d337-3fc5-4c0a-b075-252639fb871b 1073741824 Sep 15 16:38:50 devstack sudo[106201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:38:50 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-314fb3e1-f237-4c08-bc0e-4796b07486d6 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49b3fcc1-491a-4fc3-9f19-f27f8e0abc3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-12f69d56-895d-4ccb-8bd7-b75a44009dda', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:38:50 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-314fb3e1-f237-4c08-bc0e-4796b07486d6 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42894549-0be1-46d8-98d1-ee5cfbb703c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:38:51 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-314fb3e1-f237-4c08-bc0e-4796b07486d6 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Volume volume-12f69d56-895d-4ccb-8bd7-b75a44009dda (12f69d56-895d-4ccb-8bd7-b75a44009dda): created successfully Sep 15 16:38:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-314fb3e1-f237-4c08-bc0e-4796b07486d6 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42894549-0be1-46d8-98d1-ee5cfbb703c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:38:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-314fb3e1-f237-4c08-bc0e-4796b07486d6 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Flow 'volume_create_manager' (a77ed856-03ed-4f9d-90e3-a87ad1513dec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:38:51 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-314fb3e1-f237-4c08-bc0e-4796b07486d6 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Created volume successfully. Sep 15 16:38:51 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-7471c954-a94e-4fd5-b674-77198c9d5c0a tempest-CreateVolumesFromSnapshotTest-1375330957 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:38:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7471c954-a94e-4fd5-b674-77198c9d5c0a tempest-CreateVolumesFromSnapshotTest-1375330957 None] Flow 'volume_create_manager' (00a5a5f5-a322-4907-88f5-d065edd49738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:38:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7471c954-a94e-4fd5-b674-77198c9d5c0a tempest-CreateVolumesFromSnapshotTest-1375330957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7535c58b-bba7-4ffc-82b5-924f450e14ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:38:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7471c954-a94e-4fd5-b674-77198c9d5c0a tempest-CreateVolumesFromSnapshotTest-1375330957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7535c58b-bba7-4ffc-82b5-924f450e14ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:38:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1074125983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2aa24d64-51ac-4d81-9cbb-b1118181ff7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d35061545f849a0a4138bccedd85678',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:38:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:38:51Z,use_quota=True,user_id='8809b203c2064f18b94bf0135868cb97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:38:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7471c954-a94e-4fd5-b674-77198c9d5c0a tempest-CreateVolumesFromSnapshotTest-1375330957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef1d059e-8c5e-4062-8741-99f475e7c7fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:38:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7471c954-a94e-4fd5-b674-77198c9d5c0a tempest-CreateVolumesFromSnapshotTest-1375330957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef1d059e-8c5e-4062-8741-99f475e7c7fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:38:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7471c954-a94e-4fd5-b674-77198c9d5c0a tempest-CreateVolumesFromSnapshotTest-1375330957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fba3f86e-470c-4cfb-8d19-917c410e4bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:38:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7471c954-a94e-4fd5-b674-77198c9d5c0a tempest-CreateVolumesFromSnapshotTest-1375330957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fba3f86e-470c-4cfb-8d19-917c410e4bba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2aa24d64-51ac-4d81-9cbb-b1118181ff7a', 'volume_name': 'volume-2aa24d64-51ac-4d81-9cbb-b1118181ff7a', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:38:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7471c954-a94e-4fd5-b674-77198c9d5c0a tempest-CreateVolumesFromSnapshotTest-1375330957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6832bc2-d2f2-4502-acd9-43210e1f7dde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:38:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7471c954-a94e-4fd5-b674-77198c9d5c0a tempest-CreateVolumesFromSnapshotTest-1375330957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6832bc2-d2f2-4502-acd9-43210e1f7dde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:38:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7471c954-a94e-4fd5-b674-77198c9d5c0a tempest-CreateVolumesFromSnapshotTest-1375330957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (377fdc2a-16c5-4b55-a04e-1f29024cc524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:38:51 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-7471c954-a94e-4fd5-b674-77198c9d5c0a tempest-CreateVolumesFromSnapshotTest-1375330957 None] Volume 2aa24d64-51ac-4d81-9cbb-b1118181ff7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2aa24d64-51ac-4d81-9cbb-b1118181ff7a', 'volume_size': 1} Sep 15 16:38:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-7471c954-a94e-4fd5-b674-77198c9d5c0a tempest-CreateVolumesFromSnapshotTest-1375330957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:38:51 devstack sudo[106201]: pam_unix(sudo:session): session closed for user root Sep 15 16:38:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-28854ef3-a0c8-4c4d-bff8-541b30187894 tempest-CreateVolumesFromSnapshotTest-1375330957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-5ff6d337-3fc5-4c0a-b075-252639fb871b 1073741824" returned: 0 in 0.601s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:38:51 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-34dd03ba-a798-41a9-b815-dc8377344eea tempest-CreateVolumesFromSnapshotTest-1375330957 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:38:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-34dd03ba-a798-41a9-b815-dc8377344eea tempest-CreateVolumesFromSnapshotTest-1375330957 None] Flow 'volume_create_manager' (36fe0f54-23a6-4496-bab9-9b10ddd01f70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:38:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-34dd03ba-a798-41a9-b815-dc8377344eea tempest-CreateVolumesFromSnapshotTest-1375330957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (385c96bb-e799-4edd-9df4-54adbde142bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:38:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-34dd03ba-a798-41a9-b815-dc8377344eea tempest-CreateVolumesFromSnapshotTest-1375330957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (385c96bb-e799-4edd-9df4-54adbde142bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:38:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-965174959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d151342c-e0d3-4b8a-aa8c-2ff7ba5d03c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d35061545f849a0a4138bccedd85678',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:38:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:38:51Z,use_quota=True,user_id='8809b203c2064f18b94bf0135868cb97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:38:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-34dd03ba-a798-41a9-b815-dc8377344eea tempest-CreateVolumesFromSnapshotTest-1375330957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7880f511-511c-4e8b-aca1-b28bbf162cb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:38:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-34dd03ba-a798-41a9-b815-dc8377344eea tempest-CreateVolumesFromSnapshotTest-1375330957 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7880f511-511c-4e8b-aca1-b28bbf162cb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:38:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-34dd03ba-a798-41a9-b815-dc8377344eea tempest-CreateVolumesFromSnapshotTest-1375330957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d838ffc8-7e6e-40a0-9af3-3b0c525b93cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:38:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-34dd03ba-a798-41a9-b815-dc8377344eea tempest-CreateVolumesFromSnapshotTest-1375330957 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d838ffc8-7e6e-40a0-9af3-3b0c525b93cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd151342c-e0d3-4b8a-aa8c-2ff7ba5d03c2', 'volume_name': 'volume-d151342c-e0d3-4b8a-aa8c-2ff7ba5d03c2', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:38:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-34dd03ba-a798-41a9-b815-dc8377344eea tempest-CreateVolumesFromSnapshotTest-1375330957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a57f2e1-137f-4ac9-911b-9c3748593394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:38:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-34dd03ba-a798-41a9-b815-dc8377344eea tempest-CreateVolumesFromSnapshotTest-1375330957 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a57f2e1-137f-4ac9-911b-9c3748593394) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:38:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-34dd03ba-a798-41a9-b815-dc8377344eea tempest-CreateVolumesFromSnapshotTest-1375330957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1600182c-ec39-48f3-b20b-831fb3a269aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:38:51 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-34dd03ba-a798-41a9-b815-dc8377344eea tempest-CreateVolumesFromSnapshotTest-1375330957 None] Volume d151342c-e0d3-4b8a-aa8c-2ff7ba5d03c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d151342c-e0d3-4b8a-aa8c-2ff7ba5d03c2', 'volume_size': 1} Sep 15 16:38:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-34dd03ba-a798-41a9-b815-dc8377344eea tempest-CreateVolumesFromSnapshotTest-1375330957 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:38:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-28854ef3-a0c8-4c4d-bff8-541b30187894 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-5ff6d337-3fc5-4c0a-b075-252639fb871b {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:38:51 devstack sudo[106207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-5ff6d337-3fc5-4c0a-b075-252639fb871b Sep 15 16:38:51 devstack sudo[106207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:38:51 devstack sudo[106207]: pam_unix(sudo:session): session closed for user root Sep 15 16:38:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-28854ef3-a0c8-4c4d-bff8-541b30187894 tempest-CreateVolumesFromSnapshotTest-1375330957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-5ff6d337-3fc5-4c0a-b075-252639fb871b" returned: 0 in 0.252s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:38:51 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-28854ef3-a0c8-4c4d-bff8-541b30187894 tempest-CreateVolumesFromSnapshotTest-1375330957 None] <== create_volume: return (1024ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:38:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-28854ef3-a0c8-4c4d-bff8-541b30187894 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.028s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:38:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-478801e1-829f-4ee4-9e60-fdca9d5f31b2 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.130s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:38:51 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-478801e1-829f-4ee4-9e60-fdca9d5f31b2 tempest-CreateVolumesFromSnapshotTest-1375330957 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:38:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-130094782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a809b2d1-f4c1-468a-84dc-254cfe38351c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d35061545f849a0a4138bccedd85678',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:38:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:38:51Z,use_quota=True,user_id='8809b203c2064f18b94bf0135868cb97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:38:51 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-478801e1-829f-4ee4-9e60-fdca9d5f31b2 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Creating volume a809b2d1-f4c1-468a-84dc-254cfe38351c {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:38:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-478801e1-829f-4ee4-9e60-fdca9d5f31b2 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:38:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-478801e1-829f-4ee4-9e60-fdca9d5f31b2 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:38:51 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-478801e1-829f-4ee4-9e60-fdca9d5f31b2 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:38:51 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-478801e1-829f-4ee4-9e60-fdca9d5f31b2 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:38:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-478801e1-829f-4ee4-9e60-fdca9d5f31b2 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:38:51 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-478801e1-829f-4ee4-9e60-fdca9d5f31b2 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:38:51 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-478801e1-829f-4ee4-9e60-fdca9d5f31b2 tempest-CreateVolumesFromSnapshotTest-1375330957 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:38:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-478801e1-829f-4ee4-9e60-fdca9d5f31b2 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a809b2d1-f4c1-468a-84dc-254cfe38351c 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:38:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-28854ef3-a0c8-4c4d-bff8-541b30187894 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e5a6e01-7098-47b3-a57d-3e398aef160e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ff6d337-3fc5-4c0a-b075-252639fb871b', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:38:51 devstack sudo[106210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a809b2d1-f4c1-468a-84dc-254cfe38351c 1073741824 Sep 15 16:38:51 devstack sudo[106210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:38:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-28854ef3-a0c8-4c4d-bff8-541b30187894 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b22d6e04-c38e-40a9-9146-d02708c8462a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:38:51 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-28854ef3-a0c8-4c4d-bff8-541b30187894 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Volume volume-5ff6d337-3fc5-4c0a-b075-252639fb871b (5ff6d337-3fc5-4c0a-b075-252639fb871b): created successfully Sep 15 16:38:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-28854ef3-a0c8-4c4d-bff8-541b30187894 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b22d6e04-c38e-40a9-9146-d02708c8462a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:38:51 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-28854ef3-a0c8-4c4d-bff8-541b30187894 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Flow 'volume_create_manager' (ed07684a-0e72-43e7-9553-211bb72b68d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:38:52 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-28854ef3-a0c8-4c4d-bff8-541b30187894 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Created volume successfully. Sep 15 16:38:52 devstack sudo[106210]: pam_unix(sudo:session): session closed for user root Sep 15 16:38:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-478801e1-829f-4ee4-9e60-fdca9d5f31b2 tempest-CreateVolumesFromSnapshotTest-1375330957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a809b2d1-f4c1-468a-84dc-254cfe38351c 1073741824" returned: 0 in 0.418s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:38:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-478801e1-829f-4ee4-9e60-fdca9d5f31b2 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a809b2d1-f4c1-468a-84dc-254cfe38351c {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:38:52 devstack sudo[106216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a809b2d1-f4c1-468a-84dc-254cfe38351c Sep 15 16:38:52 devstack sudo[106216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:38:52 devstack sudo[106216]: pam_unix(sudo:session): session closed for user root Sep 15 16:38:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-478801e1-829f-4ee4-9e60-fdca9d5f31b2 tempest-CreateVolumesFromSnapshotTest-1375330957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a809b2d1-f4c1-468a-84dc-254cfe38351c" returned: 0 in 0.248s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:38:52 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-478801e1-829f-4ee4-9e60-fdca9d5f31b2 tempest-CreateVolumesFromSnapshotTest-1375330957 None] <== create_volume: return (705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:38:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-478801e1-829f-4ee4-9e60-fdca9d5f31b2 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.708s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:38:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-7471c954-a94e-4fd5-b674-77198c9d5c0a tempest-CreateVolumesFromSnapshotTest-1375330957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.372s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:38:52 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-7471c954-a94e-4fd5-b674-77198c9d5c0a tempest-CreateVolumesFromSnapshotTest-1375330957 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:38:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1074125983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2aa24d64-51ac-4d81-9cbb-b1118181ff7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d35061545f849a0a4138bccedd85678',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:38:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:38:51Z,use_quota=True,user_id='8809b203c2064f18b94bf0135868cb97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:38:52 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-7471c954-a94e-4fd5-b674-77198c9d5c0a tempest-CreateVolumesFromSnapshotTest-1375330957 None] Creating volume 2aa24d64-51ac-4d81-9cbb-b1118181ff7a {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:38:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-7471c954-a94e-4fd5-b674-77198c9d5c0a tempest-CreateVolumesFromSnapshotTest-1375330957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:38:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-7471c954-a94e-4fd5-b674-77198c9d5c0a tempest-CreateVolumesFromSnapshotTest-1375330957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:38:52 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-7471c954-a94e-4fd5-b674-77198c9d5c0a tempest-CreateVolumesFromSnapshotTest-1375330957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:38:52 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-7471c954-a94e-4fd5-b674-77198c9d5c0a tempest-CreateVolumesFromSnapshotTest-1375330957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:38:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-7471c954-a94e-4fd5-b674-77198c9d5c0a tempest-CreateVolumesFromSnapshotTest-1375330957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:38:52 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-7471c954-a94e-4fd5-b674-77198c9d5c0a tempest-CreateVolumesFromSnapshotTest-1375330957 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:38:52 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-7471c954-a94e-4fd5-b674-77198c9d5c0a tempest-CreateVolumesFromSnapshotTest-1375330957 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:38:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7471c954-a94e-4fd5-b674-77198c9d5c0a tempest-CreateVolumesFromSnapshotTest-1375330957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2aa24d64-51ac-4d81-9cbb-b1118181ff7a 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:38:52 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-478801e1-829f-4ee4-9e60-fdca9d5f31b2 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a4dc686-96b8-477c-a9c3-ec7e54c47a23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a809b2d1-f4c1-468a-84dc-254cfe38351c', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:38:52 devstack sudo[106219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2aa24d64-51ac-4d81-9cbb-b1118181ff7a 1073741824 Sep 15 16:38:52 devstack sudo[106219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:38:52 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-478801e1-829f-4ee4-9e60-fdca9d5f31b2 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bb11661-c062-439a-9b41-cb192bb203f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:38:52 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-478801e1-829f-4ee4-9e60-fdca9d5f31b2 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Volume volume-a809b2d1-f4c1-468a-84dc-254cfe38351c (a809b2d1-f4c1-468a-84dc-254cfe38351c): created successfully Sep 15 16:38:52 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-478801e1-829f-4ee4-9e60-fdca9d5f31b2 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bb11661-c062-439a-9b41-cb192bb203f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:38:52 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-478801e1-829f-4ee4-9e60-fdca9d5f31b2 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Flow 'volume_create_manager' (c686150e-e1f0-4617-b919-9e6ef97c7e24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:38:52 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-478801e1-829f-4ee4-9e60-fdca9d5f31b2 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Created volume successfully. Sep 15 16:38:53 devstack sudo[106219]: pam_unix(sudo:session): session closed for user root Sep 15 16:38:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7471c954-a94e-4fd5-b674-77198c9d5c0a tempest-CreateVolumesFromSnapshotTest-1375330957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2aa24d64-51ac-4d81-9cbb-b1118181ff7a 1073741824" returned: 0 in 0.426s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:38:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7471c954-a94e-4fd5-b674-77198c9d5c0a tempest-CreateVolumesFromSnapshotTest-1375330957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2aa24d64-51ac-4d81-9cbb-b1118181ff7a {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:38:53 devstack sudo[106225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2aa24d64-51ac-4d81-9cbb-b1118181ff7a Sep 15 16:38:53 devstack sudo[106225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:38:53 devstack sudo[106225]: pam_unix(sudo:session): session closed for user root Sep 15 16:38:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7471c954-a94e-4fd5-b674-77198c9d5c0a tempest-CreateVolumesFromSnapshotTest-1375330957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2aa24d64-51ac-4d81-9cbb-b1118181ff7a" returned: 0 in 0.234s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:38:53 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-7471c954-a94e-4fd5-b674-77198c9d5c0a tempest-CreateVolumesFromSnapshotTest-1375330957 None] <== create_volume: return (695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:38:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-7471c954-a94e-4fd5-b674-77198c9d5c0a tempest-CreateVolumesFromSnapshotTest-1375330957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.698s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:38:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-34dd03ba-a798-41a9-b815-dc8377344eea tempest-CreateVolumesFromSnapshotTest-1375330957 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.682s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:38:53 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-34dd03ba-a798-41a9-b815-dc8377344eea tempest-CreateVolumesFromSnapshotTest-1375330957 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:38:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-965174959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d151342c-e0d3-4b8a-aa8c-2ff7ba5d03c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3d35061545f849a0a4138bccedd85678',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:38:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:38:51Z,use_quota=True,user_id='8809b203c2064f18b94bf0135868cb97',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:38:53 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-34dd03ba-a798-41a9-b815-dc8377344eea tempest-CreateVolumesFromSnapshotTest-1375330957 None] Creating volume d151342c-e0d3-4b8a-aa8c-2ff7ba5d03c2 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:38:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-34dd03ba-a798-41a9-b815-dc8377344eea tempest-CreateVolumesFromSnapshotTest-1375330957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:38:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-34dd03ba-a798-41a9-b815-dc8377344eea tempest-CreateVolumesFromSnapshotTest-1375330957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:38:53 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-34dd03ba-a798-41a9-b815-dc8377344eea tempest-CreateVolumesFromSnapshotTest-1375330957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:38:53 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-34dd03ba-a798-41a9-b815-dc8377344eea tempest-CreateVolumesFromSnapshotTest-1375330957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:38:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-34dd03ba-a798-41a9-b815-dc8377344eea tempest-CreateVolumesFromSnapshotTest-1375330957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:38:53 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-34dd03ba-a798-41a9-b815-dc8377344eea tempest-CreateVolumesFromSnapshotTest-1375330957 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:38:53 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-34dd03ba-a798-41a9-b815-dc8377344eea tempest-CreateVolumesFromSnapshotTest-1375330957 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:38:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-34dd03ba-a798-41a9-b815-dc8377344eea tempest-CreateVolumesFromSnapshotTest-1375330957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-d151342c-e0d3-4b8a-aa8c-2ff7ba5d03c2 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:38:53 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7471c954-a94e-4fd5-b674-77198c9d5c0a tempest-CreateVolumesFromSnapshotTest-1375330957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (377fdc2a-16c5-4b55-a04e-1f29024cc524) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2aa24d64-51ac-4d81-9cbb-b1118181ff7a', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:38:53 devstack sudo[106228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-d151342c-e0d3-4b8a-aa8c-2ff7ba5d03c2 1073741824 Sep 15 16:38:53 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7471c954-a94e-4fd5-b674-77198c9d5c0a tempest-CreateVolumesFromSnapshotTest-1375330957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b413de06-4d77-442a-aeac-51a36ebbd285) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:38:53 devstack sudo[106228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:38:53 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-7471c954-a94e-4fd5-b674-77198c9d5c0a tempest-CreateVolumesFromSnapshotTest-1375330957 None] Volume volume-2aa24d64-51ac-4d81-9cbb-b1118181ff7a (2aa24d64-51ac-4d81-9cbb-b1118181ff7a): created successfully Sep 15 16:38:53 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7471c954-a94e-4fd5-b674-77198c9d5c0a tempest-CreateVolumesFromSnapshotTest-1375330957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b413de06-4d77-442a-aeac-51a36ebbd285) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:38:53 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7471c954-a94e-4fd5-b674-77198c9d5c0a tempest-CreateVolumesFromSnapshotTest-1375330957 None] Flow 'volume_create_manager' (00a5a5f5-a322-4907-88f5-d065edd49738) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:38:53 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-7471c954-a94e-4fd5-b674-77198c9d5c0a tempest-CreateVolumesFromSnapshotTest-1375330957 None] Created volume successfully. Sep 15 16:38:53 devstack sudo[106228]: pam_unix(sudo:session): session closed for user root Sep 15 16:38:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-34dd03ba-a798-41a9-b815-dc8377344eea tempest-CreateVolumesFromSnapshotTest-1375330957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-d151342c-e0d3-4b8a-aa8c-2ff7ba5d03c2 1073741824" returned: 0 in 0.446s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:38:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-34dd03ba-a798-41a9-b815-dc8377344eea tempest-CreateVolumesFromSnapshotTest-1375330957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-d151342c-e0d3-4b8a-aa8c-2ff7ba5d03c2 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:38:53 devstack sudo[106234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-d151342c-e0d3-4b8a-aa8c-2ff7ba5d03c2 Sep 15 16:38:53 devstack sudo[106234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:38:54 devstack sudo[106234]: pam_unix(sudo:session): session closed for user root Sep 15 16:38:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-34dd03ba-a798-41a9-b815-dc8377344eea tempest-CreateVolumesFromSnapshotTest-1375330957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-d151342c-e0d3-4b8a-aa8c-2ff7ba5d03c2" returned: 0 in 0.242s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:38:54 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-34dd03ba-a798-41a9-b815-dc8377344eea tempest-CreateVolumesFromSnapshotTest-1375330957 None] <== create_volume: return (730ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:38:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-34dd03ba-a798-41a9-b815-dc8377344eea tempest-CreateVolumesFromSnapshotTest-1375330957 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.732s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:38:54 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-34dd03ba-a798-41a9-b815-dc8377344eea tempest-CreateVolumesFromSnapshotTest-1375330957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1600182c-ec39-48f3-b20b-831fb3a269aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d151342c-e0d3-4b8a-aa8c-2ff7ba5d03c2', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:38:54 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-34dd03ba-a798-41a9-b815-dc8377344eea tempest-CreateVolumesFromSnapshotTest-1375330957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d83be080-74ad-450a-b42f-1d6db2c0a176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:38:54 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-34dd03ba-a798-41a9-b815-dc8377344eea tempest-CreateVolumesFromSnapshotTest-1375330957 None] Volume volume-d151342c-e0d3-4b8a-aa8c-2ff7ba5d03c2 (d151342c-e0d3-4b8a-aa8c-2ff7ba5d03c2): created successfully Sep 15 16:38:54 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-34dd03ba-a798-41a9-b815-dc8377344eea tempest-CreateVolumesFromSnapshotTest-1375330957 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d83be080-74ad-450a-b42f-1d6db2c0a176) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:38:54 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-34dd03ba-a798-41a9-b815-dc8377344eea tempest-CreateVolumesFromSnapshotTest-1375330957 None] Flow 'volume_create_manager' (36fe0f54-23a6-4496-bab9-9b10ddd01f70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:38:54 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-34dd03ba-a798-41a9-b815-dc8377344eea tempest-CreateVolumesFromSnapshotTest-1375330957 None] Created volume successfully. Sep 15 16:38:54 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-8ca66684-85bb-4d87-8f8e-a567aada1127 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Acquiring lock "cinder-d151342c-e0d3-4b8a-aa8c-2ff7ba5d03c2-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:38:54 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-8ca66684-85bb-4d87-8f8e-a567aada1127 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Lock "cinder-d151342c-e0d3-4b8a-aa8c-2ff7ba5d03c2-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:38:55 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-8ca66684-85bb-4d87-8f8e-a567aada1127 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Acquiring lock "cinder-quobyte-d151342c-e0d3-4b8a-aa8c-2ff7ba5d03c2" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:38:55 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-8ca66684-85bb-4d87-8f8e-a567aada1127 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Lock "cinder-quobyte-d151342c-e0d3-4b8a-aa8c-2ff7ba5d03c2" acquired by "delete_volume" :: waited 0.013s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:38:55 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[951b1ef9-1000-4988-905b-2cf3a60a8ffe]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:38:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8ca66684-85bb-4d87-8f8e-a567aada1127 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-d151342c-e0d3-4b8a-aa8c-2ff7ba5d03c2 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:38:55 devstack sudo[106237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-d151342c-e0d3-4b8a-aa8c-2ff7ba5d03c2 Sep 15 16:38:55 devstack sudo[106237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:38:55 devstack sudo[106237]: pam_unix(sudo:session): session closed for user root Sep 15 16:38:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8ca66684-85bb-4d87-8f8e-a567aada1127 tempest-CreateVolumesFromSnapshotTest-1375330957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-d151342c-e0d3-4b8a-aa8c-2ff7ba5d03c2" returned: 0 in 0.380s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:38:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8ca66684-85bb-4d87-8f8e-a567aada1127 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-d151342c-e0d3-4b8a-aa8c-2ff7ba5d03c2 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:38:55 devstack sudo[106242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-d151342c-e0d3-4b8a-aa8c-2ff7ba5d03c2 Sep 15 16:38:55 devstack sudo[106242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:38:55 devstack sudo[106242]: pam_unix(sudo:session): session closed for user root Sep 15 16:38:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8ca66684-85bb-4d87-8f8e-a567aada1127 tempest-CreateVolumesFromSnapshotTest-1375330957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-d151342c-e0d3-4b8a-aa8c-2ff7ba5d03c2" returned: 0 in 0.248s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:38:55 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-8ca66684-85bb-4d87-8f8e-a567aada1127 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Lock "cinder-quobyte-d151342c-e0d3-4b8a-aa8c-2ff7ba5d03c2" released by "delete_volume" :: held 0.668s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:38:55 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-8ca66684-85bb-4d87-8f8e-a567aada1127 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Created reservations ['f7f34643-5ac8-4750-841c-d29fa2039653', '06ebf598-f714-4ed7-aef2-0070efcd2593', '912824ae-04da-4be3-a0e8-c47a70700332', '4a8d726d-8e5d-40db-8d13-6b2ea1f42aba'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:38:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-8ca66684-85bb-4d87-8f8e-a567aada1127 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:38:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-8ca66684-85bb-4d87-8f8e-a567aada1127 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:38:55 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-8ca66684-85bb-4d87-8f8e-a567aada1127 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:38:55 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-8ca66684-85bb-4d87-8f8e-a567aada1127 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:38:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-8ca66684-85bb-4d87-8f8e-a567aada1127 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:38:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8ca66684-85bb-4d87-8f8e-a567aada1127 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:38:55 devstack sudo[106245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:38:55 devstack sudo[106245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:38:56 devstack sudo[106245]: pam_unix(sudo:session): session closed for user root Sep 15 16:38:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8ca66684-85bb-4d87-8f8e-a567aada1127 tempest-CreateVolumesFromSnapshotTest-1375330957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.246s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:38:56 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-8ca66684-85bb-4d87-8f8e-a567aada1127 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:38:56 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-8ca66684-85bb-4d87-8f8e-a567aada1127 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Deleted volume successfully. Sep 15 16:38:56 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-8ca66684-85bb-4d87-8f8e-a567aada1127 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Lock "cinder-d151342c-e0d3-4b8a-aa8c-2ff7ba5d03c2-delete_volume" released by "delete_volume" :: held 1.103s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:38:56 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-5d3fcd0d-a4d7-4994-837e-fafbdde140da tempest-CreateVolumesFromSnapshotTest-1375330957 None] Acquiring lock "cinder-2aa24d64-51ac-4d81-9cbb-b1118181ff7a-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:38:56 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-5d3fcd0d-a4d7-4994-837e-fafbdde140da tempest-CreateVolumesFromSnapshotTest-1375330957 None] Lock "cinder-2aa24d64-51ac-4d81-9cbb-b1118181ff7a-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:38:56 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-5d3fcd0d-a4d7-4994-837e-fafbdde140da tempest-CreateVolumesFromSnapshotTest-1375330957 None] Acquiring lock "cinder-quobyte-2aa24d64-51ac-4d81-9cbb-b1118181ff7a" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:38:56 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-5d3fcd0d-a4d7-4994-837e-fafbdde140da tempest-CreateVolumesFromSnapshotTest-1375330957 None] Lock "cinder-quobyte-2aa24d64-51ac-4d81-9cbb-b1118181ff7a" acquired by "delete_volume" :: waited 0.014s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:38:56 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9bd2670-d86e-488d-a87e-ce5a70e3d9c2]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:38:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5d3fcd0d-a4d7-4994-837e-fafbdde140da tempest-CreateVolumesFromSnapshotTest-1375330957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2aa24d64-51ac-4d81-9cbb-b1118181ff7a {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:38:56 devstack sudo[106248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2aa24d64-51ac-4d81-9cbb-b1118181ff7a Sep 15 16:38:56 devstack sudo[106248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:38:56 devstack sudo[106248]: pam_unix(sudo:session): session closed for user root Sep 15 16:38:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5d3fcd0d-a4d7-4994-837e-fafbdde140da tempest-CreateVolumesFromSnapshotTest-1375330957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2aa24d64-51ac-4d81-9cbb-b1118181ff7a" returned: 0 in 0.355s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:38:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5d3fcd0d-a4d7-4994-837e-fafbdde140da tempest-CreateVolumesFromSnapshotTest-1375330957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2aa24d64-51ac-4d81-9cbb-b1118181ff7a {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:38:56 devstack sudo[106253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2aa24d64-51ac-4d81-9cbb-b1118181ff7a Sep 15 16:38:56 devstack sudo[106253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:38:56 devstack sudo[106253]: pam_unix(sudo:session): session closed for user root Sep 15 16:38:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5d3fcd0d-a4d7-4994-837e-fafbdde140da tempest-CreateVolumesFromSnapshotTest-1375330957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2aa24d64-51ac-4d81-9cbb-b1118181ff7a" returned: 0 in 0.238s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:38:56 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-5d3fcd0d-a4d7-4994-837e-fafbdde140da tempest-CreateVolumesFromSnapshotTest-1375330957 None] Lock "cinder-quobyte-2aa24d64-51ac-4d81-9cbb-b1118181ff7a" released by "delete_volume" :: held 0.632s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:38:56 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-5d3fcd0d-a4d7-4994-837e-fafbdde140da tempest-CreateVolumesFromSnapshotTest-1375330957 None] Created reservations ['38d1af4f-52d5-44c4-a838-e7df95cec4a6', '12aff839-aa84-4d4e-9562-96645d3ed3db', 'b9227c14-2157-4290-8e77-ddc8e49e97c0', '39d36a88-91f8-4b27-b286-bb8e29024547'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:38:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-5d3fcd0d-a4d7-4994-837e-fafbdde140da tempest-CreateVolumesFromSnapshotTest-1375330957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:38:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-5d3fcd0d-a4d7-4994-837e-fafbdde140da tempest-CreateVolumesFromSnapshotTest-1375330957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:38:56 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-5d3fcd0d-a4d7-4994-837e-fafbdde140da tempest-CreateVolumesFromSnapshotTest-1375330957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:38:56 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-5d3fcd0d-a4d7-4994-837e-fafbdde140da tempest-CreateVolumesFromSnapshotTest-1375330957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:38:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-5d3fcd0d-a4d7-4994-837e-fafbdde140da tempest-CreateVolumesFromSnapshotTest-1375330957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:38:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5d3fcd0d-a4d7-4994-837e-fafbdde140da tempest-CreateVolumesFromSnapshotTest-1375330957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:38:56 devstack sudo[106256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:38:56 devstack sudo[106256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:38:57 devstack sudo[106256]: pam_unix(sudo:session): session closed for user root Sep 15 16:38:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5d3fcd0d-a4d7-4994-837e-fafbdde140da tempest-CreateVolumesFromSnapshotTest-1375330957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.240s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:38:57 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-5d3fcd0d-a4d7-4994-837e-fafbdde140da tempest-CreateVolumesFromSnapshotTest-1375330957 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:38:57 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-5d3fcd0d-a4d7-4994-837e-fafbdde140da tempest-CreateVolumesFromSnapshotTest-1375330957 None] Deleted volume successfully. Sep 15 16:38:57 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-5d3fcd0d-a4d7-4994-837e-fafbdde140da tempest-CreateVolumesFromSnapshotTest-1375330957 None] Lock "cinder-2aa24d64-51ac-4d81-9cbb-b1118181ff7a-delete_volume" released by "delete_volume" :: held 1.063s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:38:57 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-ce86ea77-e4ae-4d71-a0c8-cacea1cbdfae tempest-CreateVolumesFromSnapshotTest-1375330957 None] Acquiring lock "cinder-a809b2d1-f4c1-468a-84dc-254cfe38351c-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:38:57 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-ce86ea77-e4ae-4d71-a0c8-cacea1cbdfae tempest-CreateVolumesFromSnapshotTest-1375330957 None] Lock "cinder-a809b2d1-f4c1-468a-84dc-254cfe38351c-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:38:57 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-ce86ea77-e4ae-4d71-a0c8-cacea1cbdfae tempest-CreateVolumesFromSnapshotTest-1375330957 None] Acquiring lock "cinder-quobyte-a809b2d1-f4c1-468a-84dc-254cfe38351c" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:38:57 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-ce86ea77-e4ae-4d71-a0c8-cacea1cbdfae tempest-CreateVolumesFromSnapshotTest-1375330957 None] Lock "cinder-quobyte-a809b2d1-f4c1-468a-84dc-254cfe38351c" acquired by "delete_volume" :: waited 0.017s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:38:57 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[02af18b9-6a9a-4618-9107-e77f112c5e43]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:38:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ce86ea77-e4ae-4d71-a0c8-cacea1cbdfae tempest-CreateVolumesFromSnapshotTest-1375330957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a809b2d1-f4c1-468a-84dc-254cfe38351c {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:38:57 devstack sudo[106260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a809b2d1-f4c1-468a-84dc-254cfe38351c Sep 15 16:38:57 devstack sudo[106260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:38:57 devstack sudo[106260]: pam_unix(sudo:session): session closed for user root Sep 15 16:38:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ce86ea77-e4ae-4d71-a0c8-cacea1cbdfae tempest-CreateVolumesFromSnapshotTest-1375330957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a809b2d1-f4c1-468a-84dc-254cfe38351c" returned: 0 in 0.363s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:38:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ce86ea77-e4ae-4d71-a0c8-cacea1cbdfae tempest-CreateVolumesFromSnapshotTest-1375330957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a809b2d1-f4c1-468a-84dc-254cfe38351c {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:38:57 devstack sudo[106265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a809b2d1-f4c1-468a-84dc-254cfe38351c Sep 15 16:38:57 devstack sudo[106265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:38:58 devstack sudo[106265]: pam_unix(sudo:session): session closed for user root Sep 15 16:38:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ce86ea77-e4ae-4d71-a0c8-cacea1cbdfae tempest-CreateVolumesFromSnapshotTest-1375330957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a809b2d1-f4c1-468a-84dc-254cfe38351c" returned: 0 in 0.262s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:38:58 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-ce86ea77-e4ae-4d71-a0c8-cacea1cbdfae tempest-CreateVolumesFromSnapshotTest-1375330957 None] Lock "cinder-quobyte-a809b2d1-f4c1-468a-84dc-254cfe38351c" released by "delete_volume" :: held 0.667s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:38:58 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-ce86ea77-e4ae-4d71-a0c8-cacea1cbdfae tempest-CreateVolumesFromSnapshotTest-1375330957 None] Created reservations ['65d320f7-57be-4e7d-8a29-cfe01ea80387', '466230d3-cf16-4d13-88c5-aab9e66c646a', 'a60a1072-1b5f-47ee-ada3-16a378ee7145', '78e8afef-3e2d-4352-99ac-007302e2340c'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:38:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-ce86ea77-e4ae-4d71-a0c8-cacea1cbdfae tempest-CreateVolumesFromSnapshotTest-1375330957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:38:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-ce86ea77-e4ae-4d71-a0c8-cacea1cbdfae tempest-CreateVolumesFromSnapshotTest-1375330957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:38:58 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-ce86ea77-e4ae-4d71-a0c8-cacea1cbdfae tempest-CreateVolumesFromSnapshotTest-1375330957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:38:58 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-ce86ea77-e4ae-4d71-a0c8-cacea1cbdfae tempest-CreateVolumesFromSnapshotTest-1375330957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:38:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-ce86ea77-e4ae-4d71-a0c8-cacea1cbdfae tempest-CreateVolumesFromSnapshotTest-1375330957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:38:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ce86ea77-e4ae-4d71-a0c8-cacea1cbdfae tempest-CreateVolumesFromSnapshotTest-1375330957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:38:58 devstack sudo[106268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:38:58 devstack sudo[106268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:38:58 devstack sudo[106268]: pam_unix(sudo:session): session closed for user root Sep 15 16:38:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ce86ea77-e4ae-4d71-a0c8-cacea1cbdfae tempest-CreateVolumesFromSnapshotTest-1375330957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.265s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:38:58 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-ce86ea77-e4ae-4d71-a0c8-cacea1cbdfae tempest-CreateVolumesFromSnapshotTest-1375330957 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:38:58 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-ce86ea77-e4ae-4d71-a0c8-cacea1cbdfae tempest-CreateVolumesFromSnapshotTest-1375330957 None] Deleted volume successfully. Sep 15 16:38:58 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-ce86ea77-e4ae-4d71-a0c8-cacea1cbdfae tempest-CreateVolumesFromSnapshotTest-1375330957 None] Lock "cinder-a809b2d1-f4c1-468a-84dc-254cfe38351c-delete_volume" released by "delete_volume" :: held 1.125s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:38:58 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-a586f4d3-2ca4-4fb6-bc1c-43afc14d52ac tempest-CreateVolumesFromSnapshotTest-1375330957 None] Acquiring lock "cinder-5ff6d337-3fc5-4c0a-b075-252639fb871b-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:38:58 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-a586f4d3-2ca4-4fb6-bc1c-43afc14d52ac tempest-CreateVolumesFromSnapshotTest-1375330957 None] Lock "cinder-5ff6d337-3fc5-4c0a-b075-252639fb871b-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:38:58 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-a586f4d3-2ca4-4fb6-bc1c-43afc14d52ac tempest-CreateVolumesFromSnapshotTest-1375330957 None] Acquiring lock "cinder-quobyte-5ff6d337-3fc5-4c0a-b075-252639fb871b" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:38:58 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-a586f4d3-2ca4-4fb6-bc1c-43afc14d52ac tempest-CreateVolumesFromSnapshotTest-1375330957 None] Lock "cinder-quobyte-5ff6d337-3fc5-4c0a-b075-252639fb871b" acquired by "delete_volume" :: waited 0.015s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:38:58 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[0126034b-28dd-4998-938e-78dbabc7fa8d]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:38:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a586f4d3-2ca4-4fb6-bc1c-43afc14d52ac tempest-CreateVolumesFromSnapshotTest-1375330957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-5ff6d337-3fc5-4c0a-b075-252639fb871b {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:38:58 devstack sudo[106271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-5ff6d337-3fc5-4c0a-b075-252639fb871b Sep 15 16:38:58 devstack sudo[106271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:38:58 devstack sudo[106271]: pam_unix(sudo:session): session closed for user root Sep 15 16:38:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a586f4d3-2ca4-4fb6-bc1c-43afc14d52ac tempest-CreateVolumesFromSnapshotTest-1375330957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-5ff6d337-3fc5-4c0a-b075-252639fb871b" returned: 0 in 0.363s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:38:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a586f4d3-2ca4-4fb6-bc1c-43afc14d52ac tempest-CreateVolumesFromSnapshotTest-1375330957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-5ff6d337-3fc5-4c0a-b075-252639fb871b {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:38:58 devstack sudo[106276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-5ff6d337-3fc5-4c0a-b075-252639fb871b Sep 15 16:38:58 devstack sudo[106276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:38:59 devstack sudo[106276]: pam_unix(sudo:session): session closed for user root Sep 15 16:38:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a586f4d3-2ca4-4fb6-bc1c-43afc14d52ac tempest-CreateVolumesFromSnapshotTest-1375330957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-5ff6d337-3fc5-4c0a-b075-252639fb871b" returned: 0 in 0.249s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:38:59 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-a586f4d3-2ca4-4fb6-bc1c-43afc14d52ac tempest-CreateVolumesFromSnapshotTest-1375330957 None] Lock "cinder-quobyte-5ff6d337-3fc5-4c0a-b075-252639fb871b" released by "delete_volume" :: held 0.654s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:38:59 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-a586f4d3-2ca4-4fb6-bc1c-43afc14d52ac tempest-CreateVolumesFromSnapshotTest-1375330957 None] Created reservations ['2993e106-862e-43de-9789-cf5463c51642', '57e14e4c-3f72-4040-b577-dab62c4efbd4', '0563bdc4-f45d-461a-967f-ef96c3acaec8', '0d1780d3-72f6-4f4a-bef2-a9cdbc269554'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:38:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-a586f4d3-2ca4-4fb6-bc1c-43afc14d52ac tempest-CreateVolumesFromSnapshotTest-1375330957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:38:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-a586f4d3-2ca4-4fb6-bc1c-43afc14d52ac tempest-CreateVolumesFromSnapshotTest-1375330957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:38:59 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-a586f4d3-2ca4-4fb6-bc1c-43afc14d52ac tempest-CreateVolumesFromSnapshotTest-1375330957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:38:59 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-a586f4d3-2ca4-4fb6-bc1c-43afc14d52ac tempest-CreateVolumesFromSnapshotTest-1375330957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:38:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-a586f4d3-2ca4-4fb6-bc1c-43afc14d52ac tempest-CreateVolumesFromSnapshotTest-1375330957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:38:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a586f4d3-2ca4-4fb6-bc1c-43afc14d52ac tempest-CreateVolumesFromSnapshotTest-1375330957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:38:59 devstack sudo[106279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:38:59 devstack sudo[106279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:38:59 devstack sudo[106279]: pam_unix(sudo:session): session closed for user root Sep 15 16:38:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a586f4d3-2ca4-4fb6-bc1c-43afc14d52ac tempest-CreateVolumesFromSnapshotTest-1375330957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.243s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:38:59 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-a586f4d3-2ca4-4fb6-bc1c-43afc14d52ac tempest-CreateVolumesFromSnapshotTest-1375330957 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:38:59 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-a586f4d3-2ca4-4fb6-bc1c-43afc14d52ac tempest-CreateVolumesFromSnapshotTest-1375330957 None] Deleted volume successfully. Sep 15 16:38:59 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-a586f4d3-2ca4-4fb6-bc1c-43afc14d52ac tempest-CreateVolumesFromSnapshotTest-1375330957 None] Lock "cinder-5ff6d337-3fc5-4c0a-b075-252639fb871b-delete_volume" released by "delete_volume" :: held 1.084s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:38:59 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-e8d37964-0ef1-4029-b8ce-718e43707575 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Acquiring lock "cinder-12f69d56-895d-4ccb-8bd7-b75a44009dda-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:38:59 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-e8d37964-0ef1-4029-b8ce-718e43707575 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Lock "cinder-12f69d56-895d-4ccb-8bd7-b75a44009dda-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:38:59 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-e8d37964-0ef1-4029-b8ce-718e43707575 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Acquiring lock "cinder-quobyte-12f69d56-895d-4ccb-8bd7-b75a44009dda" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:38:59 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-e8d37964-0ef1-4029-b8ce-718e43707575 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Lock "cinder-quobyte-12f69d56-895d-4ccb-8bd7-b75a44009dda" acquired by "delete_volume" :: waited 0.017s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:38:59 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e1e2d65-4ead-47b7-a7a7-126e4926fafd]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:38:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e8d37964-0ef1-4029-b8ce-718e43707575 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-12f69d56-895d-4ccb-8bd7-b75a44009dda {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:38:59 devstack sudo[106282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-12f69d56-895d-4ccb-8bd7-b75a44009dda Sep 15 16:38:59 devstack sudo[106282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:38:59 devstack cinder-volume[86082]: DEBUG oslo_service.periodic_task [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86082) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 15 16:38:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:38:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:38:59 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:38:59 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:38:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:38:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:38:59 devstack sudo[106284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:38:59 devstack sudo[106284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:00 devstack sudo[106282]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e8d37964-0ef1-4029-b8ce-718e43707575 tempest-CreateVolumesFromSnapshotTest-1375330957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-12f69d56-895d-4ccb-8bd7-b75a44009dda" returned: 0 in 0.381s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e8d37964-0ef1-4029-b8ce-718e43707575 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-12f69d56-895d-4ccb-8bd7-b75a44009dda {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:00 devstack sudo[106290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-12f69d56-895d-4ccb-8bd7-b75a44009dda Sep 15 16:39:00 devstack sudo[106290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:00 devstack sudo[106284]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.275s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:00 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:39:00 devstack cinder-volume[86082]: DEBUG oslo_service.periodic_task [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Running periodic task VolumeManager._thread_info {{(pid=86082) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 15 16:39:00 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] thread count: 28 {{(pid=86082) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 15 16:39:00 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] thread info: [<_MainThread(MainThread, started 124875935469696)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86082) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 15 16:39:00 devstack sudo[106290]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e8d37964-0ef1-4029-b8ce-718e43707575 tempest-CreateVolumesFromSnapshotTest-1375330957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-12f69d56-895d-4ccb-8bd7-b75a44009dda" returned: 0 in 0.259s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:00 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-e8d37964-0ef1-4029-b8ce-718e43707575 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Lock "cinder-quobyte-12f69d56-895d-4ccb-8bd7-b75a44009dda" released by "delete_volume" :: held 0.685s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:39:00 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-e8d37964-0ef1-4029-b8ce-718e43707575 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Created reservations ['b52f5c45-5a2d-4558-8fea-ac6a77533d00', '1b6597fe-7be1-4ab8-a8fc-bcd735d50472', '1c5fdb07-c9d3-4a17-ad56-0e6216b6c221', '1492e344-a869-4995-9d71-ef56b87093a7'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:39:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-e8d37964-0ef1-4029-b8ce-718e43707575 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:39:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-e8d37964-0ef1-4029-b8ce-718e43707575 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:39:00 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-e8d37964-0ef1-4029-b8ce-718e43707575 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:39:00 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-e8d37964-0ef1-4029-b8ce-718e43707575 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:39:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-e8d37964-0ef1-4029-b8ce-718e43707575 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:39:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e8d37964-0ef1-4029-b8ce-718e43707575 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:00 devstack sudo[106293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:39:00 devstack sudo[106293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:00 devstack sudo[106293]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e8d37964-0ef1-4029-b8ce-718e43707575 tempest-CreateVolumesFromSnapshotTest-1375330957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.239s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:00 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-e8d37964-0ef1-4029-b8ce-718e43707575 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:39:00 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-e8d37964-0ef1-4029-b8ce-718e43707575 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Deleted volume successfully. Sep 15 16:39:00 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-6ec07c88-feda-4dad-9982-8dc55e0dd92b tempest-CreateVolumesFromSnapshotTest-1375330957 None] Acquiring lock "cinder-98152841-9697-430f-b656-5ce6c47dc711-delete_snapshot" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:39:00 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-6ec07c88-feda-4dad-9982-8dc55e0dd92b tempest-CreateVolumesFromSnapshotTest-1375330957 None] Lock "cinder-98152841-9697-430f-b656-5ce6c47dc711-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:39:00 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-6ec07c88-feda-4dad-9982-8dc55e0dd92b tempest-CreateVolumesFromSnapshotTest-1375330957 None] Acquiring lock "cinder-quobyte-6af77401-0a99-44aa-95cc-2de328c58079" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:39:00 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-e8d37964-0ef1-4029-b8ce-718e43707575 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Lock "cinder-12f69d56-895d-4ccb-8bd7-b75a44009dda-delete_volume" released by "delete_volume" :: held 1.177s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:39:00 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-6ec07c88-feda-4dad-9982-8dc55e0dd92b tempest-CreateVolumesFromSnapshotTest-1375330957 None] Lock "cinder-quobyte-6af77401-0a99-44aa-95cc-2de328c58079" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:39:00 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-6ec07c88-feda-4dad-9982-8dc55e0dd92b tempest-CreateVolumesFromSnapshotTest-1375330957 None] Acquiring lock "cinder-quobyte-98152841-9697-430f-b656-5ce6c47dc711" by "_delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:39:00 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-6ec07c88-feda-4dad-9982-8dc55e0dd92b tempest-CreateVolumesFromSnapshotTest-1375330957 None] Lock "cinder-quobyte-98152841-9697-430f-b656-5ce6c47dc711" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:39:00 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-6ec07c88-feda-4dad-9982-8dc55e0dd92b tempest-CreateVolumesFromSnapshotTest-1375330957 None] Deleting offline snapshot 98152841-9697-430f-b656-5ce6c47dc711 of volume 6af77401-0a99-44aa-95cc-2de328c58079 {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 15 16:39:00 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-6ec07c88-feda-4dad-9982-8dc55e0dd92b tempest-CreateVolumesFromSnapshotTest-1375330957 None] snapshot_file for this snap is: volume-6af77401-0a99-44aa-95cc-2de328c58079.98152841-9697-430f-b656-5ce6c47dc711 {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 15 16:39:00 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[3370f7db-1ab4-457c-bce1-255691ed79f9]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:39:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-6ec07c88-feda-4dad-9982-8dc55e0dd92b tempest-CreateVolumesFromSnapshotTest-1375330957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6af77401-0a99-44aa-95cc-2de328c58079.98152841-9697-430f-b656-5ce6c47dc711 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:00 devstack sudo[106296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6af77401-0a99-44aa-95cc-2de328c58079.98152841-9697-430f-b656-5ce6c47dc711 Sep 15 16:39:00 devstack sudo[106296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:01 devstack sudo[106296]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-6ec07c88-feda-4dad-9982-8dc55e0dd92b tempest-CreateVolumesFromSnapshotTest-1375330957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6af77401-0a99-44aa-95cc-2de328c58079.98152841-9697-430f-b656-5ce6c47dc711" returned: 0 in 0.359s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:01 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-6ec07c88-feda-4dad-9982-8dc55e0dd92b tempest-CreateVolumesFromSnapshotTest-1375330957 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6af77401-0a99-44aa-95cc-2de328c58079(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 16:39:01 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9750182-3fc8-49d4-93e3-b029c5b2c7f7]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:39:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-6ec07c88-feda-4dad-9982-8dc55e0dd92b tempest-CreateVolumesFromSnapshotTest-1375330957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6af77401-0a99-44aa-95cc-2de328c58079 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:01 devstack sudo[106301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6af77401-0a99-44aa-95cc-2de328c58079 Sep 15 16:39:01 devstack sudo[106301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:01 devstack sudo[106301]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-6ec07c88-feda-4dad-9982-8dc55e0dd92b tempest-CreateVolumesFromSnapshotTest-1375330957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6af77401-0a99-44aa-95cc-2de328c58079" returned: 0 in 0.367s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-6ec07c88-feda-4dad-9982-8dc55e0dd92b tempest-CreateVolumesFromSnapshotTest-1375330957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6af77401-0a99-44aa-95cc-2de328c58079.98152841-9697-430f-b656-5ce6c47dc711 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:01 devstack sudo[106306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6af77401-0a99-44aa-95cc-2de328c58079.98152841-9697-430f-b656-5ce6c47dc711 Sep 15 16:39:01 devstack sudo[106306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:01 devstack sudo[106306]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-6ec07c88-feda-4dad-9982-8dc55e0dd92b tempest-CreateVolumesFromSnapshotTest-1375330957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6af77401-0a99-44aa-95cc-2de328c58079.98152841-9697-430f-b656-5ce6c47dc711" returned: 0 in 0.339s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-6ec07c88-feda-4dad-9982-8dc55e0dd92b tempest-CreateVolumesFromSnapshotTest-1375330957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6af77401-0a99-44aa-95cc-2de328c58079.98152841-9697-430f-b656-5ce6c47dc711 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:02 devstack sudo[106311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6af77401-0a99-44aa-95cc-2de328c58079.98152841-9697-430f-b656-5ce6c47dc711 Sep 15 16:39:02 devstack sudo[106311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:02 devstack sudo[106311]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-6ec07c88-feda-4dad-9982-8dc55e0dd92b tempest-CreateVolumesFromSnapshotTest-1375330957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6af77401-0a99-44aa-95cc-2de328c58079.98152841-9697-430f-b656-5ce6c47dc711" returned: 0 in 0.243s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:02 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-6ec07c88-feda-4dad-9982-8dc55e0dd92b tempest-CreateVolumesFromSnapshotTest-1375330957 None] Lock "cinder-quobyte-98152841-9697-430f-b656-5ce6c47dc711" released by "_delete_snapshot" :: held 1.417s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:39:02 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-6ec07c88-feda-4dad-9982-8dc55e0dd92b tempest-CreateVolumesFromSnapshotTest-1375330957 None] Lock "cinder-quobyte-6af77401-0a99-44aa-95cc-2de328c58079" released by "delete_snapshot" :: held 1.437s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:39:02 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-6ec07c88-feda-4dad-9982-8dc55e0dd92b tempest-CreateVolumesFromSnapshotTest-1375330957 None] Created reservations ['f3df93af-7444-4bdf-8d4c-0e65cc767bac', '591a7250-c584-4b87-a2c1-f5714233bd30', 'c0f2576b-293f-4fc5-993f-a75696bf886d', 'b3c37dcb-d86f-4f3d-8eb4-038454532b03'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:39:02 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-6ec07c88-feda-4dad-9982-8dc55e0dd92b tempest-CreateVolumesFromSnapshotTest-1375330957 None] Delete snapshot completed successfully. Sep 15 16:39:02 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-6ec07c88-feda-4dad-9982-8dc55e0dd92b tempest-CreateVolumesFromSnapshotTest-1375330957 None] Lock "cinder-98152841-9697-430f-b656-5ce6c47dc711-delete_snapshot" released by "delete_snapshot" :: held 1.571s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:39:02 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f434bd9a-7757-43e8-b54d-078b11f85ae7 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Acquiring lock "cinder-6af77401-0a99-44aa-95cc-2de328c58079-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:39:02 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f434bd9a-7757-43e8-b54d-078b11f85ae7 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Lock "cinder-6af77401-0a99-44aa-95cc-2de328c58079-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:39:02 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f434bd9a-7757-43e8-b54d-078b11f85ae7 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Acquiring lock "cinder-quobyte-6af77401-0a99-44aa-95cc-2de328c58079" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:39:03 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f434bd9a-7757-43e8-b54d-078b11f85ae7 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Lock "cinder-quobyte-6af77401-0a99-44aa-95cc-2de328c58079" acquired by "delete_volume" :: waited 0.013s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:39:03 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[4129f482-5e2d-4cbc-bdcd-17120d5eec7a]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:39:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f434bd9a-7757-43e8-b54d-078b11f85ae7 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6af77401-0a99-44aa-95cc-2de328c58079 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:03 devstack sudo[106314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6af77401-0a99-44aa-95cc-2de328c58079 Sep 15 16:39:03 devstack sudo[106314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:03 devstack sudo[106314]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f434bd9a-7757-43e8-b54d-078b11f85ae7 tempest-CreateVolumesFromSnapshotTest-1375330957 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6af77401-0a99-44aa-95cc-2de328c58079" returned: 0 in 0.363s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f434bd9a-7757-43e8-b54d-078b11f85ae7 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6af77401-0a99-44aa-95cc-2de328c58079 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:03 devstack sudo[106319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6af77401-0a99-44aa-95cc-2de328c58079 Sep 15 16:39:03 devstack sudo[106319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:03 devstack sudo[106319]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f434bd9a-7757-43e8-b54d-078b11f85ae7 tempest-CreateVolumesFromSnapshotTest-1375330957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6af77401-0a99-44aa-95cc-2de328c58079" returned: 0 in 0.245s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:03 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f434bd9a-7757-43e8-b54d-078b11f85ae7 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Lock "cinder-quobyte-6af77401-0a99-44aa-95cc-2de328c58079" released by "delete_volume" :: held 0.673s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:39:03 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-f434bd9a-7757-43e8-b54d-078b11f85ae7 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Created reservations ['560ce825-8013-4697-a2cc-b6e54611412b', '30d6c902-4e28-4999-a765-40e9daa27274', '3d99acf6-1bb7-4e4b-9147-c4809f0a1967', '81d3cb0f-89cb-47f0-8c22-b801b427e3f8'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:39:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f434bd9a-7757-43e8-b54d-078b11f85ae7 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:39:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f434bd9a-7757-43e8-b54d-078b11f85ae7 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:39:03 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-f434bd9a-7757-43e8-b54d-078b11f85ae7 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:39:03 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-f434bd9a-7757-43e8-b54d-078b11f85ae7 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:39:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f434bd9a-7757-43e8-b54d-078b11f85ae7 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:39:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f434bd9a-7757-43e8-b54d-078b11f85ae7 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:03 devstack sudo[106322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:39:03 devstack sudo[106322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:04 devstack sudo[106322]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:04 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f434bd9a-7757-43e8-b54d-078b11f85ae7 tempest-CreateVolumesFromSnapshotTest-1375330957 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.238s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:04 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-f434bd9a-7757-43e8-b54d-078b11f85ae7 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:39:04 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-f434bd9a-7757-43e8-b54d-078b11f85ae7 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Deleted volume successfully. Sep 15 16:39:04 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-f434bd9a-7757-43e8-b54d-078b11f85ae7 tempest-CreateVolumesFromSnapshotTest-1375330957 None] Lock "cinder-6af77401-0a99-44aa-95cc-2de328c58079-delete_volume" released by "delete_volume" :: held 1.120s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:39:13 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:SELECT=46,cinder:INSERT=18,cinder:UPDATE=73,cinder:DELETE=6 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 16:39:14 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:UPDATE=73,cinder:SELECT=56,cinder:DELETE=7,cinder:INSERT=17 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 16:39:20 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-e59820ac-8483-47a0-a907-7d3a06f17bdb tempest-CinderUnicodeTest-459182968 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:39:20 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e59820ac-8483-47a0-a907-7d3a06f17bdb tempest-CinderUnicodeTest-459182968 None] Flow 'volume_create_manager' (52431f5c-0197-41fc-9ea9-fa7df5c92168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:39:20 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e59820ac-8483-47a0-a907-7d3a06f17bdb tempest-CinderUnicodeTest-459182968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56587de9-d3ce-4423-bff9-8425032505c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:20 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e59820ac-8483-47a0-a907-7d3a06f17bdb tempest-CinderUnicodeTest-459182968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56587de9-d3ce-4423-bff9-8425032505c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:39:19Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01121f71-c202-4642-b0fd-17276d3b8ee2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87e29cb6ae1c4d01ab1865f56bf45fbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:39:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:39:20Z,use_quota=True,user_id='c4a1202274e44834a6179871b85093a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:20 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e59820ac-8483-47a0-a907-7d3a06f17bdb tempest-CinderUnicodeTest-459182968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1f04f1b-bc5d-4f86-911c-df591902d1c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:20 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e59820ac-8483-47a0-a907-7d3a06f17bdb tempest-CinderUnicodeTest-459182968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1f04f1b-bc5d-4f86-911c-df591902d1c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:20 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e59820ac-8483-47a0-a907-7d3a06f17bdb tempest-CinderUnicodeTest-459182968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10f20865-26b7-4875-9c48-d16bf2d79b7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:20 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e59820ac-8483-47a0-a907-7d3a06f17bdb tempest-CinderUnicodeTest-459182968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10f20865-26b7-4875-9c48-d16bf2d79b7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01121f71-c202-4642-b0fd-17276d3b8ee2', 'volume_name': 'volume-01121f71-c202-4642-b0fd-17276d3b8ee2', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:20 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e59820ac-8483-47a0-a907-7d3a06f17bdb tempest-CinderUnicodeTest-459182968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (071587c7-45b6-42c6-846c-222f12abe0da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:20 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e59820ac-8483-47a0-a907-7d3a06f17bdb tempest-CinderUnicodeTest-459182968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (071587c7-45b6-42c6-846c-222f12abe0da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:20 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e59820ac-8483-47a0-a907-7d3a06f17bdb tempest-CinderUnicodeTest-459182968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be107ff1-4f64-4bfa-a33f-822a401b7198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:20 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-e59820ac-8483-47a0-a907-7d3a06f17bdb tempest-CinderUnicodeTest-459182968 None] Volume 01121f71-c202-4642-b0fd-17276d3b8ee2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01121f71-c202-4642-b0fd-17276d3b8ee2', 'volume_size': 1} Sep 15 16:39:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-e59820ac-8483-47a0-a907-7d3a06f17bdb tempest-CinderUnicodeTest-459182968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:39:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-e59820ac-8483-47a0-a907-7d3a06f17bdb tempest-CinderUnicodeTest-459182968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:39:20 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-e59820ac-8483-47a0-a907-7d3a06f17bdb tempest-CinderUnicodeTest-459182968 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:39:19Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01121f71-c202-4642-b0fd-17276d3b8ee2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87e29cb6ae1c4d01ab1865f56bf45fbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:39:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:39:20Z,use_quota=True,user_id='c4a1202274e44834a6179871b85093a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:39:20 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-e59820ac-8483-47a0-a907-7d3a06f17bdb tempest-CinderUnicodeTest-459182968 None] Creating volume 01121f71-c202-4642-b0fd-17276d3b8ee2 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:39:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-e59820ac-8483-47a0-a907-7d3a06f17bdb tempest-CinderUnicodeTest-459182968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:39:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-e59820ac-8483-47a0-a907-7d3a06f17bdb tempest-CinderUnicodeTest-459182968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:39:20 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-e59820ac-8483-47a0-a907-7d3a06f17bdb tempest-CinderUnicodeTest-459182968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:39:20 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-e59820ac-8483-47a0-a907-7d3a06f17bdb tempest-CinderUnicodeTest-459182968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:39:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-e59820ac-8483-47a0-a907-7d3a06f17bdb tempest-CinderUnicodeTest-459182968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:39:20 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-e59820ac-8483-47a0-a907-7d3a06f17bdb tempest-CinderUnicodeTest-459182968 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:39:20 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-e59820ac-8483-47a0-a907-7d3a06f17bdb tempest-CinderUnicodeTest-459182968 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:39:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e59820ac-8483-47a0-a907-7d3a06f17bdb tempest-CinderUnicodeTest-459182968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-01121f71-c202-4642-b0fd-17276d3b8ee2 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:20 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-5834d210-77e3-414b-b2fc-bbc71a36cfe5 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:39:20 devstack sudo[106403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-01121f71-c202-4642-b0fd-17276d3b8ee2 1073741824 Sep 15 16:39:20 devstack sudo[106403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:20 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5834d210-77e3-414b-b2fc-bbc71a36cfe5 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Flow 'volume_create_manager' (0f35af92-5b5f-41ce-aded-ce7e63319abb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:39:20 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5834d210-77e3-414b-b2fc-bbc71a36cfe5 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e426c8d4-404d-4bb0-83f7-2e5cb247b8b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:20 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5834d210-77e3-414b-b2fc-bbc71a36cfe5 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e426c8d4-404d-4bb0-83f7-2e5cb247b8b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:39:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1523356016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd71de7d-f827-46c1-af28-384968f04b0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cb4eea0668f40b997b7c4a55f06f397',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:39:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:39:20Z,use_quota=True,user_id='a2fb6be3f79b4c2daf3fc5a02b44a4f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:20 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5834d210-77e3-414b-b2fc-bbc71a36cfe5 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b0695fc-0247-41af-a788-02c4c539bd41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:20 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5834d210-77e3-414b-b2fc-bbc71a36cfe5 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b0695fc-0247-41af-a788-02c4c539bd41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:20 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5834d210-77e3-414b-b2fc-bbc71a36cfe5 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a085e01e-d4b9-43ac-9dc4-b1fcbca84edf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:20 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5834d210-77e3-414b-b2fc-bbc71a36cfe5 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a085e01e-d4b9-43ac-9dc4-b1fcbca84edf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd71de7d-f827-46c1-af28-384968f04b0b', 'volume_name': 'volume-cd71de7d-f827-46c1-af28-384968f04b0b', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:20 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5834d210-77e3-414b-b2fc-bbc71a36cfe5 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd2760d4-f641-4c36-ad6e-d2519918b3f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:20 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5834d210-77e3-414b-b2fc-bbc71a36cfe5 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd2760d4-f641-4c36-ad6e-d2519918b3f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:20 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5834d210-77e3-414b-b2fc-bbc71a36cfe5 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45b66042-ced7-465d-bdb9-2372f6882cf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:20 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-5834d210-77e3-414b-b2fc-bbc71a36cfe5 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Volume cd71de7d-f827-46c1-af28-384968f04b0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd71de7d-f827-46c1-af28-384968f04b0b', 'volume_size': 1} Sep 15 16:39:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-5834d210-77e3-414b-b2fc-bbc71a36cfe5 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:39:20 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-73a394ba-d5e7-4875-8160-a4e4c43b3032 tempest-CreateVolumesFromImageTest-1873971368 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:39:20 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-73a394ba-d5e7-4875-8160-a4e4c43b3032 tempest-CreateVolumesFromImageTest-1873971368 None] Flow 'volume_create_manager' (c9b94fde-613c-4f46-9cf2-9a5a7c3a3b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:39:20 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-73a394ba-d5e7-4875-8160-a4e4c43b3032 tempest-CreateVolumesFromImageTest-1873971368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ed57db0-1f8b-471d-81f1-8873595f79e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:20 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-73a394ba-d5e7-4875-8160-a4e4c43b3032 tempest-CreateVolumesFromImageTest-1873971368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ed57db0-1f8b-471d-81f1-8873595f79e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:39:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1649528627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d22b2874-fb00-4306-ab60-ffecc0e42430,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc47d5d7ba494840b07fcf725d2abdf1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:39:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:39:20Z,use_quota=True,user_id='6dbf828acb4540308faf45d751f9b245',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:20 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-73a394ba-d5e7-4875-8160-a4e4c43b3032 tempest-CreateVolumesFromImageTest-1873971368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b77c1017-7264-4d56-b8a5-71d02fa18b53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:20 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-73a394ba-d5e7-4875-8160-a4e4c43b3032 tempest-CreateVolumesFromImageTest-1873971368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b77c1017-7264-4d56-b8a5-71d02fa18b53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:20 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-73a394ba-d5e7-4875-8160-a4e4c43b3032 tempest-CreateVolumesFromImageTest-1873971368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ab2dee3-6622-4caf-85c0-0d7e0ef75069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:20 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-73a394ba-d5e7-4875-8160-a4e4c43b3032 tempest-CreateVolumesFromImageTest-1873971368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ab2dee3-6622-4caf-85c0-0d7e0ef75069) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd22b2874-fb00-4306-ab60-ffecc0e42430', 'volume_name': 'volume-d22b2874-fb00-4306-ab60-ffecc0e42430', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:20 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-73a394ba-d5e7-4875-8160-a4e4c43b3032 tempest-CreateVolumesFromImageTest-1873971368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c55a639-d40a-4cb3-b1e8-f741bfc09a7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:20 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-73a394ba-d5e7-4875-8160-a4e4c43b3032 tempest-CreateVolumesFromImageTest-1873971368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5c55a639-d40a-4cb3-b1e8-f741bfc09a7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:20 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-73a394ba-d5e7-4875-8160-a4e4c43b3032 tempest-CreateVolumesFromImageTest-1873971368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88656aac-08d2-4cda-9633-1b72d4aa80a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:20 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-73a394ba-d5e7-4875-8160-a4e4c43b3032 tempest-CreateVolumesFromImageTest-1873971368 None] Volume d22b2874-fb00-4306-ab60-ffecc0e42430: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d22b2874-fb00-4306-ab60-ffecc0e42430', 'volume_size': 1} Sep 15 16:39:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-73a394ba-d5e7-4875-8160-a4e4c43b3032 tempest-CreateVolumesFromImageTest-1873971368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:39:20 devstack sudo[106403]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e59820ac-8483-47a0-a907-7d3a06f17bdb tempest-CinderUnicodeTest-459182968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-01121f71-c202-4642-b0fd-17276d3b8ee2 1073741824" returned: 0 in 0.591s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e59820ac-8483-47a0-a907-7d3a06f17bdb tempest-CinderUnicodeTest-459182968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-01121f71-c202-4642-b0fd-17276d3b8ee2 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:20 devstack sudo[106409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-01121f71-c202-4642-b0fd-17276d3b8ee2 Sep 15 16:39:20 devstack sudo[106409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:20 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-67525af9-1e8c-415f-a0ac-1666a0075184 tempest-CreateVolumesFromImageTest-1873971368 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:39:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-67525af9-1e8c-415f-a0ac-1666a0075184 tempest-CreateVolumesFromImageTest-1873971368 None] Flow 'volume_create_manager' (6a8af658-241b-4ff6-a414-b2f51bef4dc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:39:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-67525af9-1e8c-415f-a0ac-1666a0075184 tempest-CreateVolumesFromImageTest-1873971368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a814bc1-e4d4-4c73-bded-a4baa1947342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-67525af9-1e8c-415f-a0ac-1666a0075184 tempest-CreateVolumesFromImageTest-1873971368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a814bc1-e4d4-4c73-bded-a4baa1947342) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:39:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-649374397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1174a50f-381a-4907-a928-41954e4fc889,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc47d5d7ba494840b07fcf725d2abdf1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:39:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:39:21Z,use_quota=True,user_id='6dbf828acb4540308faf45d751f9b245',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-67525af9-1e8c-415f-a0ac-1666a0075184 tempest-CreateVolumesFromImageTest-1873971368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (007193c2-647f-4a68-b495-c1f4bc3a712a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-67525af9-1e8c-415f-a0ac-1666a0075184 tempest-CreateVolumesFromImageTest-1873971368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (007193c2-647f-4a68-b495-c1f4bc3a712a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-67525af9-1e8c-415f-a0ac-1666a0075184 tempest-CreateVolumesFromImageTest-1873971368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (350d3f09-e3a0-4c16-b94e-b05e8021de51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-67525af9-1e8c-415f-a0ac-1666a0075184 tempest-CreateVolumesFromImageTest-1873971368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (350d3f09-e3a0-4c16-b94e-b05e8021de51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1174a50f-381a-4907-a928-41954e4fc889', 'volume_name': 'volume-1174a50f-381a-4907-a928-41954e4fc889', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-67525af9-1e8c-415f-a0ac-1666a0075184 tempest-CreateVolumesFromImageTest-1873971368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91a8fd9c-7a3d-4cf0-a4a1-1356e050a971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-67525af9-1e8c-415f-a0ac-1666a0075184 tempest-CreateVolumesFromImageTest-1873971368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91a8fd9c-7a3d-4cf0-a4a1-1356e050a971) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:21 devstack sudo[106409]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-67525af9-1e8c-415f-a0ac-1666a0075184 tempest-CreateVolumesFromImageTest-1873971368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (724dd017-a3cb-446e-baac-4c7d04928338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:21 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-67525af9-1e8c-415f-a0ac-1666a0075184 tempest-CreateVolumesFromImageTest-1873971368 None] Volume 1174a50f-381a-4907-a928-41954e4fc889: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1174a50f-381a-4907-a928-41954e4fc889', 'volume_size': 1} Sep 15 16:39:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-67525af9-1e8c-415f-a0ac-1666a0075184 tempest-CreateVolumesFromImageTest-1873971368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:39:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e59820ac-8483-47a0-a907-7d3a06f17bdb tempest-CinderUnicodeTest-459182968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-01121f71-c202-4642-b0fd-17276d3b8ee2" returned: 0 in 0.315s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:21 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-e59820ac-8483-47a0-a907-7d3a06f17bdb tempest-CinderUnicodeTest-459182968 None] <== create_volume: return (953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:39:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-e59820ac-8483-47a0-a907-7d3a06f17bdb tempest-CinderUnicodeTest-459182968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.958s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:39:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-5834d210-77e3-414b-b2fc-bbc71a36cfe5 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.805s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:39:21 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-5834d210-77e3-414b-b2fc-bbc71a36cfe5 tempest-CreateVolumesFromSnapshotTest-1571001215 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:39:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1523356016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd71de7d-f827-46c1-af28-384968f04b0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cb4eea0668f40b997b7c4a55f06f397',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:39:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:39:20Z,use_quota=True,user_id='a2fb6be3f79b4c2daf3fc5a02b44a4f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:39:21 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-5834d210-77e3-414b-b2fc-bbc71a36cfe5 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Creating volume cd71de7d-f827-46c1-af28-384968f04b0b {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:39:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-5834d210-77e3-414b-b2fc-bbc71a36cfe5 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:39:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-5834d210-77e3-414b-b2fc-bbc71a36cfe5 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:39:21 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-5834d210-77e3-414b-b2fc-bbc71a36cfe5 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:39:21 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-5834d210-77e3-414b-b2fc-bbc71a36cfe5 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:39:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-5834d210-77e3-414b-b2fc-bbc71a36cfe5 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:39:21 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-5834d210-77e3-414b-b2fc-bbc71a36cfe5 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:39:21 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-5834d210-77e3-414b-b2fc-bbc71a36cfe5 tempest-CreateVolumesFromSnapshotTest-1571001215 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:39:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5834d210-77e3-414b-b2fc-bbc71a36cfe5 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-cd71de7d-f827-46c1-af28-384968f04b0b 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:21 devstack sudo[106412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-cd71de7d-f827-46c1-af28-384968f04b0b 1073741824 Sep 15 16:39:21 devstack sudo[106412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e59820ac-8483-47a0-a907-7d3a06f17bdb tempest-CinderUnicodeTest-459182968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be107ff1-4f64-4bfa-a33f-822a401b7198) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01121f71-c202-4642-b0fd-17276d3b8ee2', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e59820ac-8483-47a0-a907-7d3a06f17bdb tempest-CinderUnicodeTest-459182968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f678c6f-c2a7-4498-b8aa-425836864ffe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:21 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-e59820ac-8483-47a0-a907-7d3a06f17bdb tempest-CinderUnicodeTest-459182968 None] Volume volume-01121f71-c202-4642-b0fd-17276d3b8ee2 (01121f71-c202-4642-b0fd-17276d3b8ee2): created successfully Sep 15 16:39:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e59820ac-8483-47a0-a907-7d3a06f17bdb tempest-CinderUnicodeTest-459182968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f678c6f-c2a7-4498-b8aa-425836864ffe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e59820ac-8483-47a0-a907-7d3a06f17bdb tempest-CinderUnicodeTest-459182968 None] Flow 'volume_create_manager' (52431f5c-0197-41fc-9ea9-fa7df5c92168) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:39:21 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-e59820ac-8483-47a0-a907-7d3a06f17bdb tempest-CinderUnicodeTest-459182968 None] Created volume successfully. Sep 15 16:39:21 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-c58dadb0-2309-4096-9765-ac0334241ee0 tempest-CreateVolumesFromImageTest-1873971368 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:39:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c58dadb0-2309-4096-9765-ac0334241ee0 tempest-CreateVolumesFromImageTest-1873971368 None] Flow 'volume_create_manager' (c7b42bcd-31b6-4437-afb3-b2208f4e3167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:39:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c58dadb0-2309-4096-9765-ac0334241ee0 tempest-CreateVolumesFromImageTest-1873971368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (359dbdf5-e829-494a-a2d1-3e8210a80957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c58dadb0-2309-4096-9765-ac0334241ee0 tempest-CreateVolumesFromImageTest-1873971368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (359dbdf5-e829-494a-a2d1-3e8210a80957) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:39:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-344239916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=389777a9-7e0d-4d29-8e62-64bbe27c364e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc47d5d7ba494840b07fcf725d2abdf1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:39:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:39:21Z,use_quota=True,user_id='6dbf828acb4540308faf45d751f9b245',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c58dadb0-2309-4096-9765-ac0334241ee0 tempest-CreateVolumesFromImageTest-1873971368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d18af0d9-5bb1-4164-a6ef-aeffc25064a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c58dadb0-2309-4096-9765-ac0334241ee0 tempest-CreateVolumesFromImageTest-1873971368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d18af0d9-5bb1-4164-a6ef-aeffc25064a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c58dadb0-2309-4096-9765-ac0334241ee0 tempest-CreateVolumesFromImageTest-1873971368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32375a7d-92bd-452b-ba58-d69c5d0a3ae3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c58dadb0-2309-4096-9765-ac0334241ee0 tempest-CreateVolumesFromImageTest-1873971368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32375a7d-92bd-452b-ba58-d69c5d0a3ae3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '389777a9-7e0d-4d29-8e62-64bbe27c364e', 'volume_name': 'volume-389777a9-7e0d-4d29-8e62-64bbe27c364e', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c58dadb0-2309-4096-9765-ac0334241ee0 tempest-CreateVolumesFromImageTest-1873971368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf175c88-abb8-4f91-9f94-3d1dee94607c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c58dadb0-2309-4096-9765-ac0334241ee0 tempest-CreateVolumesFromImageTest-1873971368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf175c88-abb8-4f91-9f94-3d1dee94607c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c58dadb0-2309-4096-9765-ac0334241ee0 tempest-CreateVolumesFromImageTest-1873971368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (827de86a-a2a1-454a-93f1-e8d2a1a76eb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:21 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-c58dadb0-2309-4096-9765-ac0334241ee0 tempest-CreateVolumesFromImageTest-1873971368 None] Volume 389777a9-7e0d-4d29-8e62-64bbe27c364e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-389777a9-7e0d-4d29-8e62-64bbe27c364e', 'volume_size': 1} Sep 15 16:39:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c58dadb0-2309-4096-9765-ac0334241ee0 tempest-CreateVolumesFromImageTest-1873971368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:39:21 devstack sudo[106412]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:21 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-60231294-6df8-419a-8fb4-28053a044d80 tempest-CreateVolumesFromImageTest-1873971368 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:39:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-60231294-6df8-419a-8fb4-28053a044d80 tempest-CreateVolumesFromImageTest-1873971368 None] Flow 'volume_create_manager' (9ea86fda-e24f-4898-84f8-d03001d85f8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:39:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-60231294-6df8-419a-8fb4-28053a044d80 tempest-CreateVolumesFromImageTest-1873971368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a0f3cfc-979e-4338-8a18-58ab8ba24e02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5834d210-77e3-414b-b2fc-bbc71a36cfe5 tempest-CreateVolumesFromSnapshotTest-1571001215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-cd71de7d-f827-46c1-af28-384968f04b0b 1073741824" returned: 0 in 0.697s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-60231294-6df8-419a-8fb4-28053a044d80 tempest-CreateVolumesFromImageTest-1873971368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a0f3cfc-979e-4338-8a18-58ab8ba24e02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:39:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1599894123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c270c3cc-2790-478b-a927-37eb45fb3941,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc47d5d7ba494840b07fcf725d2abdf1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:39:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:39:22Z,use_quota=True,user_id='6dbf828acb4540308faf45d751f9b245',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-60231294-6df8-419a-8fb4-28053a044d80 tempest-CreateVolumesFromImageTest-1873971368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9687f2b-3d98-493b-91bd-57f94008ffb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-60231294-6df8-419a-8fb4-28053a044d80 tempest-CreateVolumesFromImageTest-1873971368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9687f2b-3d98-493b-91bd-57f94008ffb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-60231294-6df8-419a-8fb4-28053a044d80 tempest-CreateVolumesFromImageTest-1873971368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf12520a-5cd6-4c10-b975-d386541b65c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-60231294-6df8-419a-8fb4-28053a044d80 tempest-CreateVolumesFromImageTest-1873971368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf12520a-5cd6-4c10-b975-d386541b65c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c270c3cc-2790-478b-a927-37eb45fb3941', 'volume_name': 'volume-c270c3cc-2790-478b-a927-37eb45fb3941', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-60231294-6df8-419a-8fb4-28053a044d80 tempest-CreateVolumesFromImageTest-1873971368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0faa5b60-160f-4ec1-8870-94fc273a67ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-60231294-6df8-419a-8fb4-28053a044d80 tempest-CreateVolumesFromImageTest-1873971368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0faa5b60-160f-4ec1-8870-94fc273a67ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-60231294-6df8-419a-8fb4-28053a044d80 tempest-CreateVolumesFromImageTest-1873971368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40a56848-6179-4c31-a457-6d2e90f1cd45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:21 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-60231294-6df8-419a-8fb4-28053a044d80 tempest-CreateVolumesFromImageTest-1873971368 None] Volume c270c3cc-2790-478b-a927-37eb45fb3941: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c270c3cc-2790-478b-a927-37eb45fb3941', 'volume_size': 1} Sep 15 16:39:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-60231294-6df8-419a-8fb4-28053a044d80 tempest-CreateVolumesFromImageTest-1873971368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:39:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5834d210-77e3-414b-b2fc-bbc71a36cfe5 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-cd71de7d-f827-46c1-af28-384968f04b0b {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:22 devstack sudo[106418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-cd71de7d-f827-46c1-af28-384968f04b0b Sep 15 16:39:22 devstack sudo[106418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:22 devstack sudo[106418]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5834d210-77e3-414b-b2fc-bbc71a36cfe5 tempest-CreateVolumesFromSnapshotTest-1571001215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-cd71de7d-f827-46c1-af28-384968f04b0b" returned: 0 in 0.369s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:22 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-5834d210-77e3-414b-b2fc-bbc71a36cfe5 tempest-CreateVolumesFromSnapshotTest-1571001215 None] <== create_volume: return (1235ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:39:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-5834d210-77e3-414b-b2fc-bbc71a36cfe5 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.242s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:39:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-73a394ba-d5e7-4875-8160-a4e4c43b3032 tempest-CreateVolumesFromImageTest-1873971368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.807s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:39:22 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-73a394ba-d5e7-4875-8160-a4e4c43b3032 tempest-CreateVolumesFromImageTest-1873971368 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:39:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1649528627',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d22b2874-fb00-4306-ab60-ffecc0e42430,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc47d5d7ba494840b07fcf725d2abdf1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:39:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:39:20Z,use_quota=True,user_id='6dbf828acb4540308faf45d751f9b245',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:39:22 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-73a394ba-d5e7-4875-8160-a4e4c43b3032 tempest-CreateVolumesFromImageTest-1873971368 None] Creating volume d22b2874-fb00-4306-ab60-ffecc0e42430 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:39:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-73a394ba-d5e7-4875-8160-a4e4c43b3032 tempest-CreateVolumesFromImageTest-1873971368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:39:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-73a394ba-d5e7-4875-8160-a4e4c43b3032 tempest-CreateVolumesFromImageTest-1873971368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:39:22 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-73a394ba-d5e7-4875-8160-a4e4c43b3032 tempest-CreateVolumesFromImageTest-1873971368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:39:22 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-73a394ba-d5e7-4875-8160-a4e4c43b3032 tempest-CreateVolumesFromImageTest-1873971368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:39:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-73a394ba-d5e7-4875-8160-a4e4c43b3032 tempest-CreateVolumesFromImageTest-1873971368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:39:22 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-73a394ba-d5e7-4875-8160-a4e4c43b3032 tempest-CreateVolumesFromImageTest-1873971368 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:39:22 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-73a394ba-d5e7-4875-8160-a4e4c43b3032 tempest-CreateVolumesFromImageTest-1873971368 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:39:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-73a394ba-d5e7-4875-8160-a4e4c43b3032 tempest-CreateVolumesFromImageTest-1873971368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-d22b2874-fb00-4306-ab60-ffecc0e42430 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:22 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5834d210-77e3-414b-b2fc-bbc71a36cfe5 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (45b66042-ced7-465d-bdb9-2372f6882cf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd71de7d-f827-46c1-af28-384968f04b0b', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:22 devstack sudo[106421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-d22b2874-fb00-4306-ab60-ffecc0e42430 1073741824 Sep 15 16:39:22 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5834d210-77e3-414b-b2fc-bbc71a36cfe5 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a14c9a19-1ef1-4762-9ab8-6dfbe28419f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:22 devstack sudo[106421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:22 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-5215f5df-fd44-4dd0-90f3-cf2ec1d4fd1b tempest-CreateVolumesFromImageTest-1873971368 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:39:22 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5215f5df-fd44-4dd0-90f3-cf2ec1d4fd1b tempest-CreateVolumesFromImageTest-1873971368 None] Flow 'volume_create_manager' (f37b1aff-9684-42b3-9886-1d87bbf00bc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:39:22 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5215f5df-fd44-4dd0-90f3-cf2ec1d4fd1b tempest-CreateVolumesFromImageTest-1873971368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84266b2d-ac4b-41ce-8ade-c55ea462e747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:22 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-5834d210-77e3-414b-b2fc-bbc71a36cfe5 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Volume volume-cd71de7d-f827-46c1-af28-384968f04b0b (cd71de7d-f827-46c1-af28-384968f04b0b): created successfully Sep 15 16:39:22 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5834d210-77e3-414b-b2fc-bbc71a36cfe5 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a14c9a19-1ef1-4762-9ab8-6dfbe28419f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:22 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5834d210-77e3-414b-b2fc-bbc71a36cfe5 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Flow 'volume_create_manager' (0f35af92-5b5f-41ce-aded-ce7e63319abb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:39:22 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5215f5df-fd44-4dd0-90f3-cf2ec1d4fd1b tempest-CreateVolumesFromImageTest-1873971368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84266b2d-ac4b-41ce-8ade-c55ea462e747) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:39:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1094739618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba4e1f09-3c42-4326-83c4-91160e99475f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc47d5d7ba494840b07fcf725d2abdf1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:39:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:39:22Z,use_quota=True,user_id='6dbf828acb4540308faf45d751f9b245',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:22 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5215f5df-fd44-4dd0-90f3-cf2ec1d4fd1b tempest-CreateVolumesFromImageTest-1873971368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f07cd5b-7b92-4d8a-a951-780259450696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:22 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5215f5df-fd44-4dd0-90f3-cf2ec1d4fd1b tempest-CreateVolumesFromImageTest-1873971368 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f07cd5b-7b92-4d8a-a951-780259450696) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:22 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5215f5df-fd44-4dd0-90f3-cf2ec1d4fd1b tempest-CreateVolumesFromImageTest-1873971368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93d346ee-4e69-4dba-9819-f54865503a8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:22 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5215f5df-fd44-4dd0-90f3-cf2ec1d4fd1b tempest-CreateVolumesFromImageTest-1873971368 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (93d346ee-4e69-4dba-9819-f54865503a8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba4e1f09-3c42-4326-83c4-91160e99475f', 'volume_name': 'volume-ba4e1f09-3c42-4326-83c4-91160e99475f', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:22 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5215f5df-fd44-4dd0-90f3-cf2ec1d4fd1b tempest-CreateVolumesFromImageTest-1873971368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51ccb0f7-35c0-4adc-9e54-ac94695da41f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:22 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5215f5df-fd44-4dd0-90f3-cf2ec1d4fd1b tempest-CreateVolumesFromImageTest-1873971368 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51ccb0f7-35c0-4adc-9e54-ac94695da41f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:22 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5215f5df-fd44-4dd0-90f3-cf2ec1d4fd1b tempest-CreateVolumesFromImageTest-1873971368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59bac3d6-29ec-4c25-9261-338f6898d8f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:22 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-5215f5df-fd44-4dd0-90f3-cf2ec1d4fd1b tempest-CreateVolumesFromImageTest-1873971368 None] Volume ba4e1f09-3c42-4326-83c4-91160e99475f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba4e1f09-3c42-4326-83c4-91160e99475f', 'volume_size': 1} Sep 15 16:39:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-5215f5df-fd44-4dd0-90f3-cf2ec1d4fd1b tempest-CreateVolumesFromImageTest-1873971368 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:39:22 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-5834d210-77e3-414b-b2fc-bbc71a36cfe5 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Created volume successfully. Sep 15 16:39:22 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-d01d4600-055d-4283-aad1-658312cc9d33 tempest-CinderUnicodeTest-459182968 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:39:22 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-d01d4600-055d-4283-aad1-658312cc9d33 tempest-CinderUnicodeTest-459182968 None] Flow 'volume_create_manager' (818e95d8-2ce0-47b2-87dc-6264d88efb3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:39:22 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-d01d4600-055d-4283-aad1-658312cc9d33 tempest-CinderUnicodeTest-459182968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43d60767-b1a5-482a-b6ee-e2d9e7a3d517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:22 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-d01d4600-055d-4283-aad1-658312cc9d33 tempest-CinderUnicodeTest-459182968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43d60767-b1a5-482a-b6ee-e2d9e7a3d517) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:39:22Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-966701008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6af01cd0-53c3-4308-b74e-bdeb12be5364,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87e29cb6ae1c4d01ab1865f56bf45fbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:39:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:39:23Z,use_quota=True,user_id='c4a1202274e44834a6179871b85093a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:22 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-d01d4600-055d-4283-aad1-658312cc9d33 tempest-CinderUnicodeTest-459182968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1509ebad-1675-4463-a253-d615c49f7709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:22 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-d01d4600-055d-4283-aad1-658312cc9d33 tempest-CinderUnicodeTest-459182968 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1509ebad-1675-4463-a253-d615c49f7709) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:22 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-d01d4600-055d-4283-aad1-658312cc9d33 tempest-CinderUnicodeTest-459182968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bea407f-84d7-4e96-a854-ca63be2b0d6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:22 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-d01d4600-055d-4283-aad1-658312cc9d33 tempest-CinderUnicodeTest-459182968 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bea407f-84d7-4e96-a854-ca63be2b0d6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6af01cd0-53c3-4308-b74e-bdeb12be5364', 'volume_name': 'volume-6af01cd0-53c3-4308-b74e-bdeb12be5364', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:22 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-d01d4600-055d-4283-aad1-658312cc9d33 tempest-CinderUnicodeTest-459182968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b1cc0ba-3b25-406d-bad9-15c2c1542314) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:22 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-d01d4600-055d-4283-aad1-658312cc9d33 tempest-CinderUnicodeTest-459182968 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b1cc0ba-3b25-406d-bad9-15c2c1542314) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:22 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-d01d4600-055d-4283-aad1-658312cc9d33 tempest-CinderUnicodeTest-459182968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96a0deca-d2c3-405d-98b9-e05318c95225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:22 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-d01d4600-055d-4283-aad1-658312cc9d33 tempest-CinderUnicodeTest-459182968 None] Volume 6af01cd0-53c3-4308-b74e-bdeb12be5364: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6af01cd0-53c3-4308-b74e-bdeb12be5364', 'volume_size': 1} Sep 15 16:39:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-d01d4600-055d-4283-aad1-658312cc9d33 tempest-CinderUnicodeTest-459182968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:39:22 devstack sudo[106421]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-73a394ba-d5e7-4875-8160-a4e4c43b3032 tempest-CreateVolumesFromImageTest-1873971368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-d22b2874-fb00-4306-ab60-ffecc0e42430 1073741824" returned: 0 in 0.561s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-73a394ba-d5e7-4875-8160-a4e4c43b3032 tempest-CreateVolumesFromImageTest-1873971368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-d22b2874-fb00-4306-ab60-ffecc0e42430 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:22 devstack sudo[106426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-d22b2874-fb00-4306-ab60-ffecc0e42430 Sep 15 16:39:23 devstack sudo[106426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-a91284d5-c7d7-4046-9b59-deb596370298 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:39:23 devstack sudo[106426]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-73a394ba-d5e7-4875-8160-a4e4c43b3032 tempest-CreateVolumesFromImageTest-1873971368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-d22b2874-fb00-4306-ab60-ffecc0e42430" returned: 0 in 0.289s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:23 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-73a394ba-d5e7-4875-8160-a4e4c43b3032 tempest-CreateVolumesFromImageTest-1873971368 None] <== create_volume: return (894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:39:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-73a394ba-d5e7-4875-8160-a4e4c43b3032 tempest-CreateVolumesFromImageTest-1873971368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.898s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:39:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-67525af9-1e8c-415f-a0ac-1666a0075184 tempest-CreateVolumesFromImageTest-1873971368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.163s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:39:23 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-67525af9-1e8c-415f-a0ac-1666a0075184 tempest-CreateVolumesFromImageTest-1873971368 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:39:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-649374397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1174a50f-381a-4907-a928-41954e4fc889,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc47d5d7ba494840b07fcf725d2abdf1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:39:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:39:21Z,use_quota=True,user_id='6dbf828acb4540308faf45d751f9b245',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:39:23 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-67525af9-1e8c-415f-a0ac-1666a0075184 tempest-CreateVolumesFromImageTest-1873971368 None] Creating volume 1174a50f-381a-4907-a928-41954e4fc889 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:39:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-67525af9-1e8c-415f-a0ac-1666a0075184 tempest-CreateVolumesFromImageTest-1873971368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:39:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-67525af9-1e8c-415f-a0ac-1666a0075184 tempest-CreateVolumesFromImageTest-1873971368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:39:23 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-67525af9-1e8c-415f-a0ac-1666a0075184 tempest-CreateVolumesFromImageTest-1873971368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:39:23 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-67525af9-1e8c-415f-a0ac-1666a0075184 tempest-CreateVolumesFromImageTest-1873971368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:39:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-67525af9-1e8c-415f-a0ac-1666a0075184 tempest-CreateVolumesFromImageTest-1873971368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:39:23 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-67525af9-1e8c-415f-a0ac-1666a0075184 tempest-CreateVolumesFromImageTest-1873971368 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:39:23 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-67525af9-1e8c-415f-a0ac-1666a0075184 tempest-CreateVolumesFromImageTest-1873971368 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:39:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-67525af9-1e8c-415f-a0ac-1666a0075184 tempest-CreateVolumesFromImageTest-1873971368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1174a50f-381a-4907-a928-41954e4fc889 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:23 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-73a394ba-d5e7-4875-8160-a4e4c43b3032 tempest-CreateVolumesFromImageTest-1873971368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88656aac-08d2-4cda-9633-1b72d4aa80a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d22b2874-fb00-4306-ab60-ffecc0e42430', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:23 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-73a394ba-d5e7-4875-8160-a4e4c43b3032 tempest-CreateVolumesFromImageTest-1873971368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f878fac-e146-455f-b26e-1e11a612c77f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:23 devstack sudo[106429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1174a50f-381a-4907-a928-41954e4fc889 1073741824 Sep 15 16:39:23 devstack sudo[106429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:23 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-73a394ba-d5e7-4875-8160-a4e4c43b3032 tempest-CreateVolumesFromImageTest-1873971368 None] Volume volume-d22b2874-fb00-4306-ab60-ffecc0e42430 (d22b2874-fb00-4306-ab60-ffecc0e42430): created successfully Sep 15 16:39:23 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-73a394ba-d5e7-4875-8160-a4e4c43b3032 tempest-CreateVolumesFromImageTest-1873971368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f878fac-e146-455f-b26e-1e11a612c77f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:23 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-73a394ba-d5e7-4875-8160-a4e4c43b3032 tempest-CreateVolumesFromImageTest-1873971368 None] Flow 'volume_create_manager' (c9b94fde-613c-4f46-9cf2-9a5a7c3a3b02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:39:23 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-73a394ba-d5e7-4875-8160-a4e4c43b3032 tempest-CreateVolumesFromImageTest-1873971368 None] Created volume successfully. Sep 15 16:39:23 devstack sudo[106429]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-67525af9-1e8c-415f-a0ac-1666a0075184 tempest-CreateVolumesFromImageTest-1873971368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1174a50f-381a-4907-a928-41954e4fc889 1073741824" returned: 0 in 0.477s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-67525af9-1e8c-415f-a0ac-1666a0075184 tempest-CreateVolumesFromImageTest-1873971368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1174a50f-381a-4907-a928-41954e4fc889 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:23 devstack sudo[106435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1174a50f-381a-4907-a928-41954e4fc889 Sep 15 16:39:23 devstack sudo[106435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:24 devstack sudo[106435]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-67525af9-1e8c-415f-a0ac-1666a0075184 tempest-CreateVolumesFromImageTest-1873971368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1174a50f-381a-4907-a928-41954e4fc889" returned: 0 in 0.258s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:24 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-67525af9-1e8c-415f-a0ac-1666a0075184 tempest-CreateVolumesFromImageTest-1873971368 None] <== create_volume: return (776ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:39:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-67525af9-1e8c-415f-a0ac-1666a0075184 tempest-CreateVolumesFromImageTest-1873971368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.778s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:39:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c58dadb0-2309-4096-9765-ac0334241ee0 tempest-CreateVolumesFromImageTest-1873971368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.468s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:39:24 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c58dadb0-2309-4096-9765-ac0334241ee0 tempest-CreateVolumesFromImageTest-1873971368 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:39:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-344239916',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=389777a9-7e0d-4d29-8e62-64bbe27c364e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc47d5d7ba494840b07fcf725d2abdf1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:39:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:39:21Z,use_quota=True,user_id='6dbf828acb4540308faf45d751f9b245',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:39:24 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-c58dadb0-2309-4096-9765-ac0334241ee0 tempest-CreateVolumesFromImageTest-1873971368 None] Creating volume 389777a9-7e0d-4d29-8e62-64bbe27c364e {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:39:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c58dadb0-2309-4096-9765-ac0334241ee0 tempest-CreateVolumesFromImageTest-1873971368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:39:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c58dadb0-2309-4096-9765-ac0334241ee0 tempest-CreateVolumesFromImageTest-1873971368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:39:24 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c58dadb0-2309-4096-9765-ac0334241ee0 tempest-CreateVolumesFromImageTest-1873971368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:39:24 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c58dadb0-2309-4096-9765-ac0334241ee0 tempest-CreateVolumesFromImageTest-1873971368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:39:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c58dadb0-2309-4096-9765-ac0334241ee0 tempest-CreateVolumesFromImageTest-1873971368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:39:24 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c58dadb0-2309-4096-9765-ac0334241ee0 tempest-CreateVolumesFromImageTest-1873971368 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:39:24 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-c58dadb0-2309-4096-9765-ac0334241ee0 tempest-CreateVolumesFromImageTest-1873971368 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:39:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c58dadb0-2309-4096-9765-ac0334241ee0 tempest-CreateVolumesFromImageTest-1873971368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-389777a9-7e0d-4d29-8e62-64bbe27c364e 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:24 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-67525af9-1e8c-415f-a0ac-1666a0075184 tempest-CreateVolumesFromImageTest-1873971368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (724dd017-a3cb-446e-baac-4c7d04928338) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1174a50f-381a-4907-a928-41954e4fc889', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:24 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-67525af9-1e8c-415f-a0ac-1666a0075184 tempest-CreateVolumesFromImageTest-1873971368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29c569a0-aa2e-43d2-b5e3-73fb31d61528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:24 devstack sudo[106438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-389777a9-7e0d-4d29-8e62-64bbe27c364e 1073741824 Sep 15 16:39:24 devstack sudo[106438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:24 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-67525af9-1e8c-415f-a0ac-1666a0075184 tempest-CreateVolumesFromImageTest-1873971368 None] Volume volume-1174a50f-381a-4907-a928-41954e4fc889 (1174a50f-381a-4907-a928-41954e4fc889): created successfully Sep 15 16:39:24 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-67525af9-1e8c-415f-a0ac-1666a0075184 tempest-CreateVolumesFromImageTest-1873971368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29c569a0-aa2e-43d2-b5e3-73fb31d61528) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:24 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-67525af9-1e8c-415f-a0ac-1666a0075184 tempest-CreateVolumesFromImageTest-1873971368 None] Flow 'volume_create_manager' (6a8af658-241b-4ff6-a414-b2f51bef4dc9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:39:24 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-67525af9-1e8c-415f-a0ac-1666a0075184 tempest-CreateVolumesFromImageTest-1873971368 None] Created volume successfully. Sep 15 16:39:24 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-04a38b4e-5987-473b-99bb-e57c00cebc64 tempest-VolumeAndVolumeTypeFromImageTest-1876313635 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:39:24 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-04a38b4e-5987-473b-99bb-e57c00cebc64 tempest-VolumeAndVolumeTypeFromImageTest-1876313635 None] Flow 'volume_create_manager' (f1a39208-5391-4ca9-bb47-3dda4e19a517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:39:24 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-04a38b4e-5987-473b-99bb-e57c00cebc64 tempest-VolumeAndVolumeTypeFromImageTest-1876313635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd700372-454b-4cf3-a0e6-cfeed1a477c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:24 devstack sudo[106438]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c58dadb0-2309-4096-9765-ac0334241ee0 tempest-CreateVolumesFromImageTest-1873971368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-389777a9-7e0d-4d29-8e62-64bbe27c364e 1073741824" returned: 0 in 0.519s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:24 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-04a38b4e-5987-473b-99bb-e57c00cebc64 tempest-VolumeAndVolumeTypeFromImageTest-1876313635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd700372-454b-4cf3-a0e6-cfeed1a477c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:39:24Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fda87a6-d750-4c35-9054-3145868cb76c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd93258ed29b400199966faa1eeaee06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:39:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:39:24Z,use_quota=True,user_id='e380344dfb5c4554a45739f86f1dbda0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f881039-cff9-4709-98e0-9e6949a34543),volume_type_id=2f881039-cff9-4709-98e0-9e6949a34543)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:24 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-04a38b4e-5987-473b-99bb-e57c00cebc64 tempest-VolumeAndVolumeTypeFromImageTest-1876313635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5691914-cfe7-4afa-905f-b9925ac7e419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:24 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-04a38b4e-5987-473b-99bb-e57c00cebc64 tempest-VolumeAndVolumeTypeFromImageTest-1876313635 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5691914-cfe7-4afa-905f-b9925ac7e419) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:24 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-04a38b4e-5987-473b-99bb-e57c00cebc64 tempest-VolumeAndVolumeTypeFromImageTest-1876313635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea118556-1686-4ac5-be54-34a1335d9595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:24 devstack cinder-volume[86082]: DEBUG cinder.image.glance [None req-04a38b4e-5987-473b-99bb-e57c00cebc64 tempest-VolumeAndVolumeTypeFromImageTest-1876313635 None] Creating Keystone auth plugin from conf {{(pid=86082) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 15 16:39:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c58dadb0-2309-4096-9765-ac0334241ee0 tempest-CreateVolumesFromImageTest-1873971368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-389777a9-7e0d-4d29-8e62-64bbe27c364e {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:24 devstack sudo[106444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-389777a9-7e0d-4d29-8e62-64bbe27c364e Sep 15 16:39:24 devstack sudo[106444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:24 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-04a38b4e-5987-473b-99bb-e57c00cebc64 tempest-VolumeAndVolumeTypeFromImageTest-1876313635 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea118556-1686-4ac5-be54-34a1335d9595) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4fda87a6-d750-4c35-9054-3145868cb76c', 'volume_name': 'volume-4fda87a6-d750-4c35-9054-3145868cb76c', 'volume_size': 1, 'image_id': '1a6a23d1-804d-46d6-8f3a-f9b08a29242e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1a6a23d1-804d-46d6-8f3a-f9b08a29242e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd03c05ed7fc6e810c02ccc442dee6c04', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'cd93258ed29b400199966faa1eeaee06', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '416b8c21fc9721d3f65bdd01f15ebb408dbf4259f161549ab433c843f1f45c43f81cf6eedc93dcfef29efccc9e3892cb420bb92cb9e1aed8659d25c3708f7349', 'id': '1a6a23d1-804d-46d6-8f3a-f9b08a29242e', 'created_at': datetime.datetime(2026, 9, 15, 14, 39, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 15, 14, 39, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1a6a23d1-804d-46d6-8f3a-f9b08a29242e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:24 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-04a38b4e-5987-473b-99bb-e57c00cebc64 tempest-VolumeAndVolumeTypeFromImageTest-1876313635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93bb07f9-83b0-4d76-bdef-7d64ceb6b159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:24 devstack sudo[106444]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:24 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-04a38b4e-5987-473b-99bb-e57c00cebc64 tempest-VolumeAndVolumeTypeFromImageTest-1876313635 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93bb07f9-83b0-4d76-bdef-7d64ceb6b159) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:24 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-04a38b4e-5987-473b-99bb-e57c00cebc64 tempest-VolumeAndVolumeTypeFromImageTest-1876313635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (113f7941-46b5-418b-abe9-111237d21ed1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:24 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-04a38b4e-5987-473b-99bb-e57c00cebc64 tempest-VolumeAndVolumeTypeFromImageTest-1876313635 None] Volume 4fda87a6-d750-4c35-9054-3145868cb76c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4fda87a6-d750-4c35-9054-3145868cb76c', 'volume_size': 1, 'image_id': '1a6a23d1-804d-46d6-8f3a-f9b08a29242e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1a6a23d1-804d-46d6-8f3a-f9b08a29242e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd03c05ed7fc6e810c02ccc442dee6c04', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'cd93258ed29b400199966faa1eeaee06', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '416b8c21fc9721d3f65bdd01f15ebb408dbf4259f161549ab433c843f1f45c43f81cf6eedc93dcfef29efccc9e3892cb420bb92cb9e1aed8659d25c3708f7349', 'id': '1a6a23d1-804d-46d6-8f3a-f9b08a29242e', 'created_at': datetime.datetime(2026, 9, 15, 14, 39, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 15, 14, 39, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1a6a23d1-804d-46d6-8f3a-f9b08a29242e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 15 16:39:24 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-04a38b4e-5987-473b-99bb-e57c00cebc64 tempest-VolumeAndVolumeTypeFromImageTest-1876313635 None] Trying to clone 4fda87a6-d750-4c35-9054-3145868cb76c from image 1a6a23d1-804d-46d6-8f3a-f9b08a29242e at location (None, [{'url': 'file:///opt/stack/data/glance/images/1a6a23d1-804d-46d6-8f3a-f9b08a29242e', 'metadata': {}}]). {{(pid=86082) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 15 16:39:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c58dadb0-2309-4096-9765-ac0334241ee0 tempest-CreateVolumesFromImageTest-1873971368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-389777a9-7e0d-4d29-8e62-64bbe27c364e" returned: 0 in 0.266s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:24 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c58dadb0-2309-4096-9765-ac0334241ee0 tempest-CreateVolumesFromImageTest-1873971368 None] <== create_volume: return (857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:39:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c58dadb0-2309-4096-9765-ac0334241ee0 tempest-CreateVolumesFromImageTest-1873971368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.859s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:39:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-60231294-6df8-419a-8fb4-28053a044d80 tempest-CreateVolumesFromImageTest-1873971368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.978s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:39:24 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-60231294-6df8-419a-8fb4-28053a044d80 tempest-CreateVolumesFromImageTest-1873971368 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:39:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1599894123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c270c3cc-2790-478b-a927-37eb45fb3941,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc47d5d7ba494840b07fcf725d2abdf1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:39:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:39:22Z,use_quota=True,user_id='6dbf828acb4540308faf45d751f9b245',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:39:24 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-60231294-6df8-419a-8fb4-28053a044d80 tempest-CreateVolumesFromImageTest-1873971368 None] Creating volume c270c3cc-2790-478b-a927-37eb45fb3941 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:39:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-60231294-6df8-419a-8fb4-28053a044d80 tempest-CreateVolumesFromImageTest-1873971368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:39:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-60231294-6df8-419a-8fb4-28053a044d80 tempest-CreateVolumesFromImageTest-1873971368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:39:24 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-60231294-6df8-419a-8fb4-28053a044d80 tempest-CreateVolumesFromImageTest-1873971368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:39:24 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-60231294-6df8-419a-8fb4-28053a044d80 tempest-CreateVolumesFromImageTest-1873971368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:39:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-60231294-6df8-419a-8fb4-28053a044d80 tempest-CreateVolumesFromImageTest-1873971368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:39:24 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-60231294-6df8-419a-8fb4-28053a044d80 tempest-CreateVolumesFromImageTest-1873971368 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:39:24 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-60231294-6df8-419a-8fb4-28053a044d80 tempest-CreateVolumesFromImageTest-1873971368 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:39:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-60231294-6df8-419a-8fb4-28053a044d80 tempest-CreateVolumesFromImageTest-1873971368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c270c3cc-2790-478b-a927-37eb45fb3941 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:24 devstack sudo[106447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c270c3cc-2790-478b-a927-37eb45fb3941 1073741824 Sep 15 16:39:24 devstack sudo[106447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:24 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c58dadb0-2309-4096-9765-ac0334241ee0 tempest-CreateVolumesFromImageTest-1873971368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (827de86a-a2a1-454a-93f1-e8d2a1a76eb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-389777a9-7e0d-4d29-8e62-64bbe27c364e', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:24 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c58dadb0-2309-4096-9765-ac0334241ee0 tempest-CreateVolumesFromImageTest-1873971368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34aa0cbb-87ce-4510-9d8a-c868cfaeb942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:24 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-c58dadb0-2309-4096-9765-ac0334241ee0 tempest-CreateVolumesFromImageTest-1873971368 None] Volume volume-389777a9-7e0d-4d29-8e62-64bbe27c364e (389777a9-7e0d-4d29-8e62-64bbe27c364e): created successfully Sep 15 16:39:24 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c58dadb0-2309-4096-9765-ac0334241ee0 tempest-CreateVolumesFromImageTest-1873971368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34aa0cbb-87ce-4510-9d8a-c868cfaeb942) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:24 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c58dadb0-2309-4096-9765-ac0334241ee0 tempest-CreateVolumesFromImageTest-1873971368 None] Flow 'volume_create_manager' (c7b42bcd-31b6-4437-afb3-b2208f4e3167) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:39:24 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-c58dadb0-2309-4096-9765-ac0334241ee0 tempest-CreateVolumesFromImageTest-1873971368 None] Created volume successfully. Sep 15 16:39:25 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-04a38b4e-5987-473b-99bb-e57c00cebc64 tempest-VolumeAndVolumeTypeFromImageTest-1876313635 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_1a6a23d1-804d-46d6-8f3a-f9b08a29242e_9wpokc5vdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86082) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 15 16:39:25 devstack cinder-volume[86082]: INFO cinder.image.image_utils [None req-04a38b4e-5987-473b-99bb-e57c00cebc64 tempest-VolumeAndVolumeTypeFromImageTest-1876313635 None] Image download 0.00 MB at 0.00 MB/s Sep 15 16:39:25 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa542e97-24cf-4c38-8f03-3195fb971dcf]: (4, 'raw') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:39:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-04a38b4e-5987-473b-99bb-e57c00cebc64 tempest-VolumeAndVolumeTypeFromImageTest-1876313635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1a6a23d1-804d-46d6-8f3a-f9b08a29242e_9wpokc5vdevstack@QuobyteHD {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:25 devstack sudo[106449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1a6a23d1-804d-46d6-8f3a-f9b08a29242e_9wpokc5vdevstack@QuobyteHD Sep 15 16:39:25 devstack sudo[106449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:25 devstack sudo[106447]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-60231294-6df8-419a-8fb4-28053a044d80 tempest-CreateVolumesFromImageTest-1873971368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c270c3cc-2790-478b-a927-37eb45fb3941 1073741824" returned: 0 in 0.460s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:25 devstack sudo[106449]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-04a38b4e-5987-473b-99bb-e57c00cebc64 tempest-VolumeAndVolumeTypeFromImageTest-1876313635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1a6a23d1-804d-46d6-8f3a-f9b08a29242e_9wpokc5vdevstack@QuobyteHD" returned: 0 in 0.347s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-04a38b4e-5987-473b-99bb-e57c00cebc64 tempest-VolumeAndVolumeTypeFromImageTest-1876313635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1a6a23d1-804d-46d6-8f3a-f9b08a29242e_9wpokc5vdevstack@QuobyteHD {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-60231294-6df8-419a-8fb4-28053a044d80 tempest-CreateVolumesFromImageTest-1873971368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c270c3cc-2790-478b-a927-37eb45fb3941 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:25 devstack sudo[106457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c270c3cc-2790-478b-a927-37eb45fb3941 Sep 15 16:39:25 devstack sudo[106457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:25 devstack sudo[106456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1a6a23d1-804d-46d6-8f3a-f9b08a29242e_9wpokc5vdevstack@QuobyteHD Sep 15 16:39:25 devstack sudo[106456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:25 devstack sudo[106457]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-60231294-6df8-419a-8fb4-28053a044d80 tempest-CreateVolumesFromImageTest-1873971368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c270c3cc-2790-478b-a927-37eb45fb3941" returned: 0 in 0.272s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:25 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-60231294-6df8-419a-8fb4-28053a044d80 tempest-CreateVolumesFromImageTest-1873971368 None] <== create_volume: return (790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:39:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-60231294-6df8-419a-8fb4-28053a044d80 tempest-CreateVolumesFromImageTest-1873971368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.793s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:39:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-5215f5df-fd44-4dd0-90f3-cf2ec1d4fd1b tempest-CreateVolumesFromImageTest-1873971368 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.176s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:39:25 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-5215f5df-fd44-4dd0-90f3-cf2ec1d4fd1b tempest-CreateVolumesFromImageTest-1873971368 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:39:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1094739618',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba4e1f09-3c42-4326-83c4-91160e99475f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc47d5d7ba494840b07fcf725d2abdf1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:39:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:39:22Z,use_quota=True,user_id='6dbf828acb4540308faf45d751f9b245',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:39:25 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-5215f5df-fd44-4dd0-90f3-cf2ec1d4fd1b tempest-CreateVolumesFromImageTest-1873971368 None] Creating volume ba4e1f09-3c42-4326-83c4-91160e99475f {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:39:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-5215f5df-fd44-4dd0-90f3-cf2ec1d4fd1b tempest-CreateVolumesFromImageTest-1873971368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:39:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-5215f5df-fd44-4dd0-90f3-cf2ec1d4fd1b tempest-CreateVolumesFromImageTest-1873971368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:39:25 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-5215f5df-fd44-4dd0-90f3-cf2ec1d4fd1b tempest-CreateVolumesFromImageTest-1873971368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:39:25 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-5215f5df-fd44-4dd0-90f3-cf2ec1d4fd1b tempest-CreateVolumesFromImageTest-1873971368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:39:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-5215f5df-fd44-4dd0-90f3-cf2ec1d4fd1b tempest-CreateVolumesFromImageTest-1873971368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:39:25 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-5215f5df-fd44-4dd0-90f3-cf2ec1d4fd1b tempest-CreateVolumesFromImageTest-1873971368 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:39:25 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-5215f5df-fd44-4dd0-90f3-cf2ec1d4fd1b tempest-CreateVolumesFromImageTest-1873971368 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:39:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5215f5df-fd44-4dd0-90f3-cf2ec1d4fd1b tempest-CreateVolumesFromImageTest-1873971368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ba4e1f09-3c42-4326-83c4-91160e99475f 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:25 devstack sudo[106456]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:25 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-60231294-6df8-419a-8fb4-28053a044d80 tempest-CreateVolumesFromImageTest-1873971368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40a56848-6179-4c31-a457-6d2e90f1cd45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c270c3cc-2790-478b-a927-37eb45fb3941', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:25 devstack sudo[106464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ba4e1f09-3c42-4326-83c4-91160e99475f 1073741824 Sep 15 16:39:25 devstack sudo[106464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:25 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-60231294-6df8-419a-8fb4-28053a044d80 tempest-CreateVolumesFromImageTest-1873971368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d42550e-3b88-452f-9f27-c290c76cbc86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-04a38b4e-5987-473b-99bb-e57c00cebc64 tempest-VolumeAndVolumeTypeFromImageTest-1876313635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1a6a23d1-804d-46d6-8f3a-f9b08a29242e_9wpokc5vdevstack@QuobyteHD" returned: 1 in 0.360s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-04a38b4e-5987-473b-99bb-e57c00cebc64 tempest-VolumeAndVolumeTypeFromImageTest-1876313635 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1a6a23d1-804d-46d6-8f3a-f9b08a29242e_9wpokc5vdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 15 16:39:25 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-04a38b4e-5987-473b-99bb-e57c00cebc64 tempest-VolumeAndVolumeTypeFromImageTest-1876313635 None] Temporary image 1a6a23d1-804d-46d6-8f3a-f9b08a29242e is fetched for user e380344dfb5c4554a45739f86f1dbda0. {{(pid=86082) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 15 16:39:25 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-60231294-6df8-419a-8fb4-28053a044d80 tempest-CreateVolumesFromImageTest-1873971368 None] Volume volume-c270c3cc-2790-478b-a927-37eb45fb3941 (c270c3cc-2790-478b-a927-37eb45fb3941): created successfully Sep 15 16:39:25 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-60231294-6df8-419a-8fb4-28053a044d80 tempest-CreateVolumesFromImageTest-1873971368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d42550e-3b88-452f-9f27-c290c76cbc86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:25 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-60231294-6df8-419a-8fb4-28053a044d80 tempest-CreateVolumesFromImageTest-1873971368 None] Flow 'volume_create_manager' (9ea86fda-e24f-4898-84f8-d03001d85f8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:39:25 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-60231294-6df8-419a-8fb4-28053a044d80 tempest-CreateVolumesFromImageTest-1873971368 None] Created volume successfully. Sep 15 16:39:25 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c67a5aa-1b1e-4c65-8112-228301f3e85b]: (4, 'raw') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:39:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-04a38b4e-5987-473b-99bb-e57c00cebc64 tempest-VolumeAndVolumeTypeFromImageTest-1876313635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1a6a23d1-804d-46d6-8f3a-f9b08a29242e_9wpokc5vdevstack@QuobyteHD {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:25 devstack sudo[106466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1a6a23d1-804d-46d6-8f3a-f9b08a29242e_9wpokc5vdevstack@QuobyteHD Sep 15 16:39:25 devstack sudo[106466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:26 devstack sudo[106464]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5215f5df-fd44-4dd0-90f3-cf2ec1d4fd1b tempest-CreateVolumesFromImageTest-1873971368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ba4e1f09-3c42-4326-83c4-91160e99475f 1073741824" returned: 0 in 0.431s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5215f5df-fd44-4dd0-90f3-cf2ec1d4fd1b tempest-CreateVolumesFromImageTest-1873971368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ba4e1f09-3c42-4326-83c4-91160e99475f {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:26 devstack sudo[106466]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-04a38b4e-5987-473b-99bb-e57c00cebc64 tempest-VolumeAndVolumeTypeFromImageTest-1876313635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1a6a23d1-804d-46d6-8f3a-f9b08a29242e_9wpokc5vdevstack@QuobyteHD" returned: 0 in 0.352s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-04a38b4e-5987-473b-99bb-e57c00cebc64 tempest-VolumeAndVolumeTypeFromImageTest-1876313635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1a6a23d1-804d-46d6-8f3a-f9b08a29242e_9wpokc5vdevstack@QuobyteHD {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:26 devstack sudo[106473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ba4e1f09-3c42-4326-83c4-91160e99475f Sep 15 16:39:26 devstack sudo[106473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:26 devstack sudo[106474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1a6a23d1-804d-46d6-8f3a-f9b08a29242e_9wpokc5vdevstack@QuobyteHD Sep 15 16:39:26 devstack sudo[106474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:26 devstack sudo[106473]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5215f5df-fd44-4dd0-90f3-cf2ec1d4fd1b tempest-CreateVolumesFromImageTest-1873971368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ba4e1f09-3c42-4326-83c4-91160e99475f" returned: 0 in 0.246s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:26 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-5215f5df-fd44-4dd0-90f3-cf2ec1d4fd1b tempest-CreateVolumesFromImageTest-1873971368 None] <== create_volume: return (717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:39:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-5215f5df-fd44-4dd0-90f3-cf2ec1d4fd1b tempest-CreateVolumesFromImageTest-1873971368 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.722s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:39:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-d01d4600-055d-4283-aad1-658312cc9d33 tempest-CinderUnicodeTest-459182968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.738s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:39:26 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-d01d4600-055d-4283-aad1-658312cc9d33 tempest-CinderUnicodeTest-459182968 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:39:22Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-966701008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6af01cd0-53c3-4308-b74e-bdeb12be5364,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87e29cb6ae1c4d01ab1865f56bf45fbc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:39:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:39:23Z,use_quota=True,user_id='c4a1202274e44834a6179871b85093a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:39:26 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-d01d4600-055d-4283-aad1-658312cc9d33 tempest-CinderUnicodeTest-459182968 None] Creating volume 6af01cd0-53c3-4308-b74e-bdeb12be5364 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:39:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-d01d4600-055d-4283-aad1-658312cc9d33 tempest-CinderUnicodeTest-459182968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:39:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-d01d4600-055d-4283-aad1-658312cc9d33 tempest-CinderUnicodeTest-459182968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:39:26 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-d01d4600-055d-4283-aad1-658312cc9d33 tempest-CinderUnicodeTest-459182968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:39:26 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-d01d4600-055d-4283-aad1-658312cc9d33 tempest-CinderUnicodeTest-459182968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:39:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-d01d4600-055d-4283-aad1-658312cc9d33 tempest-CinderUnicodeTest-459182968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:39:26 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-d01d4600-055d-4283-aad1-658312cc9d33 tempest-CinderUnicodeTest-459182968 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:39:26 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-d01d4600-055d-4283-aad1-658312cc9d33 tempest-CinderUnicodeTest-459182968 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:39:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d01d4600-055d-4283-aad1-658312cc9d33 tempest-CinderUnicodeTest-459182968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6af01cd0-53c3-4308-b74e-bdeb12be5364 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:26 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5215f5df-fd44-4dd0-90f3-cf2ec1d4fd1b tempest-CreateVolumesFromImageTest-1873971368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59bac3d6-29ec-4c25-9261-338f6898d8f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba4e1f09-3c42-4326-83c4-91160e99475f', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:26 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5215f5df-fd44-4dd0-90f3-cf2ec1d4fd1b tempest-CreateVolumesFromImageTest-1873971368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd416236-87d7-40aa-b0ea-10b020d9b101) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:26 devstack sudo[106478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6af01cd0-53c3-4308-b74e-bdeb12be5364 1073741824 Sep 15 16:39:26 devstack sudo[106478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:26 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-5215f5df-fd44-4dd0-90f3-cf2ec1d4fd1b tempest-CreateVolumesFromImageTest-1873971368 None] Volume volume-ba4e1f09-3c42-4326-83c4-91160e99475f (ba4e1f09-3c42-4326-83c4-91160e99475f): created successfully Sep 15 16:39:26 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5215f5df-fd44-4dd0-90f3-cf2ec1d4fd1b tempest-CreateVolumesFromImageTest-1873971368 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd416236-87d7-40aa-b0ea-10b020d9b101) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:26 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5215f5df-fd44-4dd0-90f3-cf2ec1d4fd1b tempest-CreateVolumesFromImageTest-1873971368 None] Flow 'volume_create_manager' (f37b1aff-9684-42b3-9886-1d87bbf00bc0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:39:26 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-5215f5df-fd44-4dd0-90f3-cf2ec1d4fd1b tempest-CreateVolumesFromImageTest-1873971368 None] Created volume successfully. Sep 15 16:39:26 devstack sudo[106474]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-04a38b4e-5987-473b-99bb-e57c00cebc64 tempest-VolumeAndVolumeTypeFromImageTest-1876313635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1a6a23d1-804d-46d6-8f3a-f9b08a29242e_9wpokc5vdevstack@QuobyteHD" returned: 1 in 0.349s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-04a38b4e-5987-473b-99bb-e57c00cebc64 tempest-VolumeAndVolumeTypeFromImageTest-1876313635 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1a6a23d1-804d-46d6-8f3a-f9b08a29242e_9wpokc5vdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 15 16:39:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-04a38b4e-5987-473b-99bb-e57c00cebc64 tempest-VolumeAndVolumeTypeFromImageTest-1876313635 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:39:26 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-5555f16c-96be-4bc0-83b8-6db8df1c45a6 tempest-CreateVolumesFromImageTest-1873971368 None] Acquiring lock "cinder-ba4e1f09-3c42-4326-83c4-91160e99475f-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:39:26 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-5555f16c-96be-4bc0-83b8-6db8df1c45a6 tempest-CreateVolumesFromImageTest-1873971368 None] Lock "cinder-ba4e1f09-3c42-4326-83c4-91160e99475f-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:39:26 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-5555f16c-96be-4bc0-83b8-6db8df1c45a6 tempest-CreateVolumesFromImageTest-1873971368 None] Acquiring lock "cinder-quobyte-ba4e1f09-3c42-4326-83c4-91160e99475f" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:39:26 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-5555f16c-96be-4bc0-83b8-6db8df1c45a6 tempest-CreateVolumesFromImageTest-1873971368 None] Lock "cinder-quobyte-ba4e1f09-3c42-4326-83c4-91160e99475f" acquired by "delete_volume" :: waited 0.016s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:39:26 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[887531c5-1911-4987-929d-96f377092a14]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:39:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5555f16c-96be-4bc0-83b8-6db8df1c45a6 tempest-CreateVolumesFromImageTest-1873971368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ba4e1f09-3c42-4326-83c4-91160e99475f {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:26 devstack sudo[106478]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d01d4600-055d-4283-aad1-658312cc9d33 tempest-CinderUnicodeTest-459182968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6af01cd0-53c3-4308-b74e-bdeb12be5364 1073741824" returned: 0 in 0.499s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d01d4600-055d-4283-aad1-658312cc9d33 tempest-CinderUnicodeTest-459182968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6af01cd0-53c3-4308-b74e-bdeb12be5364 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:27 devstack sudo[106487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ba4e1f09-3c42-4326-83c4-91160e99475f Sep 15 16:39:27 devstack sudo[106487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:27 devstack sudo[106488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6af01cd0-53c3-4308-b74e-bdeb12be5364 Sep 15 16:39:27 devstack sudo[106488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:27 devstack sudo[106488]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d01d4600-055d-4283-aad1-658312cc9d33 tempest-CinderUnicodeTest-459182968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6af01cd0-53c3-4308-b74e-bdeb12be5364" returned: 0 in 0.263s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:27 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-d01d4600-055d-4283-aad1-658312cc9d33 tempest-CinderUnicodeTest-459182968 None] <== create_volume: return (809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:39:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-d01d4600-055d-4283-aad1-658312cc9d33 tempest-CinderUnicodeTest-459182968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.814s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:39:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-a91284d5-c7d7-4046-9b59-deb596370298 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.033s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:39:27 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-d01d4600-055d-4283-aad1-658312cc9d33 tempest-CinderUnicodeTest-459182968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96a0deca-d2c3-405d-98b9-e05318c95225) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6af01cd0-53c3-4308-b74e-bdeb12be5364', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:27 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-d01d4600-055d-4283-aad1-658312cc9d33 tempest-CinderUnicodeTest-459182968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b39c0a7-b814-4ce0-9dea-212c80a92c74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:27 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-a91284d5-c7d7-4046-9b59-deb596370298 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Creating offline snapshot dd388514-09bc-4c0a-b89b-8db9dc161222 of volume cd71de7d-f827-46c1-af28-384968f04b0b {{(pid=86082) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 15 16:39:27 devstack sudo[106487]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5555f16c-96be-4bc0-83b8-6db8df1c45a6 tempest-CreateVolumesFromImageTest-1873971368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ba4e1f09-3c42-4326-83c4-91160e99475f" returned: 0 in 0.414s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5555f16c-96be-4bc0-83b8-6db8df1c45a6 tempest-CreateVolumesFromImageTest-1873971368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ba4e1f09-3c42-4326-83c4-91160e99475f {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:27 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8a3f628-7159-4404-8b01-225453312b68]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:39:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a91284d5-c7d7-4046-9b59-deb596370298 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-cd71de7d-f827-46c1-af28-384968f04b0b {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:27 devstack sudo[106496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ba4e1f09-3c42-4326-83c4-91160e99475f Sep 15 16:39:27 devstack sudo[106496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:27 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-d01d4600-055d-4283-aad1-658312cc9d33 tempest-CinderUnicodeTest-459182968 None] Volume volume-6af01cd0-53c3-4308-b74e-bdeb12be5364 (6af01cd0-53c3-4308-b74e-bdeb12be5364): created successfully Sep 15 16:39:27 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-d01d4600-055d-4283-aad1-658312cc9d33 tempest-CinderUnicodeTest-459182968 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b39c0a7-b814-4ce0-9dea-212c80a92c74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:27 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-d01d4600-055d-4283-aad1-658312cc9d33 tempest-CinderUnicodeTest-459182968 None] Flow 'volume_create_manager' (818e95d8-2ce0-47b2-87dc-6264d88efb3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:39:27 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-d01d4600-055d-4283-aad1-658312cc9d33 tempest-CinderUnicodeTest-459182968 None] Created volume successfully. Sep 15 16:39:27 devstack sudo[106497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-cd71de7d-f827-46c1-af28-384968f04b0b Sep 15 16:39:27 devstack sudo[106497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:27 devstack sudo[106496]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5555f16c-96be-4bc0-83b8-6db8df1c45a6 tempest-CreateVolumesFromImageTest-1873971368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-ba4e1f09-3c42-4326-83c4-91160e99475f" returned: 0 in 0.259s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:27 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-5555f16c-96be-4bc0-83b8-6db8df1c45a6 tempest-CreateVolumesFromImageTest-1873971368 None] Lock "cinder-quobyte-ba4e1f09-3c42-4326-83c4-91160e99475f" released by "delete_volume" :: held 0.733s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:39:27 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-5555f16c-96be-4bc0-83b8-6db8df1c45a6 tempest-CreateVolumesFromImageTest-1873971368 None] Created reservations ['dbdac55e-9363-4b98-a255-8f73b5f542d3', 'eb2682fe-c8c8-426d-80e2-001b54c6af5f', '39ee73a5-2686-460c-9101-350e562c48e9', '388f1be2-a843-4796-8b9d-4cc7b19adfe3'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:39:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-5555f16c-96be-4bc0-83b8-6db8df1c45a6 tempest-CreateVolumesFromImageTest-1873971368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:39:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-5555f16c-96be-4bc0-83b8-6db8df1c45a6 tempest-CreateVolumesFromImageTest-1873971368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:39:27 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-5555f16c-96be-4bc0-83b8-6db8df1c45a6 tempest-CreateVolumesFromImageTest-1873971368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:39:27 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-5555f16c-96be-4bc0-83b8-6db8df1c45a6 tempest-CreateVolumesFromImageTest-1873971368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:39:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-5555f16c-96be-4bc0-83b8-6db8df1c45a6 tempest-CreateVolumesFromImageTest-1873971368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:39:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5555f16c-96be-4bc0-83b8-6db8df1c45a6 tempest-CreateVolumesFromImageTest-1873971368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:27 devstack sudo[106497]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:27 devstack sudo[106504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:39:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a91284d5-c7d7-4046-9b59-deb596370298 tempest-CreateVolumesFromSnapshotTest-1571001215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-cd71de7d-f827-46c1-af28-384968f04b0b" returned: 0 in 0.409s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:27 devstack sudo[106504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a91284d5-c7d7-4046-9b59-deb596370298 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-cd71de7d-f827-46c1-af28-384968f04b0b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-cd71de7d-f827-46c1-af28-384968f04b0b.dd388514-09bc-4c0a-b89b-8db9dc161222 1G {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:27 devstack sudo[106506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-cd71de7d-f827-46c1-af28-384968f04b0b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-cd71de7d-f827-46c1-af28-384968f04b0b.dd388514-09bc-4c0a-b89b-8db9dc161222 1G Sep 15 16:39:27 devstack sudo[106506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:27 devstack sudo[106504]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5555f16c-96be-4bc0-83b8-6db8df1c45a6 tempest-CreateVolumesFromImageTest-1873971368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.275s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:27 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-5555f16c-96be-4bc0-83b8-6db8df1c45a6 tempest-CreateVolumesFromImageTest-1873971368 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:39:27 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-5555f16c-96be-4bc0-83b8-6db8df1c45a6 tempest-CreateVolumesFromImageTest-1873971368 None] Deleted volume successfully. Sep 15 16:39:28 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-5555f16c-96be-4bc0-83b8-6db8df1c45a6 tempest-CreateVolumesFromImageTest-1873971368 None] Lock "cinder-ba4e1f09-3c42-4326-83c4-91160e99475f-delete_volume" released by "delete_volume" :: held 1.212s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:39:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-0c9a8dba-c779-493e-b74c-ee5f6813502f tempest-CinderUnicodeTest-459182968 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:39:28 devstack sudo[106506]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a91284d5-c7d7-4046-9b59-deb596370298 tempest-CreateVolumesFromSnapshotTest-1571001215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-cd71de7d-f827-46c1-af28-384968f04b0b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-cd71de7d-f827-46c1-af28-384968f04b0b.dd388514-09bc-4c0a-b89b-8db9dc161222 1G" returned: 0 in 0.489s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a91284d5-c7d7-4046-9b59-deb596370298 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd71de7d-f827-46c1-af28-384968f04b0b -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-cd71de7d-f827-46c1-af28-384968f04b0b.dd388514-09bc-4c0a-b89b-8db9dc161222 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:28 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-8f4c2c7f-a051-41b9-9f03-1474f85e11eb tempest-CreateVolumesFromImageTest-1873971368 None] Acquiring lock "cinder-c270c3cc-2790-478b-a927-37eb45fb3941-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:39:28 devstack sudo[106512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd71de7d-f827-46c1-af28-384968f04b0b -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-cd71de7d-f827-46c1-af28-384968f04b0b.dd388514-09bc-4c0a-b89b-8db9dc161222 Sep 15 16:39:28 devstack sudo[106512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:28 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-8f4c2c7f-a051-41b9-9f03-1474f85e11eb tempest-CreateVolumesFromImageTest-1873971368 None] Lock "cinder-c270c3cc-2790-478b-a927-37eb45fb3941-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:39:28 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-8f4c2c7f-a051-41b9-9f03-1474f85e11eb tempest-CreateVolumesFromImageTest-1873971368 None] Acquiring lock "cinder-quobyte-c270c3cc-2790-478b-a927-37eb45fb3941" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:39:28 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-8f4c2c7f-a051-41b9-9f03-1474f85e11eb tempest-CreateVolumesFromImageTest-1873971368 None] Lock "cinder-quobyte-c270c3cc-2790-478b-a927-37eb45fb3941" acquired by "delete_volume" :: waited 0.020s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:39:28 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ef6abcc-853f-4d2d-9f8a-757db0e99028]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:39:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8f4c2c7f-a051-41b9-9f03-1474f85e11eb tempest-CreateVolumesFromImageTest-1873971368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c270c3cc-2790-478b-a927-37eb45fb3941 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:28 devstack sudo[106514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c270c3cc-2790-478b-a927-37eb45fb3941 Sep 15 16:39:28 devstack sudo[106514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:28 devstack sudo[106512]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a91284d5-c7d7-4046-9b59-deb596370298 tempest-CreateVolumesFromSnapshotTest-1571001215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cd71de7d-f827-46c1-af28-384968f04b0b -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-cd71de7d-f827-46c1-af28-384968f04b0b.dd388514-09bc-4c0a-b89b-8db9dc161222" returned: 0 in 0.336s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:28 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-a91284d5-c7d7-4046-9b59-deb596370298 tempest-CreateVolumesFromSnapshotTest-1571001215 None] /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-cd71de7d-f827-46c1-af28-384968f04b0b.dd388514-09bc-4c0a-b89b-8db9dc161222 is being set with open permissions: ugo+rw Sep 15 16:39:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a91284d5-c7d7-4046-9b59-deb596370298 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-cd71de7d-f827-46c1-af28-384968f04b0b.dd388514-09bc-4c0a-b89b-8db9dc161222 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:28 devstack sudo[106519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-cd71de7d-f827-46c1-af28-384968f04b0b.dd388514-09bc-4c0a-b89b-8db9dc161222 Sep 15 16:39:28 devstack sudo[106519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:28 devstack sudo[106514]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8f4c2c7f-a051-41b9-9f03-1474f85e11eb tempest-CreateVolumesFromImageTest-1873971368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c270c3cc-2790-478b-a927-37eb45fb3941" returned: 0 in 0.382s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8f4c2c7f-a051-41b9-9f03-1474f85e11eb tempest-CreateVolumesFromImageTest-1873971368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c270c3cc-2790-478b-a927-37eb45fb3941 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:28 devstack sudo[106524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c270c3cc-2790-478b-a927-37eb45fb3941 Sep 15 16:39:28 devstack sudo[106524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:28 devstack sudo[106519]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a91284d5-c7d7-4046-9b59-deb596370298 tempest-CreateVolumesFromSnapshotTest-1571001215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-cd71de7d-f827-46c1-af28-384968f04b0b.dd388514-09bc-4c0a-b89b-8db9dc161222" returned: 0 in 0.254s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a91284d5-c7d7-4046-9b59-deb596370298 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-cd71de7d-f827-46c1-af28-384968f04b0b.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:28 devstack sudo[106527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-cd71de7d-f827-46c1-af28-384968f04b0b.info Sep 15 16:39:28 devstack sudo[106527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:28 devstack sudo[106524]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8f4c2c7f-a051-41b9-9f03-1474f85e11eb tempest-CreateVolumesFromImageTest-1873971368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c270c3cc-2790-478b-a927-37eb45fb3941" returned: 0 in 0.246s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:29 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-8f4c2c7f-a051-41b9-9f03-1474f85e11eb tempest-CreateVolumesFromImageTest-1873971368 None] Lock "cinder-quobyte-c270c3cc-2790-478b-a927-37eb45fb3941" released by "delete_volume" :: held 0.672s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:39:29 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-8f4c2c7f-a051-41b9-9f03-1474f85e11eb tempest-CreateVolumesFromImageTest-1873971368 None] Created reservations ['bd790abd-7dee-4fd6-88d7-63b777a25e15', '577501cd-eb57-437b-9178-b376da553228', 'b6dd8f92-2df4-46fb-a7eb-a496db47daac', 'a07d35b8-49f6-43f4-8b18-eaccec7764cf'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:39:29 devstack sudo[106527]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a91284d5-c7d7-4046-9b59-deb596370298 tempest-CreateVolumesFromSnapshotTest-1571001215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-cd71de7d-f827-46c1-af28-384968f04b0b.info" returned: 0 in 0.273s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:29 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-a91284d5-c7d7-4046-9b59-deb596370298 tempest-CreateVolumesFromSnapshotTest-1571001215 None] /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-cd71de7d-f827-46c1-af28-384968f04b0b.info is being set with open permissions: ugo+rw Sep 15 16:39:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a91284d5-c7d7-4046-9b59-deb596370298 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-cd71de7d-f827-46c1-af28-384968f04b0b.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-8f4c2c7f-a051-41b9-9f03-1474f85e11eb tempest-CreateVolumesFromImageTest-1873971368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:39:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-8f4c2c7f-a051-41b9-9f03-1474f85e11eb tempest-CreateVolumesFromImageTest-1873971368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:39:29 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-8f4c2c7f-a051-41b9-9f03-1474f85e11eb tempest-CreateVolumesFromImageTest-1873971368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:39:29 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-8f4c2c7f-a051-41b9-9f03-1474f85e11eb tempest-CreateVolumesFromImageTest-1873971368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:39:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-8f4c2c7f-a051-41b9-9f03-1474f85e11eb tempest-CreateVolumesFromImageTest-1873971368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:39:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8f4c2c7f-a051-41b9-9f03-1474f85e11eb tempest-CreateVolumesFromImageTest-1873971368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:29 devstack sudo[106531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-cd71de7d-f827-46c1-af28-384968f04b0b.info Sep 15 16:39:29 devstack sudo[106531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:29 devstack sudo[106533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:39:29 devstack sudo[106533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:29 devstack sudo[106531]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a91284d5-c7d7-4046-9b59-deb596370298 tempest-CreateVolumesFromSnapshotTest-1571001215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-cd71de7d-f827-46c1-af28-384968f04b0b.info" returned: 0 in 0.260s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-a91284d5-c7d7-4046-9b59-deb596370298 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.159s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:39:29 devstack sudo[106533]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-04a38b4e-5987-473b-99bb-e57c00cebc64 tempest-VolumeAndVolumeTypeFromImageTest-1876313635 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.871s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:39:29 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-04a38b4e-5987-473b-99bb-e57c00cebc64 tempest-VolumeAndVolumeTypeFromImageTest-1876313635 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:39:24Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fda87a6-d750-4c35-9054-3145868cb76c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd93258ed29b400199966faa1eeaee06',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:39:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:39:24Z,use_quota=True,user_id='e380344dfb5c4554a45739f86f1dbda0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2f881039-cff9-4709-98e0-9e6949a34543),volume_type_id=2f881039-cff9-4709-98e0-9e6949a34543)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:39:29 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-04a38b4e-5987-473b-99bb-e57c00cebc64 tempest-VolumeAndVolumeTypeFromImageTest-1876313635 None] Creating volume 4fda87a6-d750-4c35-9054-3145868cb76c {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:39:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-04a38b4e-5987-473b-99bb-e57c00cebc64 tempest-VolumeAndVolumeTypeFromImageTest-1876313635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:39:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-04a38b4e-5987-473b-99bb-e57c00cebc64 tempest-VolumeAndVolumeTypeFromImageTest-1876313635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:39:29 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-04a38b4e-5987-473b-99bb-e57c00cebc64 tempest-VolumeAndVolumeTypeFromImageTest-1876313635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:39:29 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-04a38b4e-5987-473b-99bb-e57c00cebc64 tempest-VolumeAndVolumeTypeFromImageTest-1876313635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:39:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-04a38b4e-5987-473b-99bb-e57c00cebc64 tempest-VolumeAndVolumeTypeFromImageTest-1876313635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:39:29 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-04a38b4e-5987-473b-99bb-e57c00cebc64 tempest-VolumeAndVolumeTypeFromImageTest-1876313635 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:39:29 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-04a38b4e-5987-473b-99bb-e57c00cebc64 tempest-VolumeAndVolumeTypeFromImageTest-1876313635 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:39:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-04a38b4e-5987-473b-99bb-e57c00cebc64 tempest-VolumeAndVolumeTypeFromImageTest-1876313635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-4fda87a6-d750-4c35-9054-3145868cb76c 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:29 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-716d629e-6051-4e04-9bf2-1af972733997 tempest-CreateVolumesFromImageTest-1873971368 None] Acquiring lock "cinder-389777a9-7e0d-4d29-8e62-64bbe27c364e-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:39:29 devstack sudo[106537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-4fda87a6-d750-4c35-9054-3145868cb76c 1073741824 Sep 15 16:39:29 devstack sudo[106537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8f4c2c7f-a051-41b9-9f03-1474f85e11eb tempest-CreateVolumesFromImageTest-1873971368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.314s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:29 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-8f4c2c7f-a051-41b9-9f03-1474f85e11eb tempest-CreateVolumesFromImageTest-1873971368 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:39:29 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-8f4c2c7f-a051-41b9-9f03-1474f85e11eb tempest-CreateVolumesFromImageTest-1873971368 None] Deleted volume successfully. Sep 15 16:39:29 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-716d629e-6051-4e04-9bf2-1af972733997 tempest-CreateVolumesFromImageTest-1873971368 None] Lock "cinder-389777a9-7e0d-4d29-8e62-64bbe27c364e-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:39:29 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-a91284d5-c7d7-4046-9b59-deb596370298 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Create snapshot completed successfully Sep 15 16:39:29 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-8f4c2c7f-a051-41b9-9f03-1474f85e11eb tempest-CreateVolumesFromImageTest-1873971368 None] Lock "cinder-c270c3cc-2790-478b-a927-37eb45fb3941-delete_volume" released by "delete_volume" :: held 1.239s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:39:29 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-716d629e-6051-4e04-9bf2-1af972733997 tempest-CreateVolumesFromImageTest-1873971368 None] Acquiring lock "cinder-quobyte-389777a9-7e0d-4d29-8e62-64bbe27c364e" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:39:29 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-716d629e-6051-4e04-9bf2-1af972733997 tempest-CreateVolumesFromImageTest-1873971368 None] Lock "cinder-quobyte-389777a9-7e0d-4d29-8e62-64bbe27c364e" acquired by "delete_volume" :: waited 0.017s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:39:29 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[8555063b-70c4-45e2-a125-53a90463b894]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:39:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-716d629e-6051-4e04-9bf2-1af972733997 tempest-CreateVolumesFromImageTest-1873971368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-389777a9-7e0d-4d29-8e62-64bbe27c364e {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:29 devstack sudo[106539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-389777a9-7e0d-4d29-8e62-64bbe27c364e Sep 15 16:39:29 devstack sudo[106539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:29 devstack sudo[106537]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-04a38b4e-5987-473b-99bb-e57c00cebc64 tempest-VolumeAndVolumeTypeFromImageTest-1876313635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-4fda87a6-d750-4c35-9054-3145868cb76c 1073741824" returned: 0 in 0.455s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-04a38b4e-5987-473b-99bb-e57c00cebc64 tempest-VolumeAndVolumeTypeFromImageTest-1876313635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-4fda87a6-d750-4c35-9054-3145868cb76c {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:29 devstack sudo[106547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-4fda87a6-d750-4c35-9054-3145868cb76c Sep 15 16:39:29 devstack sudo[106547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:29 devstack sudo[106539]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-716d629e-6051-4e04-9bf2-1af972733997 tempest-CreateVolumesFromImageTest-1873971368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-389777a9-7e0d-4d29-8e62-64bbe27c364e" returned: 0 in 0.396s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-716d629e-6051-4e04-9bf2-1af972733997 tempest-CreateVolumesFromImageTest-1873971368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-389777a9-7e0d-4d29-8e62-64bbe27c364e {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:29 devstack sudo[106549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-389777a9-7e0d-4d29-8e62-64bbe27c364e Sep 15 16:39:29 devstack sudo[106549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:30 devstack sudo[106547]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-04a38b4e-5987-473b-99bb-e57c00cebc64 tempest-VolumeAndVolumeTypeFromImageTest-1876313635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-4fda87a6-d750-4c35-9054-3145868cb76c" returned: 0 in 0.251s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:30 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-04a38b4e-5987-473b-99bb-e57c00cebc64 tempest-VolumeAndVolumeTypeFromImageTest-1876313635 None] <== create_volume: return (748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:39:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-04a38b4e-5987-473b-99bb-e57c00cebc64 tempest-VolumeAndVolumeTypeFromImageTest-1876313635 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.753s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:39:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-0c9a8dba-c779-493e-b74c-ee5f6813502f tempest-CinderUnicodeTest-459182968 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.968s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:39:30 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-0c9a8dba-c779-493e-b74c-ee5f6813502f tempest-CinderUnicodeTest-459182968 None] Creating offline snapshot b557302c-7876-4720-a395-ba65e533237c of volume 6af01cd0-53c3-4308-b74e-bdeb12be5364 {{(pid=86082) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 15 16:39:30 devstack cinder-volume[86082]: DEBUG cinder.volume.volume_utils [None req-04a38b4e-5987-473b-99bb-e57c00cebc64 tempest-VolumeAndVolumeTypeFromImageTest-1876313635 None] Attempting download of 1a6a23d1-804d-46d6-8f3a-f9b08a29242e ((None, [{'url': 'file:///opt/stack/data/glance/images/1a6a23d1-804d-46d6-8f3a-f9b08a29242e', 'metadata': {}}])) to volume 4fda87a6-d750-4c35-9054-3145868cb76c. {{(pid=86082) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 15 16:39:30 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[274f6293-9a4f-48bf-b5c6-263ec170ad98]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:39:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0c9a8dba-c779-493e-b74c-ee5f6813502f tempest-CinderUnicodeTest-459182968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6af01cd0-53c3-4308-b74e-bdeb12be5364 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:30 devstack sudo[106549]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-716d629e-6051-4e04-9bf2-1af972733997 tempest-CreateVolumesFromImageTest-1873971368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-389777a9-7e0d-4d29-8e62-64bbe27c364e" returned: 0 in 0.256s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:30 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-716d629e-6051-4e04-9bf2-1af972733997 tempest-CreateVolumesFromImageTest-1873971368 None] Lock "cinder-quobyte-389777a9-7e0d-4d29-8e62-64bbe27c364e" released by "delete_volume" :: held 0.711s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:39:30 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[b320f45e-4e4f-4088-af9f-a421b60207d4]: (4, 'raw') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:39:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-04a38b4e-5987-473b-99bb-e57c00cebc64 tempest-VolumeAndVolumeTypeFromImageTest-1876313635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1a6a23d1-804d-46d6-8f3a-f9b08a29242e_a0unu_bb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:30 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-716d629e-6051-4e04-9bf2-1af972733997 tempest-CreateVolumesFromImageTest-1873971368 None] Created reservations ['5ce47c9d-7c57-47b2-a738-e7797062b5cf', '5d355f7b-29f7-4213-8afa-885d3277a39a', 'fc919a29-a993-4c59-a291-cadd5d8b7a4d', 'a9088ccb-4e34-4ee5-bb7a-ad5605748dc9'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:39:30 devstack sudo[106553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6af01cd0-53c3-4308-b74e-bdeb12be5364 Sep 15 16:39:30 devstack sudo[106553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-716d629e-6051-4e04-9bf2-1af972733997 tempest-CreateVolumesFromImageTest-1873971368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:39:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-716d629e-6051-4e04-9bf2-1af972733997 tempest-CreateVolumesFromImageTest-1873971368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:39:30 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-716d629e-6051-4e04-9bf2-1af972733997 tempest-CreateVolumesFromImageTest-1873971368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:39:30 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-716d629e-6051-4e04-9bf2-1af972733997 tempest-CreateVolumesFromImageTest-1873971368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:39:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-716d629e-6051-4e04-9bf2-1af972733997 tempest-CreateVolumesFromImageTest-1873971368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:39:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-716d629e-6051-4e04-9bf2-1af972733997 tempest-CreateVolumesFromImageTest-1873971368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:30 devstack sudo[106554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1a6a23d1-804d-46d6-8f3a-f9b08a29242e_a0unu_bb Sep 15 16:39:30 devstack sudo[106554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:30 devstack sudo[106557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:39:30 devstack sudo[106557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:30 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-acc0a097-ac42-4d64-b573-e27f49185715 tempest-CreateVolumesFromImageTest-1873971368 None] Acquiring lock "cinder-1174a50f-381a-4907-a928-41954e4fc889-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:39:30 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-acc0a097-ac42-4d64-b573-e27f49185715 tempest-CreateVolumesFromImageTest-1873971368 None] Lock "cinder-1174a50f-381a-4907-a928-41954e4fc889-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:39:30 devstack sudo[106553]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0c9a8dba-c779-493e-b74c-ee5f6813502f tempest-CinderUnicodeTest-459182968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6af01cd0-53c3-4308-b74e-bdeb12be5364" returned: 0 in 0.481s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:30 devstack sudo[106554]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0c9a8dba-c779-493e-b74c-ee5f6813502f tempest-CinderUnicodeTest-459182968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6af01cd0-53c3-4308-b74e-bdeb12be5364,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6af01cd0-53c3-4308-b74e-bdeb12be5364.b557302c-7876-4720-a395-ba65e533237c 1G {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-04a38b4e-5987-473b-99bb-e57c00cebc64 tempest-VolumeAndVolumeTypeFromImageTest-1876313635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_1a6a23d1-804d-46d6-8f3a-f9b08a29242e_a0unu_bb" returned: 0 in 0.444s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-04a38b4e-5987-473b-99bb-e57c00cebc64 tempest-VolumeAndVolumeTypeFromImageTest-1876313635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1a6a23d1-804d-46d6-8f3a-f9b08a29242e_a0unu_bb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:30 devstack sudo[106565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6af01cd0-53c3-4308-b74e-bdeb12be5364,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6af01cd0-53c3-4308-b74e-bdeb12be5364.b557302c-7876-4720-a395-ba65e533237c 1G Sep 15 16:39:30 devstack sudo[106565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:30 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-acc0a097-ac42-4d64-b573-e27f49185715 tempest-CreateVolumesFromImageTest-1873971368 None] Acquiring lock "cinder-quobyte-1174a50f-381a-4907-a928-41954e4fc889" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:39:30 devstack sudo[106557]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-716d629e-6051-4e04-9bf2-1af972733997 tempest-CreateVolumesFromImageTest-1873971368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.378s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:30 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-716d629e-6051-4e04-9bf2-1af972733997 tempest-CreateVolumesFromImageTest-1873971368 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:39:30 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-716d629e-6051-4e04-9bf2-1af972733997 tempest-CreateVolumesFromImageTest-1873971368 None] Deleted volume successfully. Sep 15 16:39:30 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-acc0a097-ac42-4d64-b573-e27f49185715 tempest-CreateVolumesFromImageTest-1873971368 None] Lock "cinder-quobyte-1174a50f-381a-4907-a928-41954e4fc889" acquired by "delete_volume" :: waited 0.077s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:39:30 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-716d629e-6051-4e04-9bf2-1af972733997 tempest-CreateVolumesFromImageTest-1873971368 None] Lock "cinder-389777a9-7e0d-4d29-8e62-64bbe27c364e-delete_volume" released by "delete_volume" :: held 1.377s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:39:30 devstack sudo[106566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1a6a23d1-804d-46d6-8f3a-f9b08a29242e_a0unu_bb Sep 15 16:39:30 devstack sudo[106566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:30 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[e28bca70-d1f7-489c-8512-0fba4e59cf6f]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:39:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-acc0a097-ac42-4d64-b573-e27f49185715 tempest-CreateVolumesFromImageTest-1873971368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1174a50f-381a-4907-a928-41954e4fc889 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:31 devstack sudo[106569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1174a50f-381a-4907-a928-41954e4fc889 Sep 15 16:39:31 devstack sudo[106569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:31 devstack sudo[106566]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-04a38b4e-5987-473b-99bb-e57c00cebc64 tempest-VolumeAndVolumeTypeFromImageTest-1876313635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1a6a23d1-804d-46d6-8f3a-f9b08a29242e_a0unu_bb" returned: 1 in 0.438s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-04a38b4e-5987-473b-99bb-e57c00cebc64 tempest-VolumeAndVolumeTypeFromImageTest-1876313635 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_1a6a23d1-804d-46d6-8f3a-f9b08a29242e_a0unu_bb' failed. Not Retrying. {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 15 16:39:31 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee994d25-0845-4dee-8c3a-d3cac0ddcafe]: (4, 'raw') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:39:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-04a38b4e-5987-473b-99bb-e57c00cebc64 tempest-VolumeAndVolumeTypeFromImageTest-1876313635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1a6a23d1-804d-46d6-8f3a-f9b08a29242e_9wpokc5vdevstack@QuobyteHD {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:31 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-c72e6a86-ccc7-47d6-a592-5474bbf21716 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:39:31 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c72e6a86-ccc7-47d6-a592-5474bbf21716 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Flow 'volume_create_manager' (d86463c0-154f-438c-9ee1-a3d1c22d718e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:39:31 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c72e6a86-ccc7-47d6-a592-5474bbf21716 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d74ee0e-7f6c-48b1-96af-fe5fd910c6a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:31 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c72e6a86-ccc7-47d6-a592-5474bbf21716 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d74ee0e-7f6c-48b1-96af-fe5fd910c6a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:39:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1655300395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4148e89-fa2d-4231-a905-c97281596730,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cb4eea0668f40b997b7c4a55f06f397',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:39:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:39:31Z,use_quota=True,user_id='a2fb6be3f79b4c2daf3fc5a02b44a4f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:31 devstack sudo[106565]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:31 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c72e6a86-ccc7-47d6-a592-5474bbf21716 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7af6000-e443-4ebe-8cff-bdae370c49af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:31 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c72e6a86-ccc7-47d6-a592-5474bbf21716 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7af6000-e443-4ebe-8cff-bdae370c49af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:31 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c72e6a86-ccc7-47d6-a592-5474bbf21716 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c9cac9e-96ec-4903-9c7c-eb6293f0b5e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:31 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c72e6a86-ccc7-47d6-a592-5474bbf21716 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c9cac9e-96ec-4903-9c7c-eb6293f0b5e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4148e89-fa2d-4231-a905-c97281596730', 'volume_name': 'volume-c4148e89-fa2d-4231-a905-c97281596730', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:31 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c72e6a86-ccc7-47d6-a592-5474bbf21716 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d7c641c-4114-40d5-8b9a-469026a7b07c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:31 devstack sudo[106577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1a6a23d1-804d-46d6-8f3a-f9b08a29242e_9wpokc5vdevstack@QuobyteHD Sep 15 16:39:31 devstack sudo[106577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:31 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c72e6a86-ccc7-47d6-a592-5474bbf21716 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d7c641c-4114-40d5-8b9a-469026a7b07c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:31 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c72e6a86-ccc7-47d6-a592-5474bbf21716 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13d691a8-9d43-4aa7-b82b-55672a56d67f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:31 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-c72e6a86-ccc7-47d6-a592-5474bbf21716 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Volume c4148e89-fa2d-4231-a905-c97281596730: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4148e89-fa2d-4231-a905-c97281596730', 'volume_size': 1} Sep 15 16:39:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c72e6a86-ccc7-47d6-a592-5474bbf21716 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:39:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0c9a8dba-c779-493e-b74c-ee5f6813502f tempest-CinderUnicodeTest-459182968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6af01cd0-53c3-4308-b74e-bdeb12be5364,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6af01cd0-53c3-4308-b74e-bdeb12be5364.b557302c-7876-4720-a395-ba65e533237c 1G" returned: 0 in 0.684s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0c9a8dba-c779-493e-b74c-ee5f6813502f tempest-CinderUnicodeTest-459182968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6af01cd0-53c3-4308-b74e-bdeb12be5364 -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6af01cd0-53c3-4308-b74e-bdeb12be5364.b557302c-7876-4720-a395-ba65e533237c {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:31 devstack sudo[106582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6af01cd0-53c3-4308-b74e-bdeb12be5364 -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6af01cd0-53c3-4308-b74e-bdeb12be5364.b557302c-7876-4720-a395-ba65e533237c Sep 15 16:39:31 devstack sudo[106582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:31 devstack sudo[106569]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-acc0a097-ac42-4d64-b573-e27f49185715 tempest-CreateVolumesFromImageTest-1873971368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1174a50f-381a-4907-a928-41954e4fc889" returned: 0 in 0.536s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-acc0a097-ac42-4d64-b573-e27f49185715 tempest-CreateVolumesFromImageTest-1873971368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1174a50f-381a-4907-a928-41954e4fc889 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:31 devstack sudo[106584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1174a50f-381a-4907-a928-41954e4fc889 Sep 15 16:39:31 devstack sudo[106584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:31 devstack sudo[106577]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-04a38b4e-5987-473b-99bb-e57c00cebc64 tempest-VolumeAndVolumeTypeFromImageTest-1876313635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_1a6a23d1-804d-46d6-8f3a-f9b08a29242e_9wpokc5vdevstack@QuobyteHD" returned: 0 in 0.576s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-04a38b4e-5987-473b-99bb-e57c00cebc64 tempest-VolumeAndVolumeTypeFromImageTest-1876313635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1a6a23d1-804d-46d6-8f3a-f9b08a29242e_9wpokc5vdevstack@QuobyteHD {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:31 devstack sudo[106582]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0c9a8dba-c779-493e-b74c-ee5f6813502f tempest-CinderUnicodeTest-459182968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6af01cd0-53c3-4308-b74e-bdeb12be5364 -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6af01cd0-53c3-4308-b74e-bdeb12be5364.b557302c-7876-4720-a395-ba65e533237c" returned: 0 in 0.395s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:31 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-0c9a8dba-c779-493e-b74c-ee5f6813502f tempest-CinderUnicodeTest-459182968 None] /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6af01cd0-53c3-4308-b74e-bdeb12be5364.b557302c-7876-4720-a395-ba65e533237c is being set with open permissions: ugo+rw Sep 15 16:39:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0c9a8dba-c779-493e-b74c-ee5f6813502f tempest-CinderUnicodeTest-459182968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6af01cd0-53c3-4308-b74e-bdeb12be5364.b557302c-7876-4720-a395-ba65e533237c {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:31 devstack sudo[106593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6af01cd0-53c3-4308-b74e-bdeb12be5364.b557302c-7876-4720-a395-ba65e533237c Sep 15 16:39:31 devstack sudo[106593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:31 devstack sudo[106584]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-acc0a097-ac42-4d64-b573-e27f49185715 tempest-CreateVolumesFromImageTest-1873971368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1174a50f-381a-4907-a928-41954e4fc889" returned: 0 in 0.400s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:31 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-acc0a097-ac42-4d64-b573-e27f49185715 tempest-CreateVolumesFromImageTest-1873971368 None] Lock "cinder-quobyte-1174a50f-381a-4907-a928-41954e4fc889" released by "delete_volume" :: held 1.037s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:39:31 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6704b73-5f44-4603-9ad5-bae2602100c8 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:39:31 devstack sudo[106592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1a6a23d1-804d-46d6-8f3a-f9b08a29242e_9wpokc5vdevstack@QuobyteHD Sep 15 16:39:31 devstack sudo[106592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:31 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b6704b73-5f44-4603-9ad5-bae2602100c8 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Flow 'volume_create_manager' (ad2008ed-ba8a-48fc-a25e-a7068098fa59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:39:31 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b6704b73-5f44-4603-9ad5-bae2602100c8 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e7b878c-69c3-4454-bb60-3f86be84c83f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:31 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b6704b73-5f44-4603-9ad5-bae2602100c8 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e7b878c-69c3-4454-bb60-3f86be84c83f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:39:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-958682295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a237a739-6776-40e3-8aa2-32ca306393c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cb4eea0668f40b997b7c4a55f06f397',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:39:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:39:32Z,use_quota=True,user_id='a2fb6be3f79b4c2daf3fc5a02b44a4f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:31 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b6704b73-5f44-4603-9ad5-bae2602100c8 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96c5edec-3ba9-453e-8722-7c3a6333fd07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:32 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b6704b73-5f44-4603-9ad5-bae2602100c8 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (96c5edec-3ba9-453e-8722-7c3a6333fd07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:32 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b6704b73-5f44-4603-9ad5-bae2602100c8 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94038250-cfd4-462a-b5ad-6878bc514315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:32 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b6704b73-5f44-4603-9ad5-bae2602100c8 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94038250-cfd4-462a-b5ad-6878bc514315) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a237a739-6776-40e3-8aa2-32ca306393c3', 'volume_name': 'volume-a237a739-6776-40e3-8aa2-32ca306393c3', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:32 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b6704b73-5f44-4603-9ad5-bae2602100c8 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ec5bcfb-239a-4c9e-9046-33d7bd0d5990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:32 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b6704b73-5f44-4603-9ad5-bae2602100c8 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ec5bcfb-239a-4c9e-9046-33d7bd0d5990) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:32 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b6704b73-5f44-4603-9ad5-bae2602100c8 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e18ba306-8234-49fd-8e07-e04607cf5017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:32 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-b6704b73-5f44-4603-9ad5-bae2602100c8 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Volume a237a739-6776-40e3-8aa2-32ca306393c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a237a739-6776-40e3-8aa2-32ca306393c3', 'volume_size': 1} Sep 15 16:39:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b6704b73-5f44-4603-9ad5-bae2602100c8 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:39:32 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-acc0a097-ac42-4d64-b573-e27f49185715 tempest-CreateVolumesFromImageTest-1873971368 None] Created reservations ['d0f35766-6380-430f-81db-99a5bad29e97', 'c440599b-fef8-4fc9-b4cb-6951dd9c192f', '075e5619-ccdf-472f-92c0-f30020bc4ba4', 'e29181bd-8135-4b2d-8e15-9de57a64098b'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:39:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-acc0a097-ac42-4d64-b573-e27f49185715 tempest-CreateVolumesFromImageTest-1873971368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:39:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-acc0a097-ac42-4d64-b573-e27f49185715 tempest-CreateVolumesFromImageTest-1873971368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:39:32 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-acc0a097-ac42-4d64-b573-e27f49185715 tempest-CreateVolumesFromImageTest-1873971368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:39:32 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-acc0a097-ac42-4d64-b573-e27f49185715 tempest-CreateVolumesFromImageTest-1873971368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:39:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-acc0a097-ac42-4d64-b573-e27f49185715 tempest-CreateVolumesFromImageTest-1873971368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:39:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-acc0a097-ac42-4d64-b573-e27f49185715 tempest-CreateVolumesFromImageTest-1873971368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:32 devstack sudo[106593]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0c9a8dba-c779-493e-b74c-ee5f6813502f tempest-CinderUnicodeTest-459182968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6af01cd0-53c3-4308-b74e-bdeb12be5364.b557302c-7876-4720-a395-ba65e533237c" returned: 0 in 0.402s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:32 devstack sudo[106603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:39:32 devstack sudo[106603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:32 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb34e3de-e1c7-4499-a4ed-07e7f47bf909 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:39:32 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-cb34e3de-e1c7-4499-a4ed-07e7f47bf909 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Flow 'volume_create_manager' (8f478560-700a-4e47-87d3-57d6e834e732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:39:32 devstack sudo[106592]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:32 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-cb34e3de-e1c7-4499-a4ed-07e7f47bf909 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38009ac6-f77f-46ab-8ef9-2a4b04de667f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0c9a8dba-c779-493e-b74c-ee5f6813502f tempest-CinderUnicodeTest-459182968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6af01cd0-53c3-4308-b74e-bdeb12be5364.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-04a38b4e-5987-473b-99bb-e57c00cebc64 tempest-VolumeAndVolumeTypeFromImageTest-1876313635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1a6a23d1-804d-46d6-8f3a-f9b08a29242e_9wpokc5vdevstack@QuobyteHD" returned: 1 in 0.591s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-04a38b4e-5987-473b-99bb-e57c00cebc64 tempest-VolumeAndVolumeTypeFromImageTest-1876313635 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_1a6a23d1-804d-46d6-8f3a-f9b08a29242e_9wpokc5vdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 15 16:39:32 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-04a38b4e-5987-473b-99bb-e57c00cebc64 tempest-VolumeAndVolumeTypeFromImageTest-1876313635 None] 1a6a23d1-804d-46d6-8f3a-f9b08a29242e was raw, converting to qcow2 {{(pid=86082) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 15 16:39:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-04a38b4e-5987-473b-99bb-e57c00cebc64 tempest-VolumeAndVolumeTypeFromImageTest-1876313635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1a6a23d1-804d-46d6-8f3a-f9b08a29242e_9wpokc5vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-4fda87a6-d750-4c35-9054-3145868cb76c {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:32 devstack sudo[106608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6af01cd0-53c3-4308-b74e-bdeb12be5364.info Sep 15 16:39:32 devstack sudo[106608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:32 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-cb34e3de-e1c7-4499-a4ed-07e7f47bf909 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38009ac6-f77f-46ab-8ef9-2a4b04de667f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:39:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1806428226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0baf2c22-5800-4f57-b807-8c617efe3aa0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cb4eea0668f40b997b7c4a55f06f397',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:39:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:39:32Z,use_quota=True,user_id='a2fb6be3f79b4c2daf3fc5a02b44a4f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:32 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-cb34e3de-e1c7-4499-a4ed-07e7f47bf909 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6262a9bd-1c69-419c-a6e5-2052d1e4ec88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:32 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-cb34e3de-e1c7-4499-a4ed-07e7f47bf909 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6262a9bd-1c69-419c-a6e5-2052d1e4ec88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:32 devstack sudo[106610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1a6a23d1-804d-46d6-8f3a-f9b08a29242e_9wpokc5vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-4fda87a6-d750-4c35-9054-3145868cb76c Sep 15 16:39:32 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-cb34e3de-e1c7-4499-a4ed-07e7f47bf909 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fd9f6f6-ad55-4ee5-871d-685cfa01e0ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:32 devstack sudo[106610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:32 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-cb34e3de-e1c7-4499-a4ed-07e7f47bf909 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fd9f6f6-ad55-4ee5-871d-685cfa01e0ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0baf2c22-5800-4f57-b807-8c617efe3aa0', 'volume_name': 'volume-0baf2c22-5800-4f57-b807-8c617efe3aa0', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:32 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-cb34e3de-e1c7-4499-a4ed-07e7f47bf909 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72d9b6ae-5575-44db-82ae-e823e98a2ba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:32 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-cb34e3de-e1c7-4499-a4ed-07e7f47bf909 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72d9b6ae-5575-44db-82ae-e823e98a2ba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:32 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-cb34e3de-e1c7-4499-a4ed-07e7f47bf909 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8406fba9-7539-4ff7-b045-643084ac0cb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:32 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-cb34e3de-e1c7-4499-a4ed-07e7f47bf909 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Volume 0baf2c22-5800-4f57-b807-8c617efe3aa0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0baf2c22-5800-4f57-b807-8c617efe3aa0', 'volume_size': 1} Sep 15 16:39:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-cb34e3de-e1c7-4499-a4ed-07e7f47bf909 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:39:32 devstack sudo[106603]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-acc0a097-ac42-4d64-b573-e27f49185715 tempest-CreateVolumesFromImageTest-1873971368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.415s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:32 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-acc0a097-ac42-4d64-b573-e27f49185715 tempest-CreateVolumesFromImageTest-1873971368 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:39:32 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-acc0a097-ac42-4d64-b573-e27f49185715 tempest-CreateVolumesFromImageTest-1873971368 None] Deleted volume successfully. Sep 15 16:39:32 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-acc0a097-ac42-4d64-b573-e27f49185715 tempest-CreateVolumesFromImageTest-1873971368 None] Lock "cinder-1174a50f-381a-4907-a928-41954e4fc889-delete_volume" released by "delete_volume" :: held 1.973s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:39:32 devstack sudo[106608]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0c9a8dba-c779-493e-b74c-ee5f6813502f tempest-CinderUnicodeTest-459182968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6af01cd0-53c3-4308-b74e-bdeb12be5364.info" returned: 0 in 0.351s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:32 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-0c9a8dba-c779-493e-b74c-ee5f6813502f tempest-CinderUnicodeTest-459182968 None] /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6af01cd0-53c3-4308-b74e-bdeb12be5364.info is being set with open permissions: ugo+rw Sep 15 16:39:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0c9a8dba-c779-493e-b74c-ee5f6813502f tempest-CinderUnicodeTest-459182968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6af01cd0-53c3-4308-b74e-bdeb12be5364.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:32 devstack sudo[106614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6af01cd0-53c3-4308-b74e-bdeb12be5364.info Sep 15 16:39:32 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-39a5bb35-230f-4bcf-8b77-e355f0153384 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:39:32 devstack sudo[106614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:32 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-39a5bb35-230f-4bcf-8b77-e355f0153384 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Flow 'volume_create_manager' (794a3dba-922f-4118-9a69-1ee3fff85d58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:39:32 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-39a5bb35-230f-4bcf-8b77-e355f0153384 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e195651-f96e-4d3c-b8e2-0f1ec2b3a3dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:32 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-39a5bb35-230f-4bcf-8b77-e355f0153384 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e195651-f96e-4d3c-b8e2-0f1ec2b3a3dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:39:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-560640396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=342afcfb-f7fa-41c4-ab64-5f79ee02af0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cb4eea0668f40b997b7c4a55f06f397',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:39:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:39:33Z,use_quota=True,user_id='a2fb6be3f79b4c2daf3fc5a02b44a4f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:32 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-39a5bb35-230f-4bcf-8b77-e355f0153384 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ee1dbf2-338e-4c2c-83f9-f6c40b6c8b38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:32 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-39a5bb35-230f-4bcf-8b77-e355f0153384 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ee1dbf2-338e-4c2c-83f9-f6c40b6c8b38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:32 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-39a5bb35-230f-4bcf-8b77-e355f0153384 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9546af46-98e3-449d-8e2a-b063dc26dc11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:32 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-39a5bb35-230f-4bcf-8b77-e355f0153384 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9546af46-98e3-449d-8e2a-b063dc26dc11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '342afcfb-f7fa-41c4-ab64-5f79ee02af0e', 'volume_name': 'volume-342afcfb-f7fa-41c4-ab64-5f79ee02af0e', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:32 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-39a5bb35-230f-4bcf-8b77-e355f0153384 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be6ead88-d0de-47cf-a9b0-1d1589cc757c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:32 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-39a5bb35-230f-4bcf-8b77-e355f0153384 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be6ead88-d0de-47cf-a9b0-1d1589cc757c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:32 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-39a5bb35-230f-4bcf-8b77-e355f0153384 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2065e94-89c1-4fd7-aa8e-fd8d5bdf5d68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:32 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-39a5bb35-230f-4bcf-8b77-e355f0153384 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Volume 342afcfb-f7fa-41c4-ab64-5f79ee02af0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-342afcfb-f7fa-41c4-ab64-5f79ee02af0e', 'volume_size': 1} Sep 15 16:39:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-39a5bb35-230f-4bcf-8b77-e355f0153384 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:39:32 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-13e741af-0f0d-4843-b308-40d621c6d4e8 tempest-CreateVolumesFromImageTest-1873971368 None] Acquiring lock "cinder-d22b2874-fb00-4306-ab60-ffecc0e42430-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:39:32 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-13e741af-0f0d-4843-b308-40d621c6d4e8 tempest-CreateVolumesFromImageTest-1873971368 None] Lock "cinder-d22b2874-fb00-4306-ab60-ffecc0e42430-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:39:33 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-13e741af-0f0d-4843-b308-40d621c6d4e8 tempest-CreateVolumesFromImageTest-1873971368 None] Acquiring lock "cinder-quobyte-d22b2874-fb00-4306-ab60-ffecc0e42430" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:39:33 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-13e741af-0f0d-4843-b308-40d621c6d4e8 tempest-CreateVolumesFromImageTest-1873971368 None] Lock "cinder-quobyte-d22b2874-fb00-4306-ab60-ffecc0e42430" acquired by "delete_volume" :: waited 0.021s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:39:33 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[43aa8e53-7b67-4908-8ec8-cdf58b507ce4]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:39:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-13e741af-0f0d-4843-b308-40d621c6d4e8 tempest-CreateVolumesFromImageTest-1873971368 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-d22b2874-fb00-4306-ab60-ffecc0e42430 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:33 devstack sudo[106614]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0c9a8dba-c779-493e-b74c-ee5f6813502f tempest-CinderUnicodeTest-459182968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6af01cd0-53c3-4308-b74e-bdeb12be5364.info" returned: 0 in 0.442s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:33 devstack sudo[106610]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-0c9a8dba-c779-493e-b74c-ee5f6813502f tempest-CinderUnicodeTest-459182968 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.965s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:39:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c72e6a86-ccc7-47d6-a592-5474bbf21716 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.761s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:39:33 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c72e6a86-ccc7-47d6-a592-5474bbf21716 tempest-CreateVolumesFromSnapshotTest-1571001215 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:39:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1655300395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4148e89-fa2d-4231-a905-c97281596730,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cb4eea0668f40b997b7c4a55f06f397',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:39:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:39:31Z,use_quota=True,user_id='a2fb6be3f79b4c2daf3fc5a02b44a4f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:39:33 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-c72e6a86-ccc7-47d6-a592-5474bbf21716 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Creating volume c4148e89-fa2d-4231-a905-c97281596730 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:39:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c72e6a86-ccc7-47d6-a592-5474bbf21716 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:39:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c72e6a86-ccc7-47d6-a592-5474bbf21716 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:39:33 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c72e6a86-ccc7-47d6-a592-5474bbf21716 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:39:33 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c72e6a86-ccc7-47d6-a592-5474bbf21716 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:39:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c72e6a86-ccc7-47d6-a592-5474bbf21716 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:39:33 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c72e6a86-ccc7-47d6-a592-5474bbf21716 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:39:33 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-c72e6a86-ccc7-47d6-a592-5474bbf21716 tempest-CreateVolumesFromSnapshotTest-1571001215 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:39:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c72e6a86-ccc7-47d6-a592-5474bbf21716 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c4148e89-fa2d-4231-a905-c97281596730 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-04a38b4e-5987-473b-99bb-e57c00cebc64 tempest-VolumeAndVolumeTypeFromImageTest-1876313635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_1a6a23d1-804d-46d6-8f3a-f9b08a29242e_9wpokc5vdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-4fda87a6-d750-4c35-9054-3145868cb76c" returned: 0 in 0.822s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:33 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-04a38b4e-5987-473b-99bb-e57c00cebc64 tempest-VolumeAndVolumeTypeFromImageTest-1876313635 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_1a6a23d1-804d-46d6-8f3a-f9b08a29242e_9wpokc5vdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-4fda87a6-d750-4c35-9054-3145868cb76c {{(pid=86082) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 15 16:39:33 devstack cinder-volume[86082]: INFO cinder.image.image_utils [None req-04a38b4e-5987-473b-99bb-e57c00cebc64 tempest-VolumeAndVolumeTypeFromImageTest-1876313635 None] Converted 0.00 MB image at 0.00 MB/s Sep 15 16:39:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-04a38b4e-5987-473b-99bb-e57c00cebc64 tempest-VolumeAndVolumeTypeFromImageTest-1876313635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-4fda87a6-d750-4c35-9054-3145868cb76c 1G {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:33 devstack sudo[106622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c4148e89-fa2d-4231-a905-c97281596730 1073741824 Sep 15 16:39:33 devstack sudo[106622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:33 devstack sudo[106621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-d22b2874-fb00-4306-ab60-ffecc0e42430 Sep 15 16:39:33 devstack sudo[106621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:33 devstack sudo[106623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-4fda87a6-d750-4c35-9054-3145868cb76c 1G Sep 15 16:39:33 devstack sudo[106623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:33 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-72b07cae-c87d-4d34-a3f7-d80ff43fdfc5 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:39:33 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-72b07cae-c87d-4d34-a3f7-d80ff43fdfc5 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Flow 'volume_create_manager' (246a9e17-319d-4bf3-80a4-182f17bc65cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:39:33 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-72b07cae-c87d-4d34-a3f7-d80ff43fdfc5 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63b904dc-f92b-439e-a2b4-1797e5c41411) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:33 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-0c9a8dba-c779-493e-b74c-ee5f6813502f tempest-CinderUnicodeTest-459182968 None] Create snapshot completed successfully Sep 15 16:39:33 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-72b07cae-c87d-4d34-a3f7-d80ff43fdfc5 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63b904dc-f92b-439e-a2b4-1797e5c41411) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:39:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1743781109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5250eb4a-b438-4a1a-a4e0-95b28fbc0298,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cb4eea0668f40b997b7c4a55f06f397',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:39:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:39:33Z,use_quota=True,user_id='a2fb6be3f79b4c2daf3fc5a02b44a4f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:33 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-72b07cae-c87d-4d34-a3f7-d80ff43fdfc5 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca1059ce-81b5-4113-998e-26a9b4ae57e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:33 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-72b07cae-c87d-4d34-a3f7-d80ff43fdfc5 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca1059ce-81b5-4113-998e-26a9b4ae57e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:33 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-72b07cae-c87d-4d34-a3f7-d80ff43fdfc5 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25f0f114-7f7b-4d86-b31b-56e79e6a153f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:33 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-72b07cae-c87d-4d34-a3f7-d80ff43fdfc5 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25f0f114-7f7b-4d86-b31b-56e79e6a153f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5250eb4a-b438-4a1a-a4e0-95b28fbc0298', 'volume_name': 'volume-5250eb4a-b438-4a1a-a4e0-95b28fbc0298', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:33 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-72b07cae-c87d-4d34-a3f7-d80ff43fdfc5 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (baefac20-32be-45c3-a7b8-db3e39780617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:33 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-72b07cae-c87d-4d34-a3f7-d80ff43fdfc5 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (baefac20-32be-45c3-a7b8-db3e39780617) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:33 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-72b07cae-c87d-4d34-a3f7-d80ff43fdfc5 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (add0f589-4495-4078-a5a1-4f28859e4203) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:33 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-72b07cae-c87d-4d34-a3f7-d80ff43fdfc5 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Volume 5250eb4a-b438-4a1a-a4e0-95b28fbc0298: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5250eb4a-b438-4a1a-a4e0-95b28fbc0298', 'volume_size': 1} Sep 15 16:39:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-72b07cae-c87d-4d34-a3f7-d80ff43fdfc5 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:39:33 devstack sudo[106621]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-13e741af-0f0d-4843-b308-40d621c6d4e8 tempest-CreateVolumesFromImageTest-1873971368 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-d22b2874-fb00-4306-ab60-ffecc0e42430" returned: 0 in 0.450s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-13e741af-0f0d-4843-b308-40d621c6d4e8 tempest-CreateVolumesFromImageTest-1873971368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-d22b2874-fb00-4306-ab60-ffecc0e42430 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:33 devstack sudo[106623]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:33 devstack sudo[106637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-d22b2874-fb00-4306-ab60-ffecc0e42430 Sep 15 16:39:33 devstack sudo[106637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-04a38b4e-5987-473b-99bb-e57c00cebc64 tempest-VolumeAndVolumeTypeFromImageTest-1876313635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-4fda87a6-d750-4c35-9054-3145868cb76c 1G" returned: 0 in 0.376s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:33 devstack cinder-volume[86082]: DEBUG cinder.volume.volume_utils [None req-04a38b4e-5987-473b-99bb-e57c00cebc64 tempest-VolumeAndVolumeTypeFromImageTest-1876313635 None] Downloaded image 1a6a23d1-804d-46d6-8f3a-f9b08a29242e ((None, [{'url': 'file:///opt/stack/data/glance/images/1a6a23d1-804d-46d6-8f3a-f9b08a29242e', 'metadata': {}}])) to volume 4fda87a6-d750-4c35-9054-3145868cb76c successfully. {{(pid=86082) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 15 16:39:33 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-04a38b4e-5987-473b-99bb-e57c00cebc64 tempest-VolumeAndVolumeTypeFromImageTest-1876313635 None] Temporary image 1a6a23d1-804d-46d6-8f3a-f9b08a29242e for user e380344dfb5c4554a45739f86f1dbda0 is deleted. {{(pid=86082) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 15 16:39:33 devstack cinder-volume[86082]: DEBUG cinder.volume.volume_utils [None req-04a38b4e-5987-473b-99bb-e57c00cebc64 tempest-VolumeAndVolumeTypeFromImageTest-1876313635 None] Marking volume 4fda87a6-d750-4c35-9054-3145868cb76c as bootable. {{(pid=86082) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 15 16:39:33 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-65e70ff0-fece-4181-b2e5-99870111d3a4 tempest-CinderUnicodeTest-459182968 None] Acquiring lock "cinder-b557302c-7876-4720-a395-ba65e533237c-delete_snapshot" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:39:33 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-04a38b4e-5987-473b-99bb-e57c00cebc64 tempest-VolumeAndVolumeTypeFromImageTest-1876313635 None] Copying metadata from image 1a6a23d1-804d-46d6-8f3a-f9b08a29242e to 4fda87a6-d750-4c35-9054-3145868cb76c. {{(pid=86082) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 15 16:39:33 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-04a38b4e-5987-473b-99bb-e57c00cebc64 tempest-VolumeAndVolumeTypeFromImageTest-1876313635 None] Creating volume glance metadata for volume 4fda87a6-d750-4c35-9054-3145868cb76c backed by image 1a6a23d1-804d-46d6-8f3a-f9b08a29242e with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '1a6a23d1-804d-46d6-8f3a-f9b08a29242e', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'd03c05ed7fc6e810c02ccc442dee6c04', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86082) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 15 16:39:33 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-65e70ff0-fece-4181-b2e5-99870111d3a4 tempest-CinderUnicodeTest-459182968 None] Lock "cinder-b557302c-7876-4720-a395-ba65e533237c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:39:33 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-65e70ff0-fece-4181-b2e5-99870111d3a4 tempest-CinderUnicodeTest-459182968 None] Acquiring lock "cinder-quobyte-6af01cd0-53c3-4308-b74e-bdeb12be5364" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:39:33 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-65e70ff0-fece-4181-b2e5-99870111d3a4 tempest-CinderUnicodeTest-459182968 None] Lock "cinder-quobyte-6af01cd0-53c3-4308-b74e-bdeb12be5364" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:39:33 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-65e70ff0-fece-4181-b2e5-99870111d3a4 tempest-CinderUnicodeTest-459182968 None] Acquiring lock "cinder-quobyte-b557302c-7876-4720-a395-ba65e533237c" by "_delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:39:33 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-65e70ff0-fece-4181-b2e5-99870111d3a4 tempest-CinderUnicodeTest-459182968 None] Lock "cinder-quobyte-b557302c-7876-4720-a395-ba65e533237c" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:39:33 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-65e70ff0-fece-4181-b2e5-99870111d3a4 tempest-CinderUnicodeTest-459182968 None] Deleting offline snapshot b557302c-7876-4720-a395-ba65e533237c of volume 6af01cd0-53c3-4308-b74e-bdeb12be5364 {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 15 16:39:33 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-65e70ff0-fece-4181-b2e5-99870111d3a4 tempest-CinderUnicodeTest-459182968 None] snapshot_file for this snap is: volume-6af01cd0-53c3-4308-b74e-bdeb12be5364.b557302c-7876-4720-a395-ba65e533237c {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 15 16:39:33 devstack sudo[106622]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:33 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[2437d182-c40d-4776-9ad3-383940ece7cd]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:39:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-65e70ff0-fece-4181-b2e5-99870111d3a4 tempest-CinderUnicodeTest-459182968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6af01cd0-53c3-4308-b74e-bdeb12be5364.b557302c-7876-4720-a395-ba65e533237c {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c72e6a86-ccc7-47d6-a592-5474bbf21716 tempest-CreateVolumesFromSnapshotTest-1571001215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c4148e89-fa2d-4231-a905-c97281596730 1073741824" returned: 0 in 0.569s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:33 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-04a38b4e-5987-473b-99bb-e57c00cebc64 tempest-VolumeAndVolumeTypeFromImageTest-1876313635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (113f7941-46b5-418b-abe9-111237d21ed1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4fda87a6-d750-4c35-9054-3145868cb76c', 'volume_size': 1, 'image_id': '1a6a23d1-804d-46d6-8f3a-f9b08a29242e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/1a6a23d1-804d-46d6-8f3a-f9b08a29242e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'd03c05ed7fc6e810c02ccc442dee6c04', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'cd93258ed29b400199966faa1eeaee06', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '416b8c21fc9721d3f65bdd01f15ebb408dbf4259f161549ab433c843f1f45c43f81cf6eedc93dcfef29efccc9e3892cb420bb92cb9e1aed8659d25c3708f7349', 'id': '1a6a23d1-804d-46d6-8f3a-f9b08a29242e', 'created_at': datetime.datetime(2026, 9, 15, 14, 39, 22, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 15, 14, 39, 24, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/1a6a23d1-804d-46d6-8f3a-f9b08a29242e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:33 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-04a38b4e-5987-473b-99bb-e57c00cebc64 tempest-VolumeAndVolumeTypeFromImageTest-1876313635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09951056-908b-45b4-b866-32894f1cfdbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c72e6a86-ccc7-47d6-a592-5474bbf21716 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c4148e89-fa2d-4231-a905-c97281596730 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:33 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-04a38b4e-5987-473b-99bb-e57c00cebc64 tempest-VolumeAndVolumeTypeFromImageTest-1876313635 None] Volume volume-4fda87a6-d750-4c35-9054-3145868cb76c (4fda87a6-d750-4c35-9054-3145868cb76c): created successfully Sep 15 16:39:33 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-04a38b4e-5987-473b-99bb-e57c00cebc64 tempest-VolumeAndVolumeTypeFromImageTest-1876313635 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09951056-908b-45b4-b866-32894f1cfdbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:33 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-04a38b4e-5987-473b-99bb-e57c00cebc64 tempest-VolumeAndVolumeTypeFromImageTest-1876313635 None] Flow 'volume_create_manager' (f1a39208-5391-4ca9-bb47-3dda4e19a517) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:39:33 devstack sudo[106643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c4148e89-fa2d-4231-a905-c97281596730 Sep 15 16:39:33 devstack sudo[106637]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:33 devstack sudo[106643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:33 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-04a38b4e-5987-473b-99bb-e57c00cebc64 tempest-VolumeAndVolumeTypeFromImageTest-1876313635 None] Created volume successfully. Sep 15 16:39:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-13e741af-0f0d-4843-b308-40d621c6d4e8 tempest-CreateVolumesFromImageTest-1873971368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-d22b2874-fb00-4306-ab60-ffecc0e42430" returned: 0 in 0.337s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:33 devstack sudo[106641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6af01cd0-53c3-4308-b74e-bdeb12be5364.b557302c-7876-4720-a395-ba65e533237c Sep 15 16:39:33 devstack sudo[106641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:33 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-13e741af-0f0d-4843-b308-40d621c6d4e8 tempest-CreateVolumesFromImageTest-1873971368 None] Lock "cinder-quobyte-d22b2874-fb00-4306-ab60-ffecc0e42430" released by "delete_volume" :: held 0.851s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:39:33 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-13e741af-0f0d-4843-b308-40d621c6d4e8 tempest-CreateVolumesFromImageTest-1873971368 None] Created reservations ['d5e4e5fb-7d64-4b09-8453-6bf8f84ffc15', '8abd7540-4435-43d5-ac78-5e5a99f7577a', 'a2231d3c-e3d1-4be3-b541-7b84f3b58dd8', 'c4825ff4-ff29-4e4e-bffc-af737754d064'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:39:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-13e741af-0f0d-4843-b308-40d621c6d4e8 tempest-CreateVolumesFromImageTest-1873971368 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:39:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-13e741af-0f0d-4843-b308-40d621c6d4e8 tempest-CreateVolumesFromImageTest-1873971368 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:39:34 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-13e741af-0f0d-4843-b308-40d621c6d4e8 tempest-CreateVolumesFromImageTest-1873971368 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:39:34 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-13e741af-0f0d-4843-b308-40d621c6d4e8 tempest-CreateVolumesFromImageTest-1873971368 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:39:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-13e741af-0f0d-4843-b308-40d621c6d4e8 tempest-CreateVolumesFromImageTest-1873971368 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:39:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-13e741af-0f0d-4843-b308-40d621c6d4e8 tempest-CreateVolumesFromImageTest-1873971368 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:34 devstack sudo[106647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:39:34 devstack sudo[106647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:34 devstack sudo[106643]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c72e6a86-ccc7-47d6-a592-5474bbf21716 tempest-CreateVolumesFromSnapshotTest-1571001215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c4148e89-fa2d-4231-a905-c97281596730" returned: 0 in 0.358s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:34 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c72e6a86-ccc7-47d6-a592-5474bbf21716 tempest-CreateVolumesFromSnapshotTest-1571001215 None] <== create_volume: return (995ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:39:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c72e6a86-ccc7-47d6-a592-5474bbf21716 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:39:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b6704b73-5f44-4603-9ad5-bae2602100c8 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.119s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:39:34 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-b6704b73-5f44-4603-9ad5-bae2602100c8 tempest-CreateVolumesFromSnapshotTest-1571001215 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:39:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-958682295',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a237a739-6776-40e3-8aa2-32ca306393c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cb4eea0668f40b997b7c4a55f06f397',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:39:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:39:32Z,use_quota=True,user_id='a2fb6be3f79b4c2daf3fc5a02b44a4f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:39:34 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-b6704b73-5f44-4603-9ad5-bae2602100c8 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Creating volume a237a739-6776-40e3-8aa2-32ca306393c3 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:39:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b6704b73-5f44-4603-9ad5-bae2602100c8 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:39:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b6704b73-5f44-4603-9ad5-bae2602100c8 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:39:34 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-b6704b73-5f44-4603-9ad5-bae2602100c8 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:39:34 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-b6704b73-5f44-4603-9ad5-bae2602100c8 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:39:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b6704b73-5f44-4603-9ad5-bae2602100c8 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:39:34 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-b6704b73-5f44-4603-9ad5-bae2602100c8 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:39:34 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-b6704b73-5f44-4603-9ad5-bae2602100c8 tempest-CreateVolumesFromSnapshotTest-1571001215 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:39:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b6704b73-5f44-4603-9ad5-bae2602100c8 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a237a739-6776-40e3-8aa2-32ca306393c3 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:34 devstack sudo[106652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a237a739-6776-40e3-8aa2-32ca306393c3 1073741824 Sep 15 16:39:34 devstack sudo[106652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:34 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c72e6a86-ccc7-47d6-a592-5474bbf21716 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (13d691a8-9d43-4aa7-b82b-55672a56d67f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4148e89-fa2d-4231-a905-c97281596730', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:34 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c72e6a86-ccc7-47d6-a592-5474bbf21716 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a82c19e1-675e-48dc-a1ba-a5c1da8fbc62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:34 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-c72e6a86-ccc7-47d6-a592-5474bbf21716 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Volume volume-c4148e89-fa2d-4231-a905-c97281596730 (c4148e89-fa2d-4231-a905-c97281596730): created successfully Sep 15 16:39:34 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c72e6a86-ccc7-47d6-a592-5474bbf21716 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a82c19e1-675e-48dc-a1ba-a5c1da8fbc62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:34 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c72e6a86-ccc7-47d6-a592-5474bbf21716 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Flow 'volume_create_manager' (d86463c0-154f-438c-9ee1-a3d1c22d718e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:39:34 devstack sudo[106641]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:34 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-c72e6a86-ccc7-47d6-a592-5474bbf21716 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Created volume successfully. Sep 15 16:39:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-65e70ff0-fece-4181-b2e5-99870111d3a4 tempest-CinderUnicodeTest-459182968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6af01cd0-53c3-4308-b74e-bdeb12be5364.b557302c-7876-4720-a395-ba65e533237c" returned: 0 in 0.559s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:34 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-65e70ff0-fece-4181-b2e5-99870111d3a4 tempest-CinderUnicodeTest-459182968 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6af01cd0-53c3-4308-b74e-bdeb12be5364(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 16:39:34 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-9a717249-6a62-430c-9b14-c99396151890 tempest-VolumeAndVolumeTypeFromImageTest-1876313635 None] Acquiring lock "cinder-4fda87a6-d750-4c35-9054-3145868cb76c-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:39:34 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac143aaf-6990-4d2d-8ca9-35c221840177]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:39:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-65e70ff0-fece-4181-b2e5-99870111d3a4 tempest-CinderUnicodeTest-459182968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6af01cd0-53c3-4308-b74e-bdeb12be5364 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:34 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-9a717249-6a62-430c-9b14-c99396151890 tempest-VolumeAndVolumeTypeFromImageTest-1876313635 None] Lock "cinder-4fda87a6-d750-4c35-9054-3145868cb76c-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:39:34 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-9a717249-6a62-430c-9b14-c99396151890 tempest-VolumeAndVolumeTypeFromImageTest-1876313635 None] Acquiring lock "cinder-quobyte-4fda87a6-d750-4c35-9054-3145868cb76c" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:39:34 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-9a717249-6a62-430c-9b14-c99396151890 tempest-VolumeAndVolumeTypeFromImageTest-1876313635 None] Lock "cinder-quobyte-4fda87a6-d750-4c35-9054-3145868cb76c" acquired by "delete_volume" :: waited 0.016s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:39:34 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[889db2c0-d4ab-49c8-81c4-48c7666b9290]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:39:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9a717249-6a62-430c-9b14-c99396151890 tempest-VolumeAndVolumeTypeFromImageTest-1876313635 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-4fda87a6-d750-4c35-9054-3145868cb76c {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:34 devstack sudo[106647]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-13e741af-0f0d-4843-b308-40d621c6d4e8 tempest-CreateVolumesFromImageTest-1873971368 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.455s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:34 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-13e741af-0f0d-4843-b308-40d621c6d4e8 tempest-CreateVolumesFromImageTest-1873971368 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:39:34 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-13e741af-0f0d-4843-b308-40d621c6d4e8 tempest-CreateVolumesFromImageTest-1873971368 None] Deleted volume successfully. Sep 15 16:39:34 devstack sudo[106654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6af01cd0-53c3-4308-b74e-bdeb12be5364 Sep 15 16:39:34 devstack sudo[106654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:34 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-13e741af-0f0d-4843-b308-40d621c6d4e8 tempest-CreateVolumesFromImageTest-1873971368 None] Lock "cinder-d22b2874-fb00-4306-ab60-ffecc0e42430-delete_volume" released by "delete_volume" :: held 1.631s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:39:34 devstack sudo[106659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-4fda87a6-d750-4c35-9054-3145868cb76c Sep 15 16:39:34 devstack sudo[106659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:34 devstack sudo[106652]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b6704b73-5f44-4603-9ad5-bae2602100c8 tempest-CreateVolumesFromSnapshotTest-1571001215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a237a739-6776-40e3-8aa2-32ca306393c3 1073741824" returned: 0 in 0.608s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b6704b73-5f44-4603-9ad5-bae2602100c8 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a237a739-6776-40e3-8aa2-32ca306393c3 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:34 devstack sudo[106666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a237a739-6776-40e3-8aa2-32ca306393c3 Sep 15 16:39:34 devstack sudo[106666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:34 devstack sudo[106654]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-65e70ff0-fece-4181-b2e5-99870111d3a4 tempest-CinderUnicodeTest-459182968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6af01cd0-53c3-4308-b74e-bdeb12be5364" returned: 0 in 0.538s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-65e70ff0-fece-4181-b2e5-99870111d3a4 tempest-CinderUnicodeTest-459182968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6af01cd0-53c3-4308-b74e-bdeb12be5364.b557302c-7876-4720-a395-ba65e533237c {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:34 devstack sudo[106669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6af01cd0-53c3-4308-b74e-bdeb12be5364.b557302c-7876-4720-a395-ba65e533237c Sep 15 16:39:34 devstack sudo[106669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:34 devstack sudo[106659]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9a717249-6a62-430c-9b14-c99396151890 tempest-VolumeAndVolumeTypeFromImageTest-1876313635 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-4fda87a6-d750-4c35-9054-3145868cb76c" returned: 0 in 0.502s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9a717249-6a62-430c-9b14-c99396151890 tempest-VolumeAndVolumeTypeFromImageTest-1876313635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-4fda87a6-d750-4c35-9054-3145868cb76c {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:35 devstack sudo[106673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-4fda87a6-d750-4c35-9054-3145868cb76c Sep 15 16:39:35 devstack sudo[106673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:35 devstack sudo[106666]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b6704b73-5f44-4603-9ad5-bae2602100c8 tempest-CreateVolumesFromSnapshotTest-1571001215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a237a739-6776-40e3-8aa2-32ca306393c3" returned: 0 in 0.312s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:35 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-b6704b73-5f44-4603-9ad5-bae2602100c8 tempest-CreateVolumesFromSnapshotTest-1571001215 None] <== create_volume: return (969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:39:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b6704b73-5f44-4603-9ad5-bae2602100c8 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:39:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-cb34e3de-e1c7-4499-a4ed-07e7f47bf909 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.659s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:39:35 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-cb34e3de-e1c7-4499-a4ed-07e7f47bf909 tempest-CreateVolumesFromSnapshotTest-1571001215 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:39:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1806428226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0baf2c22-5800-4f57-b807-8c617efe3aa0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cb4eea0668f40b997b7c4a55f06f397',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:39:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:39:32Z,use_quota=True,user_id='a2fb6be3f79b4c2daf3fc5a02b44a4f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:39:35 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-cb34e3de-e1c7-4499-a4ed-07e7f47bf909 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Creating volume 0baf2c22-5800-4f57-b807-8c617efe3aa0 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:39:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-cb34e3de-e1c7-4499-a4ed-07e7f47bf909 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:39:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-cb34e3de-e1c7-4499-a4ed-07e7f47bf909 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:39:35 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-cb34e3de-e1c7-4499-a4ed-07e7f47bf909 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:39:35 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-cb34e3de-e1c7-4499-a4ed-07e7f47bf909 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:39:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-cb34e3de-e1c7-4499-a4ed-07e7f47bf909 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:39:35 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-cb34e3de-e1c7-4499-a4ed-07e7f47bf909 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:39:35 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-cb34e3de-e1c7-4499-a4ed-07e7f47bf909 tempest-CreateVolumesFromSnapshotTest-1571001215 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:39:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-cb34e3de-e1c7-4499-a4ed-07e7f47bf909 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0baf2c22-5800-4f57-b807-8c617efe3aa0 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:35 devstack sudo[106678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0baf2c22-5800-4f57-b807-8c617efe3aa0 1073741824 Sep 15 16:39:35 devstack sudo[106678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:35 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b6704b73-5f44-4603-9ad5-bae2602100c8 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e18ba306-8234-49fd-8e07-e04607cf5017) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a237a739-6776-40e3-8aa2-32ca306393c3', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:35 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b6704b73-5f44-4603-9ad5-bae2602100c8 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b3504a9-4d7d-4ff8-8d60-223bc6a36f7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:35 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-b6704b73-5f44-4603-9ad5-bae2602100c8 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Volume volume-a237a739-6776-40e3-8aa2-32ca306393c3 (a237a739-6776-40e3-8aa2-32ca306393c3): created successfully Sep 15 16:39:35 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b6704b73-5f44-4603-9ad5-bae2602100c8 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b3504a9-4d7d-4ff8-8d60-223bc6a36f7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:35 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b6704b73-5f44-4603-9ad5-bae2602100c8 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Flow 'volume_create_manager' (ad2008ed-ba8a-48fc-a25e-a7068098fa59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:39:35 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-b6704b73-5f44-4603-9ad5-bae2602100c8 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Created volume successfully. Sep 15 16:39:35 devstack sudo[106673]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9a717249-6a62-430c-9b14-c99396151890 tempest-VolumeAndVolumeTypeFromImageTest-1876313635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-4fda87a6-d750-4c35-9054-3145868cb76c" returned: 0 in 0.365s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:35 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-9a717249-6a62-430c-9b14-c99396151890 tempest-VolumeAndVolumeTypeFromImageTest-1876313635 None] Lock "cinder-quobyte-4fda87a6-d750-4c35-9054-3145868cb76c" released by "delete_volume" :: held 0.919s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:39:35 devstack sudo[106669]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-65e70ff0-fece-4181-b2e5-99870111d3a4 tempest-CinderUnicodeTest-459182968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6af01cd0-53c3-4308-b74e-bdeb12be5364.b557302c-7876-4720-a395-ba65e533237c" returned: 0 in 0.517s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-65e70ff0-fece-4181-b2e5-99870111d3a4 tempest-CinderUnicodeTest-459182968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6af01cd0-53c3-4308-b74e-bdeb12be5364.b557302c-7876-4720-a395-ba65e533237c {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:35 devstack sudo[106682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6af01cd0-53c3-4308-b74e-bdeb12be5364.b557302c-7876-4720-a395-ba65e533237c Sep 15 16:39:35 devstack sudo[106682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:35 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-9a717249-6a62-430c-9b14-c99396151890 tempest-VolumeAndVolumeTypeFromImageTest-1876313635 None] Created reservations ['cd0b3e80-600e-408c-92c2-e4c0b22aeae2', 'bcfc3e87-47ff-473f-bfab-5149f8dca043', '1e9bea59-f7d7-4f5e-bb78-3db1c810f449', '807dc9e4-5604-4100-b099-f4060799db24'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:39:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-9a717249-6a62-430c-9b14-c99396151890 tempest-VolumeAndVolumeTypeFromImageTest-1876313635 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:39:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-9a717249-6a62-430c-9b14-c99396151890 tempest-VolumeAndVolumeTypeFromImageTest-1876313635 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:39:35 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-9a717249-6a62-430c-9b14-c99396151890 tempest-VolumeAndVolumeTypeFromImageTest-1876313635 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:39:35 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-9a717249-6a62-430c-9b14-c99396151890 tempest-VolumeAndVolumeTypeFromImageTest-1876313635 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:39:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-9a717249-6a62-430c-9b14-c99396151890 tempest-VolumeAndVolumeTypeFromImageTest-1876313635 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:39:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9a717249-6a62-430c-9b14-c99396151890 tempest-VolumeAndVolumeTypeFromImageTest-1876313635 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:35 devstack sudo[106687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:39:35 devstack sudo[106687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:35 devstack sudo[106682]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-65e70ff0-fece-4181-b2e5-99870111d3a4 tempest-CinderUnicodeTest-459182968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6af01cd0-53c3-4308-b74e-bdeb12be5364.b557302c-7876-4720-a395-ba65e533237c" returned: 0 in 0.375s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:35 devstack sudo[106678]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-cb34e3de-e1c7-4499-a4ed-07e7f47bf909 tempest-CreateVolumesFromSnapshotTest-1571001215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0baf2c22-5800-4f57-b807-8c617efe3aa0 1073741824" returned: 0 in 0.691s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:35 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-65e70ff0-fece-4181-b2e5-99870111d3a4 tempest-CinderUnicodeTest-459182968 None] Lock "cinder-quobyte-b557302c-7876-4720-a395-ba65e533237c" released by "_delete_snapshot" :: held 2.192s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:39:35 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-65e70ff0-fece-4181-b2e5-99870111d3a4 tempest-CinderUnicodeTest-459182968 None] Lock "cinder-quobyte-6af01cd0-53c3-4308-b74e-bdeb12be5364" released by "delete_snapshot" :: held 2.233s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:39:35 devstack sudo[106687]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9a717249-6a62-430c-9b14-c99396151890 tempest-VolumeAndVolumeTypeFromImageTest-1876313635 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.339s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:35 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-9a717249-6a62-430c-9b14-c99396151890 tempest-VolumeAndVolumeTypeFromImageTest-1876313635 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:39:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-cb34e3de-e1c7-4499-a4ed-07e7f47bf909 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0baf2c22-5800-4f57-b807-8c617efe3aa0 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:35 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-9a717249-6a62-430c-9b14-c99396151890 tempest-VolumeAndVolumeTypeFromImageTest-1876313635 None] Deleted volume successfully. Sep 15 16:39:35 devstack sudo[106692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0baf2c22-5800-4f57-b807-8c617efe3aa0 Sep 15 16:39:35 devstack sudo[106692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:35 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-9a717249-6a62-430c-9b14-c99396151890 tempest-VolumeAndVolumeTypeFromImageTest-1876313635 None] Lock "cinder-4fda87a6-d750-4c35-9054-3145868cb76c-delete_volume" released by "delete_volume" :: held 1.592s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:39:36 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-65e70ff0-fece-4181-b2e5-99870111d3a4 tempest-CinderUnicodeTest-459182968 None] Created reservations ['79de55d2-4113-4cef-aaf4-0ef0bde81e58', 'ef2c1fa5-0812-4f6e-a301-287258d589ce', 'bbf040fd-0a3f-4734-878f-d2f9e46d3b5f', '84ab8e75-57e7-4e1d-9093-ac371b353a92'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:39:36 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-65e70ff0-fece-4181-b2e5-99870111d3a4 tempest-CinderUnicodeTest-459182968 None] Delete snapshot completed successfully. Sep 15 16:39:36 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-65e70ff0-fece-4181-b2e5-99870111d3a4 tempest-CinderUnicodeTest-459182968 None] Lock "cinder-b557302c-7876-4720-a395-ba65e533237c-delete_snapshot" released by "delete_snapshot" :: held 2.457s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:39:36 devstack sudo[106692]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-cb34e3de-e1c7-4499-a4ed-07e7f47bf909 tempest-CreateVolumesFromSnapshotTest-1571001215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0baf2c22-5800-4f57-b807-8c617efe3aa0" returned: 0 in 0.305s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:36 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-cb34e3de-e1c7-4499-a4ed-07e7f47bf909 tempest-CreateVolumesFromSnapshotTest-1571001215 None] <== create_volume: return (1078ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:39:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-cb34e3de-e1c7-4499-a4ed-07e7f47bf909 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.082s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:39:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-39a5bb35-230f-4bcf-8b77-e355f0153384 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.412s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:39:36 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-39a5bb35-230f-4bcf-8b77-e355f0153384 tempest-CreateVolumesFromSnapshotTest-1571001215 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:39:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-560640396',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=342afcfb-f7fa-41c4-ab64-5f79ee02af0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cb4eea0668f40b997b7c4a55f06f397',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:39:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:39:33Z,use_quota=True,user_id='a2fb6be3f79b4c2daf3fc5a02b44a4f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:39:36 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-39a5bb35-230f-4bcf-8b77-e355f0153384 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Creating volume 342afcfb-f7fa-41c4-ab64-5f79ee02af0e {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:39:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-39a5bb35-230f-4bcf-8b77-e355f0153384 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:39:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-39a5bb35-230f-4bcf-8b77-e355f0153384 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:39:36 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-39a5bb35-230f-4bcf-8b77-e355f0153384 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:39:36 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-39a5bb35-230f-4bcf-8b77-e355f0153384 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:39:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-39a5bb35-230f-4bcf-8b77-e355f0153384 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:39:36 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-39a5bb35-230f-4bcf-8b77-e355f0153384 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:39:36 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-39a5bb35-230f-4bcf-8b77-e355f0153384 tempest-CreateVolumesFromSnapshotTest-1571001215 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:39:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-39a5bb35-230f-4bcf-8b77-e355f0153384 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-342afcfb-f7fa-41c4-ab64-5f79ee02af0e 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:36 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-cb34e3de-e1c7-4499-a4ed-07e7f47bf909 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8406fba9-7539-4ff7-b045-643084ac0cb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0baf2c22-5800-4f57-b807-8c617efe3aa0', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:36 devstack sudo[106695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-342afcfb-f7fa-41c4-ab64-5f79ee02af0e 1073741824 Sep 15 16:39:36 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-cb34e3de-e1c7-4499-a4ed-07e7f47bf909 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25324b43-04db-4675-b134-95c4271c5f83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:36 devstack sudo[106695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:36 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-cb34e3de-e1c7-4499-a4ed-07e7f47bf909 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Volume volume-0baf2c22-5800-4f57-b807-8c617efe3aa0 (0baf2c22-5800-4f57-b807-8c617efe3aa0): created successfully Sep 15 16:39:36 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-cb34e3de-e1c7-4499-a4ed-07e7f47bf909 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25324b43-04db-4675-b134-95c4271c5f83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:36 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-cb34e3de-e1c7-4499-a4ed-07e7f47bf909 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Flow 'volume_create_manager' (8f478560-700a-4e47-87d3-57d6e834e732) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:39:36 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-cb34e3de-e1c7-4499-a4ed-07e7f47bf909 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Created volume successfully. Sep 15 16:39:36 devstack sudo[106695]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-39a5bb35-230f-4bcf-8b77-e355f0153384 tempest-CreateVolumesFromSnapshotTest-1571001215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-342afcfb-f7fa-41c4-ab64-5f79ee02af0e 1073741824" returned: 0 in 0.549s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-39a5bb35-230f-4bcf-8b77-e355f0153384 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-342afcfb-f7fa-41c4-ab64-5f79ee02af0e {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:36 devstack sudo[106702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-342afcfb-f7fa-41c4-ab64-5f79ee02af0e Sep 15 16:39:36 devstack sudo[106702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:36 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-5b69ae0c-6612-4b71-bfb3-71485cd0344b tempest-CinderUnicodeTest-459182968 None] Acquiring lock "cinder-6af01cd0-53c3-4308-b74e-bdeb12be5364-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:39:36 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-5b69ae0c-6612-4b71-bfb3-71485cd0344b tempest-CinderUnicodeTest-459182968 None] Lock "cinder-6af01cd0-53c3-4308-b74e-bdeb12be5364-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:39:36 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-5b69ae0c-6612-4b71-bfb3-71485cd0344b tempest-CinderUnicodeTest-459182968 None] Acquiring lock "cinder-quobyte-6af01cd0-53c3-4308-b74e-bdeb12be5364" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:39:36 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-5b69ae0c-6612-4b71-bfb3-71485cd0344b tempest-CinderUnicodeTest-459182968 None] Lock "cinder-quobyte-6af01cd0-53c3-4308-b74e-bdeb12be5364" acquired by "delete_volume" :: waited 0.016s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:39:37 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7ad1619-8ea3-40b6-be1c-4ab6a25fc6b3]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:39:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5b69ae0c-6612-4b71-bfb3-71485cd0344b tempest-CinderUnicodeTest-459182968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6af01cd0-53c3-4308-b74e-bdeb12be5364 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:37 devstack sudo[106705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6af01cd0-53c3-4308-b74e-bdeb12be5364 Sep 15 16:39:37 devstack sudo[106705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:37 devstack sudo[106702]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-39a5bb35-230f-4bcf-8b77-e355f0153384 tempest-CreateVolumesFromSnapshotTest-1571001215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-342afcfb-f7fa-41c4-ab64-5f79ee02af0e" returned: 0 in 0.377s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:37 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-39a5bb35-230f-4bcf-8b77-e355f0153384 tempest-CreateVolumesFromSnapshotTest-1571001215 None] <== create_volume: return (1002ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:39:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-39a5bb35-230f-4bcf-8b77-e355f0153384 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.005s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:39:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-72b07cae-c87d-4d34-a3f7-d80ff43fdfc5 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.872s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:39:37 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-72b07cae-c87d-4d34-a3f7-d80ff43fdfc5 tempest-CreateVolumesFromSnapshotTest-1571001215 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:39:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1743781109',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5250eb4a-b438-4a1a-a4e0-95b28fbc0298,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6cb4eea0668f40b997b7c4a55f06f397',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:39:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:39:33Z,use_quota=True,user_id='a2fb6be3f79b4c2daf3fc5a02b44a4f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:39:37 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-72b07cae-c87d-4d34-a3f7-d80ff43fdfc5 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Creating volume 5250eb4a-b438-4a1a-a4e0-95b28fbc0298 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:39:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-72b07cae-c87d-4d34-a3f7-d80ff43fdfc5 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:39:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-72b07cae-c87d-4d34-a3f7-d80ff43fdfc5 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:39:37 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-72b07cae-c87d-4d34-a3f7-d80ff43fdfc5 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:39:37 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-72b07cae-c87d-4d34-a3f7-d80ff43fdfc5 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:39:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-72b07cae-c87d-4d34-a3f7-d80ff43fdfc5 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:39:37 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-72b07cae-c87d-4d34-a3f7-d80ff43fdfc5 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:39:37 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-72b07cae-c87d-4d34-a3f7-d80ff43fdfc5 tempest-CreateVolumesFromSnapshotTest-1571001215 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:39:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-72b07cae-c87d-4d34-a3f7-d80ff43fdfc5 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-5250eb4a-b438-4a1a-a4e0-95b28fbc0298 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:37 devstack sudo[106708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-5250eb4a-b438-4a1a-a4e0-95b28fbc0298 1073741824 Sep 15 16:39:37 devstack sudo[106708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:37 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-39a5bb35-230f-4bcf-8b77-e355f0153384 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2065e94-89c1-4fd7-aa8e-fd8d5bdf5d68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-342afcfb-f7fa-41c4-ab64-5f79ee02af0e', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:37 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-39a5bb35-230f-4bcf-8b77-e355f0153384 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49e15f36-d5df-4aee-a3d2-dd2167b4ec24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:37 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-39a5bb35-230f-4bcf-8b77-e355f0153384 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Volume volume-342afcfb-f7fa-41c4-ab64-5f79ee02af0e (342afcfb-f7fa-41c4-ab64-5f79ee02af0e): created successfully Sep 15 16:39:37 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-39a5bb35-230f-4bcf-8b77-e355f0153384 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49e15f36-d5df-4aee-a3d2-dd2167b4ec24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:37 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-39a5bb35-230f-4bcf-8b77-e355f0153384 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Flow 'volume_create_manager' (794a3dba-922f-4118-9a69-1ee3fff85d58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:39:37 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-39a5bb35-230f-4bcf-8b77-e355f0153384 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Created volume successfully. Sep 15 16:39:37 devstack sudo[106705]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5b69ae0c-6612-4b71-bfb3-71485cd0344b tempest-CinderUnicodeTest-459182968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6af01cd0-53c3-4308-b74e-bdeb12be5364" returned: 0 in 0.514s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5b69ae0c-6612-4b71-bfb3-71485cd0344b tempest-CinderUnicodeTest-459182968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6af01cd0-53c3-4308-b74e-bdeb12be5364 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:37 devstack sudo[106715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6af01cd0-53c3-4308-b74e-bdeb12be5364 Sep 15 16:39:37 devstack sudo[106715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:37 devstack sudo[106708]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-72b07cae-c87d-4d34-a3f7-d80ff43fdfc5 tempest-CreateVolumesFromSnapshotTest-1571001215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-5250eb4a-b438-4a1a-a4e0-95b28fbc0298 1073741824" returned: 0 in 0.641s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:37 devstack sudo[106715]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5b69ae0c-6612-4b71-bfb3-71485cd0344b tempest-CinderUnicodeTest-459182968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6af01cd0-53c3-4308-b74e-bdeb12be5364" returned: 0 in 0.382s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:37 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-5b69ae0c-6612-4b71-bfb3-71485cd0344b tempest-CinderUnicodeTest-459182968 None] Lock "cinder-quobyte-6af01cd0-53c3-4308-b74e-bdeb12be5364" released by "delete_volume" :: held 0.990s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:39:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-72b07cae-c87d-4d34-a3f7-d80ff43fdfc5 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-5250eb4a-b438-4a1a-a4e0-95b28fbc0298 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:38 devstack sudo[106719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-5250eb4a-b438-4a1a-a4e0-95b28fbc0298 Sep 15 16:39:38 devstack sudo[106719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:38 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-5b69ae0c-6612-4b71-bfb3-71485cd0344b tempest-CinderUnicodeTest-459182968 None] Created reservations ['9825b7f9-f5ae-40b9-99a8-ad1de3e90180', '665a45e0-fde4-4044-88df-a1c019e5d5aa', 'ae6d4c37-f465-4a2b-9b0f-778f6db58885', '6d6d7e11-028e-4c7e-85a7-acf0754ec221'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:39:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-5b69ae0c-6612-4b71-bfb3-71485cd0344b tempest-CinderUnicodeTest-459182968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:39:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-5b69ae0c-6612-4b71-bfb3-71485cd0344b tempest-CinderUnicodeTest-459182968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:39:38 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-5b69ae0c-6612-4b71-bfb3-71485cd0344b tempest-CinderUnicodeTest-459182968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:39:38 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-5b69ae0c-6612-4b71-bfb3-71485cd0344b tempest-CinderUnicodeTest-459182968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:39:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-5b69ae0c-6612-4b71-bfb3-71485cd0344b tempest-CinderUnicodeTest-459182968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:39:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5b69ae0c-6612-4b71-bfb3-71485cd0344b tempest-CinderUnicodeTest-459182968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:38 devstack sudo[106721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:39:38 devstack sudo[106721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:38 devstack sudo[106719]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-72b07cae-c87d-4d34-a3f7-d80ff43fdfc5 tempest-CreateVolumesFromSnapshotTest-1571001215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-5250eb4a-b438-4a1a-a4e0-95b28fbc0298" returned: 0 in 0.437s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:38 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-72b07cae-c87d-4d34-a3f7-d80ff43fdfc5 tempest-CreateVolumesFromSnapshotTest-1571001215 None] <== create_volume: return (1199ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:39:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-72b07cae-c87d-4d34-a3f7-d80ff43fdfc5 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.201s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:39:38 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-72b07cae-c87d-4d34-a3f7-d80ff43fdfc5 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (add0f589-4495-4078-a5a1-4f28859e4203) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5250eb4a-b438-4a1a-a4e0-95b28fbc0298', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:38 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-72b07cae-c87d-4d34-a3f7-d80ff43fdfc5 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0298e4b2-84ae-4771-b655-bdc61e4f96d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:38 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-17052c92-0259-4be2-9ecc-f20c90d6a004 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:39:38 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-17052c92-0259-4be2-9ecc-f20c90d6a004 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Flow 'volume_create_manager' (f9da8153-d912-4268-9faa-83e42ae56345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:39:38 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-17052c92-0259-4be2-9ecc-f20c90d6a004 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b87dc43-519e-49ca-90b4-9215252c4dfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:38 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-72b07cae-c87d-4d34-a3f7-d80ff43fdfc5 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Volume volume-5250eb4a-b438-4a1a-a4e0-95b28fbc0298 (5250eb4a-b438-4a1a-a4e0-95b28fbc0298): created successfully Sep 15 16:39:38 devstack sudo[106721]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:38 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-72b07cae-c87d-4d34-a3f7-d80ff43fdfc5 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0298e4b2-84ae-4771-b655-bdc61e4f96d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:38 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-72b07cae-c87d-4d34-a3f7-d80ff43fdfc5 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Flow 'volume_create_manager' (246a9e17-319d-4bf3-80a4-182f17bc65cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:39:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5b69ae0c-6612-4b71-bfb3-71485cd0344b tempest-CinderUnicodeTest-459182968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.345s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:38 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-5b69ae0c-6612-4b71-bfb3-71485cd0344b tempest-CinderUnicodeTest-459182968 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:39:38 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-17052c92-0259-4be2-9ecc-f20c90d6a004 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b87dc43-519e-49ca-90b4-9215252c4dfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:39:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1484547858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9c1d8a2-7109-4e9b-a1d5-4dc6f9c5ce95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba3c09c85ceb4574b747022f8cd53fd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:39:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:39:38Z,use_quota=True,user_id='06128a4c927b419a936bd45b6c2749fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:38 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-17052c92-0259-4be2-9ecc-f20c90d6a004 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (823cc899-d404-4587-b683-a227b371b90f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:38 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-17052c92-0259-4be2-9ecc-f20c90d6a004 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (823cc899-d404-4587-b683-a227b371b90f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:38 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-17052c92-0259-4be2-9ecc-f20c90d6a004 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b51841fe-5e5e-4a93-856d-ba6109369bfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:38 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-17052c92-0259-4be2-9ecc-f20c90d6a004 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b51841fe-5e5e-4a93-856d-ba6109369bfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9c1d8a2-7109-4e9b-a1d5-4dc6f9c5ce95', 'volume_name': 'volume-b9c1d8a2-7109-4e9b-a1d5-4dc6f9c5ce95', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:38 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-17052c92-0259-4be2-9ecc-f20c90d6a004 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b3e91eb-3626-4dfe-b39c-84ead2bf1bbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:38 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-17052c92-0259-4be2-9ecc-f20c90d6a004 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b3e91eb-3626-4dfe-b39c-84ead2bf1bbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:38 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-17052c92-0259-4be2-9ecc-f20c90d6a004 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b7d1830-0e48-4e6b-a836-d0ac539cca9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:38 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-17052c92-0259-4be2-9ecc-f20c90d6a004 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Volume b9c1d8a2-7109-4e9b-a1d5-4dc6f9c5ce95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9c1d8a2-7109-4e9b-a1d5-4dc6f9c5ce95', 'volume_size': 1} Sep 15 16:39:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-17052c92-0259-4be2-9ecc-f20c90d6a004 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:39:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-17052c92-0259-4be2-9ecc-f20c90d6a004 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:39:38 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-17052c92-0259-4be2-9ecc-f20c90d6a004 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:39:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1484547858',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9c1d8a2-7109-4e9b-a1d5-4dc6f9c5ce95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba3c09c85ceb4574b747022f8cd53fd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:39:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:39:38Z,use_quota=True,user_id='06128a4c927b419a936bd45b6c2749fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:39:38 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-17052c92-0259-4be2-9ecc-f20c90d6a004 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Creating volume b9c1d8a2-7109-4e9b-a1d5-4dc6f9c5ce95 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:39:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-17052c92-0259-4be2-9ecc-f20c90d6a004 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:39:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-17052c92-0259-4be2-9ecc-f20c90d6a004 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:39:38 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-17052c92-0259-4be2-9ecc-f20c90d6a004 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:39:38 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-17052c92-0259-4be2-9ecc-f20c90d6a004 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:39:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-17052c92-0259-4be2-9ecc-f20c90d6a004 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:39:38 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-17052c92-0259-4be2-9ecc-f20c90d6a004 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:39:38 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-17052c92-0259-4be2-9ecc-f20c90d6a004 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:39:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-17052c92-0259-4be2-9ecc-f20c90d6a004 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b9c1d8a2-7109-4e9b-a1d5-4dc6f9c5ce95 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:38 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-5b69ae0c-6612-4b71-bfb3-71485cd0344b tempest-CinderUnicodeTest-459182968 None] Deleted volume successfully. Sep 15 16:39:38 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-72b07cae-c87d-4d34-a3f7-d80ff43fdfc5 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Created volume successfully. Sep 15 16:39:38 devstack sudo[106725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b9c1d8a2-7109-4e9b-a1d5-4dc6f9c5ce95 1073741824 Sep 15 16:39:38 devstack sudo[106725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:38 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-5b69ae0c-6612-4b71-bfb3-71485cd0344b tempest-CinderUnicodeTest-459182968 None] Lock "cinder-6af01cd0-53c3-4308-b74e-bdeb12be5364-delete_volume" released by "delete_volume" :: held 1.690s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:39:38 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-5a66c21f-f5e6-4552-a4ce-14169f6fb237 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Acquiring lock "cinder-5250eb4a-b438-4a1a-a4e0-95b28fbc0298-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:39:38 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-5a66c21f-f5e6-4552-a4ce-14169f6fb237 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Lock "cinder-5250eb4a-b438-4a1a-a4e0-95b28fbc0298-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:39:38 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-5a66c21f-f5e6-4552-a4ce-14169f6fb237 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Acquiring lock "cinder-quobyte-5250eb4a-b438-4a1a-a4e0-95b28fbc0298" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:39:38 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-5a66c21f-f5e6-4552-a4ce-14169f6fb237 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Lock "cinder-quobyte-5250eb4a-b438-4a1a-a4e0-95b28fbc0298" acquired by "delete_volume" :: waited 0.015s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:39:38 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[f156af32-7b1a-4ce2-a986-88c626d8a9ad]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:39:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5a66c21f-f5e6-4552-a4ce-14169f6fb237 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-5250eb4a-b438-4a1a-a4e0-95b28fbc0298 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:39 devstack sudo[106730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-5250eb4a-b438-4a1a-a4e0-95b28fbc0298 Sep 15 16:39:39 devstack sudo[106730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:39 devstack sudo[106725]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-17052c92-0259-4be2-9ecc-f20c90d6a004 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b9c1d8a2-7109-4e9b-a1d5-4dc6f9c5ce95 1073741824" returned: 0 in 0.572s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:39 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-8b6b9436-c913-444a-9d0c-d5a127f19a70 tempest-CinderUnicodeTest-459182968 None] Acquiring lock "cinder-01121f71-c202-4642-b0fd-17276d3b8ee2-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:39:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-17052c92-0259-4be2-9ecc-f20c90d6a004 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b9c1d8a2-7109-4e9b-a1d5-4dc6f9c5ce95 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:39 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-8b6b9436-c913-444a-9d0c-d5a127f19a70 tempest-CinderUnicodeTest-459182968 None] Lock "cinder-01121f71-c202-4642-b0fd-17276d3b8ee2-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:39:39 devstack sudo[106733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b9c1d8a2-7109-4e9b-a1d5-4dc6f9c5ce95 Sep 15 16:39:39 devstack sudo[106733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:39 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-8b6b9436-c913-444a-9d0c-d5a127f19a70 tempest-CinderUnicodeTest-459182968 None] Acquiring lock "cinder-quobyte-01121f71-c202-4642-b0fd-17276d3b8ee2" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:39:39 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-8b6b9436-c913-444a-9d0c-d5a127f19a70 tempest-CinderUnicodeTest-459182968 None] Lock "cinder-quobyte-01121f71-c202-4642-b0fd-17276d3b8ee2" acquired by "delete_volume" :: waited 0.020s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:39:39 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcc62aad-de5e-4276-a27d-9b0665394332]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:39:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8b6b9436-c913-444a-9d0c-d5a127f19a70 tempest-CinderUnicodeTest-459182968 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-01121f71-c202-4642-b0fd-17276d3b8ee2 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:39 devstack sudo[106736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-01121f71-c202-4642-b0fd-17276d3b8ee2 Sep 15 16:39:39 devstack sudo[106736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:39 devstack sudo[106730]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5a66c21f-f5e6-4552-a4ce-14169f6fb237 tempest-CreateVolumesFromSnapshotTest-1571001215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-5250eb4a-b438-4a1a-a4e0-95b28fbc0298" returned: 0 in 0.523s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5a66c21f-f5e6-4552-a4ce-14169f6fb237 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-5250eb4a-b438-4a1a-a4e0-95b28fbc0298 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:39 devstack sudo[106741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-5250eb4a-b438-4a1a-a4e0-95b28fbc0298 Sep 15 16:39:39 devstack sudo[106741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:39 devstack sudo[106733]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-17052c92-0259-4be2-9ecc-f20c90d6a004 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b9c1d8a2-7109-4e9b-a1d5-4dc6f9c5ce95" returned: 0 in 0.369s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:39 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-17052c92-0259-4be2-9ecc-f20c90d6a004 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] <== create_volume: return (1006ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:39:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-17052c92-0259-4be2-9ecc-f20c90d6a004 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.010s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:39:39 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-17052c92-0259-4be2-9ecc-f20c90d6a004 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b7d1830-0e48-4e6b-a836-d0ac539cca9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9c1d8a2-7109-4e9b-a1d5-4dc6f9c5ce95', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:39 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-17052c92-0259-4be2-9ecc-f20c90d6a004 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38c28a9e-2665-4d9e-85a2-697e77648e22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:39 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-17052c92-0259-4be2-9ecc-f20c90d6a004 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Volume volume-b9c1d8a2-7109-4e9b-a1d5-4dc6f9c5ce95 (b9c1d8a2-7109-4e9b-a1d5-4dc6f9c5ce95): created successfully Sep 15 16:39:39 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-17052c92-0259-4be2-9ecc-f20c90d6a004 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38c28a9e-2665-4d9e-85a2-697e77648e22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:39 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-17052c92-0259-4be2-9ecc-f20c90d6a004 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Flow 'volume_create_manager' (f9da8153-d912-4268-9faa-83e42ae56345) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:39:39 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-17052c92-0259-4be2-9ecc-f20c90d6a004 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Created volume successfully. Sep 15 16:39:39 devstack sudo[106736]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8b6b9436-c913-444a-9d0c-d5a127f19a70 tempest-CinderUnicodeTest-459182968 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-01121f71-c202-4642-b0fd-17276d3b8ee2" returned: 0 in 0.397s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8b6b9436-c913-444a-9d0c-d5a127f19a70 tempest-CinderUnicodeTest-459182968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-01121f71-c202-4642-b0fd-17276d3b8ee2 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:39 devstack sudo[106746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-01121f71-c202-4642-b0fd-17276d3b8ee2 Sep 15 16:39:39 devstack sudo[106746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:39 devstack sudo[106741]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5a66c21f-f5e6-4552-a4ce-14169f6fb237 tempest-CreateVolumesFromSnapshotTest-1571001215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-5250eb4a-b438-4a1a-a4e0-95b28fbc0298" returned: 0 in 0.324s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:39 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-5a66c21f-f5e6-4552-a4ce-14169f6fb237 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Lock "cinder-quobyte-5250eb4a-b438-4a1a-a4e0-95b28fbc0298" released by "delete_volume" :: held 0.901s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:39:39 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-5a66c21f-f5e6-4552-a4ce-14169f6fb237 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Created reservations ['6891506a-5040-43e2-9ece-569f75f70a56', '0704b7b8-3071-4231-99d3-cc43f315409d', 'e7dda0b0-f959-49a8-8152-df0fea01bc9e', 'cbac2a92-3179-4370-aeca-2d272b1bd245'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:39:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-5a66c21f-f5e6-4552-a4ce-14169f6fb237 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:39:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-5a66c21f-f5e6-4552-a4ce-14169f6fb237 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:39:39 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-5a66c21f-f5e6-4552-a4ce-14169f6fb237 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:39:39 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-5a66c21f-f5e6-4552-a4ce-14169f6fb237 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:39:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-5a66c21f-f5e6-4552-a4ce-14169f6fb237 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:39:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5a66c21f-f5e6-4552-a4ce-14169f6fb237 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:40 devstack sudo[106749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:39:40 devstack sudo[106749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:40 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-a1898455-6515-4780-8ede-34220838c717 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Acquiring lock "cinder-342afcfb-f7fa-41c4-ab64-5f79ee02af0e-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:39:40 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-a1898455-6515-4780-8ede-34220838c717 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Lock "cinder-342afcfb-f7fa-41c4-ab64-5f79ee02af0e-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:39:40 devstack sudo[106746]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8b6b9436-c913-444a-9d0c-d5a127f19a70 tempest-CinderUnicodeTest-459182968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-01121f71-c202-4642-b0fd-17276d3b8ee2" returned: 0 in 0.375s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:40 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-a1898455-6515-4780-8ede-34220838c717 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Acquiring lock "cinder-quobyte-342afcfb-f7fa-41c4-ab64-5f79ee02af0e" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:39:40 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-8b6b9436-c913-444a-9d0c-d5a127f19a70 tempest-CinderUnicodeTest-459182968 None] Lock "cinder-quobyte-01121f71-c202-4642-b0fd-17276d3b8ee2" released by "delete_volume" :: held 0.858s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:39:40 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-a1898455-6515-4780-8ede-34220838c717 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Lock "cinder-quobyte-342afcfb-f7fa-41c4-ab64-5f79ee02af0e" acquired by "delete_volume" :: waited 0.035s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:39:40 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c9e6f42-e0de-4e67-8812-bc792a519d0b]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:39:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a1898455-6515-4780-8ede-34220838c717 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-342afcfb-f7fa-41c4-ab64-5f79ee02af0e {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:40 devstack sudo[106749]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5a66c21f-f5e6-4552-a4ce-14169f6fb237 tempest-CreateVolumesFromSnapshotTest-1571001215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.310s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:40 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-5a66c21f-f5e6-4552-a4ce-14169f6fb237 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:39:40 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-5a66c21f-f5e6-4552-a4ce-14169f6fb237 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Deleted volume successfully. Sep 15 16:39:40 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-5a66c21f-f5e6-4552-a4ce-14169f6fb237 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Lock "cinder-5250eb4a-b438-4a1a-a4e0-95b28fbc0298-delete_volume" released by "delete_volume" :: held 1.487s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:39:40 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-8b6b9436-c913-444a-9d0c-d5a127f19a70 tempest-CinderUnicodeTest-459182968 None] Created reservations ['f1fd607d-b016-483c-8859-2896276d9155', '3cd5d055-ec84-458e-97b8-c366082d2127', 'e371fedb-09df-4bc3-aba8-dd8a077d3b54', 'f79bfa10-c66c-4167-b4af-7f5e141d6269'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:39:40 devstack sudo[106753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-342afcfb-f7fa-41c4-ab64-5f79ee02af0e Sep 15 16:39:40 devstack sudo[106753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-8b6b9436-c913-444a-9d0c-d5a127f19a70 tempest-CinderUnicodeTest-459182968 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:39:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-8b6b9436-c913-444a-9d0c-d5a127f19a70 tempest-CinderUnicodeTest-459182968 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:39:40 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-8b6b9436-c913-444a-9d0c-d5a127f19a70 tempest-CinderUnicodeTest-459182968 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:39:40 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-8b6b9436-c913-444a-9d0c-d5a127f19a70 tempest-CinderUnicodeTest-459182968 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:39:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-8b6b9436-c913-444a-9d0c-d5a127f19a70 tempest-CinderUnicodeTest-459182968 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:39:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8b6b9436-c913-444a-9d0c-d5a127f19a70 tempest-CinderUnicodeTest-459182968 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:40 devstack sudo[106755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:39:40 devstack sudo[106755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:40 devstack sudo[106753]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a1898455-6515-4780-8ede-34220838c717 tempest-CreateVolumesFromSnapshotTest-1571001215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-342afcfb-f7fa-41c4-ab64-5f79ee02af0e" returned: 0 in 0.469s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a1898455-6515-4780-8ede-34220838c717 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-342afcfb-f7fa-41c4-ab64-5f79ee02af0e {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:40 devstack sudo[106760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-342afcfb-f7fa-41c4-ab64-5f79ee02af0e Sep 15 16:39:40 devstack sudo[106760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:40 devstack sudo[106755]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8b6b9436-c913-444a-9d0c-d5a127f19a70 tempest-CinderUnicodeTest-459182968 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.322s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:40 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-8b6b9436-c913-444a-9d0c-d5a127f19a70 tempest-CinderUnicodeTest-459182968 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:39:40 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-8b6b9436-c913-444a-9d0c-d5a127f19a70 tempest-CinderUnicodeTest-459182968 None] Deleted volume successfully. Sep 15 16:39:40 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-8b6b9436-c913-444a-9d0c-d5a127f19a70 tempest-CinderUnicodeTest-459182968 None] Lock "cinder-01121f71-c202-4642-b0fd-17276d3b8ee2-delete_volume" released by "delete_volume" :: held 1.617s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:39:41 devstack sudo[106760]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a1898455-6515-4780-8ede-34220838c717 tempest-CreateVolumesFromSnapshotTest-1571001215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-342afcfb-f7fa-41c4-ab64-5f79ee02af0e" returned: 0 in 0.325s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:41 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-a1898455-6515-4780-8ede-34220838c717 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Lock "cinder-quobyte-342afcfb-f7fa-41c4-ab64-5f79ee02af0e" released by "delete_volume" :: held 0.852s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:39:41 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c823bf9-5897-446e-93ee-022286f17e6e tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:39:41 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2c823bf9-5897-446e-93ee-022286f17e6e tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Flow 'volume_create_manager' (3f459358-11b8-4426-82db-87ecf984fee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:39:41 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2c823bf9-5897-446e-93ee-022286f17e6e tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9033d2f1-1289-4c40-a856-7c30b755e5b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:41 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2c823bf9-5897-446e-93ee-022286f17e6e tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9033d2f1-1289-4c40-a856-7c30b755e5b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:39:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1986104617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcb07027-338e-49ed-b34a-1aeb25fb9a2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba3c09c85ceb4574b747022f8cd53fd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:39:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:39:41Z,use_quota=True,user_id='06128a4c927b419a936bd45b6c2749fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:41 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2c823bf9-5897-446e-93ee-022286f17e6e tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07570b2c-1776-4af1-8f53-6f036b65d449) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:41 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2c823bf9-5897-446e-93ee-022286f17e6e tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07570b2c-1776-4af1-8f53-6f036b65d449) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:41 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2c823bf9-5897-446e-93ee-022286f17e6e tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab529807-1284-47a1-ae53-e91e4fa77fcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:41 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2c823bf9-5897-446e-93ee-022286f17e6e tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab529807-1284-47a1-ae53-e91e4fa77fcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dcb07027-338e-49ed-b34a-1aeb25fb9a2f', 'volume_name': 'volume-dcb07027-338e-49ed-b34a-1aeb25fb9a2f', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:41 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2c823bf9-5897-446e-93ee-022286f17e6e tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24bd9512-3f6f-434d-b0d9-9fd1d77dd987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:41 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2c823bf9-5897-446e-93ee-022286f17e6e tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24bd9512-3f6f-434d-b0d9-9fd1d77dd987) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:41 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2c823bf9-5897-446e-93ee-022286f17e6e tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (535667fe-baf2-4c58-ab08-2798730598dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:41 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-2c823bf9-5897-446e-93ee-022286f17e6e tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Volume dcb07027-338e-49ed-b34a-1aeb25fb9a2f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dcb07027-338e-49ed-b34a-1aeb25fb9a2f', 'volume_size': 1} Sep 15 16:39:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-2c823bf9-5897-446e-93ee-022286f17e6e tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:39:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-2c823bf9-5897-446e-93ee-022286f17e6e tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:39:41 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-2c823bf9-5897-446e-93ee-022286f17e6e tempest-CreateVolumesFromSourceVolumeTest-983402188 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:39:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1986104617',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcb07027-338e-49ed-b34a-1aeb25fb9a2f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba3c09c85ceb4574b747022f8cd53fd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:39:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:39:41Z,use_quota=True,user_id='06128a4c927b419a936bd45b6c2749fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:39:41 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-2c823bf9-5897-446e-93ee-022286f17e6e tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Creating volume dcb07027-338e-49ed-b34a-1aeb25fb9a2f {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:39:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-2c823bf9-5897-446e-93ee-022286f17e6e tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:39:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-2c823bf9-5897-446e-93ee-022286f17e6e tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:39:41 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-2c823bf9-5897-446e-93ee-022286f17e6e tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:39:41 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-2c823bf9-5897-446e-93ee-022286f17e6e tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:39:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-2c823bf9-5897-446e-93ee-022286f17e6e tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:39:41 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-2c823bf9-5897-446e-93ee-022286f17e6e tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:39:41 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-2c823bf9-5897-446e-93ee-022286f17e6e tempest-CreateVolumesFromSourceVolumeTest-983402188 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:39:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2c823bf9-5897-446e-93ee-022286f17e6e tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-dcb07027-338e-49ed-b34a-1aeb25fb9a2f 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:41 devstack sudo[106764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-dcb07027-338e-49ed-b34a-1aeb25fb9a2f 1073741824 Sep 15 16:39:41 devstack sudo[106764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:41 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-a1898455-6515-4780-8ede-34220838c717 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Created reservations ['ed8a952b-9b3d-47b6-9481-ae9d08c5b8d4', 'f653bbc3-c849-4d13-9e00-66185991420e', '222ce1ec-fbea-4d69-8e99-daf9121ec1ae', '0aa3aaf8-c5fb-4dd6-8796-4c033668bd7b'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:39:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-a1898455-6515-4780-8ede-34220838c717 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:39:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-a1898455-6515-4780-8ede-34220838c717 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:39:41 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-a1898455-6515-4780-8ede-34220838c717 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:39:41 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-a1898455-6515-4780-8ede-34220838c717 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:39:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-a1898455-6515-4780-8ede-34220838c717 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:39:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a1898455-6515-4780-8ede-34220838c717 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:41 devstack sudo[106766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:39:41 devstack sudo[106766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:41 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f01af2c-67fd-4b77-acb3-88ba4459a99c tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:39:41 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8f01af2c-67fd-4b77-acb3-88ba4459a99c tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Flow 'volume_create_manager' (e64d5fa4-9824-4942-b44b-4c687974c4e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:39:41 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8f01af2c-67fd-4b77-acb3-88ba4459a99c tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fbb5947-e0b6-498d-9660-291795c5e58d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:41 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8f01af2c-67fd-4b77-acb3-88ba4459a99c tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fbb5947-e0b6-498d-9660-291795c5e58d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:39:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-561605000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52d8b18b-8f27-40d2-a0d7-0c9a47c0b1aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba3c09c85ceb4574b747022f8cd53fd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:39:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:39:41Z,use_quota=True,user_id='06128a4c927b419a936bd45b6c2749fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:41 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8f01af2c-67fd-4b77-acb3-88ba4459a99c tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdb62341-e7b6-4bbd-80c3-392e8d174c57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:41 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8f01af2c-67fd-4b77-acb3-88ba4459a99c tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdb62341-e7b6-4bbd-80c3-392e8d174c57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:41 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8f01af2c-67fd-4b77-acb3-88ba4459a99c tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (002a1fad-59ef-4abd-9c67-dceba5a9cb3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:41 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8f01af2c-67fd-4b77-acb3-88ba4459a99c tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (002a1fad-59ef-4abd-9c67-dceba5a9cb3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52d8b18b-8f27-40d2-a0d7-0c9a47c0b1aa', 'volume_name': 'volume-52d8b18b-8f27-40d2-a0d7-0c9a47c0b1aa', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:41 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8f01af2c-67fd-4b77-acb3-88ba4459a99c tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6e6d3f6-fd1f-470b-a0de-b321433503a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:41 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8f01af2c-67fd-4b77-acb3-88ba4459a99c tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6e6d3f6-fd1f-470b-a0de-b321433503a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:41 devstack sudo[106766]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:41 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8f01af2c-67fd-4b77-acb3-88ba4459a99c tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e8be3df-2ee8-4ceb-b137-2677fc5fd0dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:41 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-8f01af2c-67fd-4b77-acb3-88ba4459a99c tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Volume 52d8b18b-8f27-40d2-a0d7-0c9a47c0b1aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52d8b18b-8f27-40d2-a0d7-0c9a47c0b1aa', 'volume_size': 1} Sep 15 16:39:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-8f01af2c-67fd-4b77-acb3-88ba4459a99c tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:39:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a1898455-6515-4780-8ede-34220838c717 tempest-CreateVolumesFromSnapshotTest-1571001215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.393s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:41 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-a1898455-6515-4780-8ede-34220838c717 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:39:41 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-a1898455-6515-4780-8ede-34220838c717 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Deleted volume successfully. Sep 15 16:39:41 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-a1898455-6515-4780-8ede-34220838c717 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Lock "cinder-342afcfb-f7fa-41c4-ab64-5f79ee02af0e-delete_volume" released by "delete_volume" :: held 1.797s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:39:42 devstack sudo[106764]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2c823bf9-5897-446e-93ee-022286f17e6e tempest-CreateVolumesFromSourceVolumeTest-983402188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-dcb07027-338e-49ed-b34a-1aeb25fb9a2f 1073741824" returned: 0 in 0.954s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:42 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ac64c8b-ed66-45eb-8d60-09856ae2caaa tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:39:42 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-3ac64c8b-ed66-45eb-8d60-09856ae2caaa tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Flow 'volume_create_manager' (003018b6-7461-4176-b6ea-c07d529c7387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:39:42 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-3ac64c8b-ed66-45eb-8d60-09856ae2caaa tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3664334f-2e9e-42b9-bacf-94577f6721dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2c823bf9-5897-446e-93ee-022286f17e6e tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-dcb07027-338e-49ed-b34a-1aeb25fb9a2f {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:42 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-3ac64c8b-ed66-45eb-8d60-09856ae2caaa tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3664334f-2e9e-42b9-bacf-94577f6721dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:39:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-449424727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38e58d5e-b7c6-4840-b5ff-07fcca57efcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba3c09c85ceb4574b747022f8cd53fd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:39:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:39:42Z,use_quota=True,user_id='06128a4c927b419a936bd45b6c2749fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:42 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-3ac64c8b-ed66-45eb-8d60-09856ae2caaa tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17565254-7bf4-47d0-949b-1d11ea1faf51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:42 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-3ac64c8b-ed66-45eb-8d60-09856ae2caaa tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17565254-7bf4-47d0-949b-1d11ea1faf51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:42 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-3ac64c8b-ed66-45eb-8d60-09856ae2caaa tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc85be65-ec82-4c76-b9cb-34ea18c3346d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:42 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-3ac64c8b-ed66-45eb-8d60-09856ae2caaa tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc85be65-ec82-4c76-b9cb-34ea18c3346d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38e58d5e-b7c6-4840-b5ff-07fcca57efcc', 'volume_name': 'volume-38e58d5e-b7c6-4840-b5ff-07fcca57efcc', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:42 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-3ac64c8b-ed66-45eb-8d60-09856ae2caaa tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52c8f78e-9cb2-4b47-a64f-54fbf05b60d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:42 devstack sudo[106773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-dcb07027-338e-49ed-b34a-1aeb25fb9a2f Sep 15 16:39:42 devstack sudo[106773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:42 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-3ac64c8b-ed66-45eb-8d60-09856ae2caaa tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (52c8f78e-9cb2-4b47-a64f-54fbf05b60d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:42 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-3ac64c8b-ed66-45eb-8d60-09856ae2caaa tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dc8999e-7c47-4448-8fc4-2877abfbb027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:42 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-3ac64c8b-ed66-45eb-8d60-09856ae2caaa tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Volume 38e58d5e-b7c6-4840-b5ff-07fcca57efcc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38e58d5e-b7c6-4840-b5ff-07fcca57efcc', 'volume_size': 1} Sep 15 16:39:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-3ac64c8b-ed66-45eb-8d60-09856ae2caaa tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:39:42 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-ebe95170-67da-4cea-8eaa-860728845c5a tempest-CreateVolumesFromSnapshotTest-1571001215 None] Acquiring lock "cinder-0baf2c22-5800-4f57-b807-8c617efe3aa0-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:39:42 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-ebe95170-67da-4cea-8eaa-860728845c5a tempest-CreateVolumesFromSnapshotTest-1571001215 None] Lock "cinder-0baf2c22-5800-4f57-b807-8c617efe3aa0-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:39:42 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-ebe95170-67da-4cea-8eaa-860728845c5a tempest-CreateVolumesFromSnapshotTest-1571001215 None] Acquiring lock "cinder-quobyte-0baf2c22-5800-4f57-b807-8c617efe3aa0" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:39:42 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-ebe95170-67da-4cea-8eaa-860728845c5a tempest-CreateVolumesFromSnapshotTest-1571001215 None] Lock "cinder-quobyte-0baf2c22-5800-4f57-b807-8c617efe3aa0" acquired by "delete_volume" :: waited 0.038s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:39:42 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[5741fc85-2a4f-4b12-befa-112d7ba48dd2]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:39:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ebe95170-67da-4cea-8eaa-860728845c5a tempest-CreateVolumesFromSnapshotTest-1571001215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0baf2c22-5800-4f57-b807-8c617efe3aa0 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:42 devstack sudo[106773]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2c823bf9-5897-446e-93ee-022286f17e6e tempest-CreateVolumesFromSourceVolumeTest-983402188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-dcb07027-338e-49ed-b34a-1aeb25fb9a2f" returned: 0 in 0.535s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:42 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-2c823bf9-5897-446e-93ee-022286f17e6e tempest-CreateVolumesFromSourceVolumeTest-983402188 None] <== create_volume: return (1612ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:39:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-2c823bf9-5897-446e-93ee-022286f17e6e tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.615s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:39:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-8f01af2c-67fd-4b77-acb3-88ba4459a99c tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.971s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:39:42 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-8f01af2c-67fd-4b77-acb3-88ba4459a99c tempest-CreateVolumesFromSourceVolumeTest-983402188 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:39:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-561605000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52d8b18b-8f27-40d2-a0d7-0c9a47c0b1aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba3c09c85ceb4574b747022f8cd53fd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:39:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:39:41Z,use_quota=True,user_id='06128a4c927b419a936bd45b6c2749fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:39:42 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-8f01af2c-67fd-4b77-acb3-88ba4459a99c tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Creating volume 52d8b18b-8f27-40d2-a0d7-0c9a47c0b1aa {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:39:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-8f01af2c-67fd-4b77-acb3-88ba4459a99c tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:39:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-8f01af2c-67fd-4b77-acb3-88ba4459a99c tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:39:42 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-8f01af2c-67fd-4b77-acb3-88ba4459a99c tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:39:42 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-8f01af2c-67fd-4b77-acb3-88ba4459a99c tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:39:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-8f01af2c-67fd-4b77-acb3-88ba4459a99c tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:39:42 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-8f01af2c-67fd-4b77-acb3-88ba4459a99c tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:39:42 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-8f01af2c-67fd-4b77-acb3-88ba4459a99c tempest-CreateVolumesFromSourceVolumeTest-983402188 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:39:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8f01af2c-67fd-4b77-acb3-88ba4459a99c tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-52d8b18b-8f27-40d2-a0d7-0c9a47c0b1aa 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:42 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2c823bf9-5897-446e-93ee-022286f17e6e tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (535667fe-baf2-4c58-ab08-2798730598dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dcb07027-338e-49ed-b34a-1aeb25fb9a2f', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:42 devstack sudo[106777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-52d8b18b-8f27-40d2-a0d7-0c9a47c0b1aa 1073741824 Sep 15 16:39:42 devstack sudo[106777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:42 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2c823bf9-5897-446e-93ee-022286f17e6e tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dbd57ef-8930-4e79-9cc3-92ed958aa0e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:42 devstack sudo[106776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0baf2c22-5800-4f57-b807-8c617efe3aa0 Sep 15 16:39:42 devstack sudo[106776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:42 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e13b2a3-1df4-4bf4-bf53-74198afa3f69 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:39:43 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0e13b2a3-1df4-4bf4-bf53-74198afa3f69 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Flow 'volume_create_manager' (d883c0be-74cc-4cbe-8b09-42a6222ea3d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:39:43 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0e13b2a3-1df4-4bf4-bf53-74198afa3f69 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8e0b7c0-cd48-46da-9b1f-7dc58bdf9a54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:43 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-2c823bf9-5897-446e-93ee-022286f17e6e tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Volume volume-dcb07027-338e-49ed-b34a-1aeb25fb9a2f (dcb07027-338e-49ed-b34a-1aeb25fb9a2f): created successfully Sep 15 16:39:43 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2c823bf9-5897-446e-93ee-022286f17e6e tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dbd57ef-8930-4e79-9cc3-92ed958aa0e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:43 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2c823bf9-5897-446e-93ee-022286f17e6e tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Flow 'volume_create_manager' (3f459358-11b8-4426-82db-87ecf984fee9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:39:43 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0e13b2a3-1df4-4bf4-bf53-74198afa3f69 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8e0b7c0-cd48-46da-9b1f-7dc58bdf9a54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:39:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2024391631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6016525-7014-4e87-8698-1763864d7699,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba3c09c85ceb4574b747022f8cd53fd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:39:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:39:43Z,use_quota=True,user_id='06128a4c927b419a936bd45b6c2749fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:43 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0e13b2a3-1df4-4bf4-bf53-74198afa3f69 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55116b2a-b0b3-40cf-96bf-b6ec9c582682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:43 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0e13b2a3-1df4-4bf4-bf53-74198afa3f69 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (55116b2a-b0b3-40cf-96bf-b6ec9c582682) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:43 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0e13b2a3-1df4-4bf4-bf53-74198afa3f69 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aeb79a63-ac1a-43e3-a928-8d1ea818bcb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:43 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0e13b2a3-1df4-4bf4-bf53-74198afa3f69 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aeb79a63-ac1a-43e3-a928-8d1ea818bcb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e6016525-7014-4e87-8698-1763864d7699', 'volume_name': 'volume-e6016525-7014-4e87-8698-1763864d7699', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:43 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0e13b2a3-1df4-4bf4-bf53-74198afa3f69 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (374e9dbb-766a-4cc9-beb3-9d851696aa23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:43 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0e13b2a3-1df4-4bf4-bf53-74198afa3f69 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (374e9dbb-766a-4cc9-beb3-9d851696aa23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:43 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0e13b2a3-1df4-4bf4-bf53-74198afa3f69 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (770f5086-2fc5-4e8d-8181-62dba3d63aa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:43 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-0e13b2a3-1df4-4bf4-bf53-74198afa3f69 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Volume e6016525-7014-4e87-8698-1763864d7699: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e6016525-7014-4e87-8698-1763864d7699', 'volume_size': 1} Sep 15 16:39:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-0e13b2a3-1df4-4bf4-bf53-74198afa3f69 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:39:43 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-2c823bf9-5897-446e-93ee-022286f17e6e tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Created volume successfully. Sep 15 16:39:43 devstack sudo[106776]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ebe95170-67da-4cea-8eaa-860728845c5a tempest-CreateVolumesFromSnapshotTest-1571001215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0baf2c22-5800-4f57-b807-8c617efe3aa0" returned: 0 in 0.758s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ebe95170-67da-4cea-8eaa-860728845c5a tempest-CreateVolumesFromSnapshotTest-1571001215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0baf2c22-5800-4f57-b807-8c617efe3aa0 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:43 devstack sudo[106786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0baf2c22-5800-4f57-b807-8c617efe3aa0 Sep 15 16:39:43 devstack sudo[106786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:43 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-decb911d-99bc-433d-9e72-47b47338c575 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:39:43 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-decb911d-99bc-433d-9e72-47b47338c575 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Flow 'volume_create_manager' (5b03f70d-5e29-404c-8a67-e082a29f0096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:39:43 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-decb911d-99bc-433d-9e72-47b47338c575 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b33c06a-021d-4beb-b1cd-62846991b5ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:43 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-decb911d-99bc-433d-9e72-47b47338c575 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b33c06a-021d-4beb-b1cd-62846991b5ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:39:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1001036950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c395f8e7-ea7f-43c2-948a-a370e0ca842c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba3c09c85ceb4574b747022f8cd53fd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:39:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:39:43Z,use_quota=True,user_id='06128a4c927b419a936bd45b6c2749fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:43 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-decb911d-99bc-433d-9e72-47b47338c575 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b57121a-d43b-46e0-894e-6aa18ad3ec72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:43 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-decb911d-99bc-433d-9e72-47b47338c575 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b57121a-d43b-46e0-894e-6aa18ad3ec72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:43 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-decb911d-99bc-433d-9e72-47b47338c575 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f239d7f-a21c-4c4c-8aa0-34549a029e17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:43 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-decb911d-99bc-433d-9e72-47b47338c575 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8f239d7f-a21c-4c4c-8aa0-34549a029e17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c395f8e7-ea7f-43c2-948a-a370e0ca842c', 'volume_name': 'volume-c395f8e7-ea7f-43c2-948a-a370e0ca842c', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:43 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-decb911d-99bc-433d-9e72-47b47338c575 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f53a697-3605-4efd-a9b6-00451d16e01a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:43 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-decb911d-99bc-433d-9e72-47b47338c575 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f53a697-3605-4efd-a9b6-00451d16e01a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:43 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-decb911d-99bc-433d-9e72-47b47338c575 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0b0f287-ff14-4e72-bb12-dd55c1997565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:43 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-decb911d-99bc-433d-9e72-47b47338c575 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Volume c395f8e7-ea7f-43c2-948a-a370e0ca842c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c395f8e7-ea7f-43c2-948a-a370e0ca842c', 'volume_size': 1} Sep 15 16:39:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-decb911d-99bc-433d-9e72-47b47338c575 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:39:43 devstack sudo[106777]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8f01af2c-67fd-4b77-acb3-88ba4459a99c tempest-CreateVolumesFromSourceVolumeTest-983402188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-52d8b18b-8f27-40d2-a0d7-0c9a47c0b1aa 1073741824" returned: 0 in 0.953s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8f01af2c-67fd-4b77-acb3-88ba4459a99c tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-52d8b18b-8f27-40d2-a0d7-0c9a47c0b1aa {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:43 devstack sudo[106789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-52d8b18b-8f27-40d2-a0d7-0c9a47c0b1aa Sep 15 16:39:43 devstack sudo[106789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:43 devstack sudo[106786]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ebe95170-67da-4cea-8eaa-860728845c5a tempest-CreateVolumesFromSnapshotTest-1571001215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0baf2c22-5800-4f57-b807-8c617efe3aa0" returned: 0 in 0.412s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:43 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-ebe95170-67da-4cea-8eaa-860728845c5a tempest-CreateVolumesFromSnapshotTest-1571001215 None] Lock "cinder-quobyte-0baf2c22-5800-4f57-b807-8c617efe3aa0" released by "delete_volume" :: held 1.244s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:39:43 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-ebe95170-67da-4cea-8eaa-860728845c5a tempest-CreateVolumesFromSnapshotTest-1571001215 None] Created reservations ['5c049626-166f-4b4b-966b-077a2a98a625', 'ef4258c1-eab7-4c30-95e4-691609f10c6f', '7900258e-f420-4adf-86e2-f2511118b734', 'a6b991fe-3b70-4265-86e7-afa970bc6674'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:39:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-ebe95170-67da-4cea-8eaa-860728845c5a tempest-CreateVolumesFromSnapshotTest-1571001215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:39:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-ebe95170-67da-4cea-8eaa-860728845c5a tempest-CreateVolumesFromSnapshotTest-1571001215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:39:44 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-ebe95170-67da-4cea-8eaa-860728845c5a tempest-CreateVolumesFromSnapshotTest-1571001215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:39:44 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-ebe95170-67da-4cea-8eaa-860728845c5a tempest-CreateVolumesFromSnapshotTest-1571001215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:39:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-ebe95170-67da-4cea-8eaa-860728845c5a tempest-CreateVolumesFromSnapshotTest-1571001215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:39:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ebe95170-67da-4cea-8eaa-860728845c5a tempest-CreateVolumesFromSnapshotTest-1571001215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:44 devstack sudo[106791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:39:44 devstack sudo[106791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:44 devstack sudo[106789]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8f01af2c-67fd-4b77-acb3-88ba4459a99c tempest-CreateVolumesFromSourceVolumeTest-983402188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-52d8b18b-8f27-40d2-a0d7-0c9a47c0b1aa" returned: 0 in 0.336s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:44 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-8f01af2c-67fd-4b77-acb3-88ba4459a99c tempest-CreateVolumesFromSourceVolumeTest-983402188 None] <== create_volume: return (1365ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:39:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-8f01af2c-67fd-4b77-acb3-88ba4459a99c tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.369s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:39:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-3ac64c8b-ed66-45eb-8d60-09856ae2caaa tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.853s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:39:44 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-3ac64c8b-ed66-45eb-8d60-09856ae2caaa tempest-CreateVolumesFromSourceVolumeTest-983402188 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:39:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-449424727',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38e58d5e-b7c6-4840-b5ff-07fcca57efcc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba3c09c85ceb4574b747022f8cd53fd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:39:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:39:42Z,use_quota=True,user_id='06128a4c927b419a936bd45b6c2749fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:39:44 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-3ac64c8b-ed66-45eb-8d60-09856ae2caaa tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Creating volume 38e58d5e-b7c6-4840-b5ff-07fcca57efcc {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:39:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-3ac64c8b-ed66-45eb-8d60-09856ae2caaa tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:39:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-3ac64c8b-ed66-45eb-8d60-09856ae2caaa tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:39:44 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-3ac64c8b-ed66-45eb-8d60-09856ae2caaa tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:39:44 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-3ac64c8b-ed66-45eb-8d60-09856ae2caaa tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:39:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-3ac64c8b-ed66-45eb-8d60-09856ae2caaa tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:39:44 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-3ac64c8b-ed66-45eb-8d60-09856ae2caaa tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:39:44 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-3ac64c8b-ed66-45eb-8d60-09856ae2caaa tempest-CreateVolumesFromSourceVolumeTest-983402188 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:39:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3ac64c8b-ed66-45eb-8d60-09856ae2caaa tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-38e58d5e-b7c6-4840-b5ff-07fcca57efcc 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:44 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8f01af2c-67fd-4b77-acb3-88ba4459a99c tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e8be3df-2ee8-4ceb-b137-2677fc5fd0dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52d8b18b-8f27-40d2-a0d7-0c9a47c0b1aa', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:44 devstack sudo[106794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-38e58d5e-b7c6-4840-b5ff-07fcca57efcc 1073741824 Sep 15 16:39:44 devstack sudo[106794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:44 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8f01af2c-67fd-4b77-acb3-88ba4459a99c tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1a80c01-f260-4aac-9daf-159425c865ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:44 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-8f01af2c-67fd-4b77-acb3-88ba4459a99c tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Volume volume-52d8b18b-8f27-40d2-a0d7-0c9a47c0b1aa (52d8b18b-8f27-40d2-a0d7-0c9a47c0b1aa): created successfully Sep 15 16:39:44 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8f01af2c-67fd-4b77-acb3-88ba4459a99c tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1a80c01-f260-4aac-9daf-159425c865ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:44 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-8f01af2c-67fd-4b77-acb3-88ba4459a99c tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Flow 'volume_create_manager' (e64d5fa4-9824-4942-b44b-4c687974c4e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:39:44 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-8f01af2c-67fd-4b77-acb3-88ba4459a99c tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Created volume successfully. Sep 15 16:39:44 devstack sudo[106791]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ebe95170-67da-4cea-8eaa-860728845c5a tempest-CreateVolumesFromSnapshotTest-1571001215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.307s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:44 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-ebe95170-67da-4cea-8eaa-860728845c5a tempest-CreateVolumesFromSnapshotTest-1571001215 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:39:44 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-ebe95170-67da-4cea-8eaa-860728845c5a tempest-CreateVolumesFromSnapshotTest-1571001215 None] Deleted volume successfully. Sep 15 16:39:44 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-ebe95170-67da-4cea-8eaa-860728845c5a tempest-CreateVolumesFromSnapshotTest-1571001215 None] Lock "cinder-0baf2c22-5800-4f57-b807-8c617efe3aa0-delete_volume" released by "delete_volume" :: held 1.888s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:39:44 devstack sudo[106794]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3ac64c8b-ed66-45eb-8d60-09856ae2caaa tempest-CreateVolumesFromSourceVolumeTest-983402188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-38e58d5e-b7c6-4840-b5ff-07fcca57efcc 1073741824" returned: 0 in 0.631s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:44 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-2258c2e2-2478-4ac8-a3df-2eadc4963c1a tempest-CreateVolumesFromSnapshotTest-1571001215 None] Acquiring lock "cinder-a237a739-6776-40e3-8aa2-32ca306393c3-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:39:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3ac64c8b-ed66-45eb-8d60-09856ae2caaa tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-38e58d5e-b7c6-4840-b5ff-07fcca57efcc {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:44 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-2258c2e2-2478-4ac8-a3df-2eadc4963c1a tempest-CreateVolumesFromSnapshotTest-1571001215 None] Lock "cinder-a237a739-6776-40e3-8aa2-32ca306393c3-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:39:44 devstack sudo[106800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-38e58d5e-b7c6-4840-b5ff-07fcca57efcc Sep 15 16:39:44 devstack sudo[106800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:44 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-2258c2e2-2478-4ac8-a3df-2eadc4963c1a tempest-CreateVolumesFromSnapshotTest-1571001215 None] Acquiring lock "cinder-quobyte-a237a739-6776-40e3-8aa2-32ca306393c3" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:39:44 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-2258c2e2-2478-4ac8-a3df-2eadc4963c1a tempest-CreateVolumesFromSnapshotTest-1571001215 None] Lock "cinder-quobyte-a237a739-6776-40e3-8aa2-32ca306393c3" acquired by "delete_volume" :: waited 0.017s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:39:44 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae4002c7-ccf9-4457-8dd5-48904b68f4de]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:39:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2258c2e2-2478-4ac8-a3df-2eadc4963c1a tempest-CreateVolumesFromSnapshotTest-1571001215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a237a739-6776-40e3-8aa2-32ca306393c3 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:45 devstack sudo[106802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a237a739-6776-40e3-8aa2-32ca306393c3 Sep 15 16:39:45 devstack sudo[106802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3ac64c8b-ed66-45eb-8d60-09856ae2caaa tempest-CreateVolumesFromSourceVolumeTest-983402188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-38e58d5e-b7c6-4840-b5ff-07fcca57efcc" returned: 0 in 0.317s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:45 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-3ac64c8b-ed66-45eb-8d60-09856ae2caaa tempest-CreateVolumesFromSourceVolumeTest-983402188 None] <== create_volume: return (1012ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:39:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-3ac64c8b-ed66-45eb-8d60-09856ae2caaa tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.020s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:39:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-0e13b2a3-1df4-4bf4-bf53-74198afa3f69 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.061s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:39:45 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-0e13b2a3-1df4-4bf4-bf53-74198afa3f69 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:39:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2024391631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e6016525-7014-4e87-8698-1763864d7699,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba3c09c85ceb4574b747022f8cd53fd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:39:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:39:43Z,use_quota=True,user_id='06128a4c927b419a936bd45b6c2749fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:39:45 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-0e13b2a3-1df4-4bf4-bf53-74198afa3f69 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Creating volume e6016525-7014-4e87-8698-1763864d7699 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:39:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-0e13b2a3-1df4-4bf4-bf53-74198afa3f69 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:39:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-0e13b2a3-1df4-4bf4-bf53-74198afa3f69 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:39:45 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-0e13b2a3-1df4-4bf4-bf53-74198afa3f69 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:39:45 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-0e13b2a3-1df4-4bf4-bf53-74198afa3f69 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:39:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-0e13b2a3-1df4-4bf4-bf53-74198afa3f69 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:39:45 devstack sudo[106800]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:45 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-0e13b2a3-1df4-4bf4-bf53-74198afa3f69 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:39:45 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-0e13b2a3-1df4-4bf4-bf53-74198afa3f69 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:39:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0e13b2a3-1df4-4bf4-bf53-74198afa3f69 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-e6016525-7014-4e87-8698-1763864d7699 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:45 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-3ac64c8b-ed66-45eb-8d60-09856ae2caaa tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dc8999e-7c47-4448-8fc4-2877abfbb027) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38e58d5e-b7c6-4840-b5ff-07fcca57efcc', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:45 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-3ac64c8b-ed66-45eb-8d60-09856ae2caaa tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b1bcbd9-e9b6-4d6c-85e3-3dfa450f755e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:45 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-3ac64c8b-ed66-45eb-8d60-09856ae2caaa tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Volume volume-38e58d5e-b7c6-4840-b5ff-07fcca57efcc (38e58d5e-b7c6-4840-b5ff-07fcca57efcc): created successfully Sep 15 16:39:45 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-3ac64c8b-ed66-45eb-8d60-09856ae2caaa tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b1bcbd9-e9b6-4d6c-85e3-3dfa450f755e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:45 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-3ac64c8b-ed66-45eb-8d60-09856ae2caaa tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Flow 'volume_create_manager' (003018b6-7461-4176-b6ea-c07d529c7387) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:39:45 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-3ac64c8b-ed66-45eb-8d60-09856ae2caaa tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Created volume successfully. Sep 15 16:39:45 devstack sudo[106806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-e6016525-7014-4e87-8698-1763864d7699 1073741824 Sep 15 16:39:45 devstack sudo[106806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:45 devstack sudo[106802]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2258c2e2-2478-4ac8-a3df-2eadc4963c1a tempest-CreateVolumesFromSnapshotTest-1571001215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a237a739-6776-40e3-8aa2-32ca306393c3" returned: 0 in 0.625s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2258c2e2-2478-4ac8-a3df-2eadc4963c1a tempest-CreateVolumesFromSnapshotTest-1571001215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a237a739-6776-40e3-8aa2-32ca306393c3 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:45 devstack sudo[106815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a237a739-6776-40e3-8aa2-32ca306393c3 Sep 15 16:39:45 devstack sudo[106815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:45 devstack sudo[106806]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0e13b2a3-1df4-4bf4-bf53-74198afa3f69 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-e6016525-7014-4e87-8698-1763864d7699 1073741824" returned: 0 in 0.722s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:45 devstack sudo[106815]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2258c2e2-2478-4ac8-a3df-2eadc4963c1a tempest-CreateVolumesFromSnapshotTest-1571001215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-a237a739-6776-40e3-8aa2-32ca306393c3" returned: 0 in 0.341s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:45 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-2258c2e2-2478-4ac8-a3df-2eadc4963c1a tempest-CreateVolumesFromSnapshotTest-1571001215 None] Lock "cinder-quobyte-a237a739-6776-40e3-8aa2-32ca306393c3" released by "delete_volume" :: held 1.039s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:39:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0e13b2a3-1df4-4bf4-bf53-74198afa3f69 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-e6016525-7014-4e87-8698-1763864d7699 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:46 devstack sudo[106820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-e6016525-7014-4e87-8698-1763864d7699 Sep 15 16:39:46 devstack sudo[106820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:46 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-2258c2e2-2478-4ac8-a3df-2eadc4963c1a tempest-CreateVolumesFromSnapshotTest-1571001215 None] Created reservations ['f87b93ba-426d-43f9-8c8a-73dbf8569d32', '522f5a83-c55c-4484-8a80-2d773e5e935f', '47ad3770-c746-4fe0-ae50-3bc1ab1867b5', 'dace9c34-88f1-4930-bf74-782d72cbd64f'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:39:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-2258c2e2-2478-4ac8-a3df-2eadc4963c1a tempest-CreateVolumesFromSnapshotTest-1571001215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:39:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-2258c2e2-2478-4ac8-a3df-2eadc4963c1a tempest-CreateVolumesFromSnapshotTest-1571001215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:39:46 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-2258c2e2-2478-4ac8-a3df-2eadc4963c1a tempest-CreateVolumesFromSnapshotTest-1571001215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:39:46 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-2258c2e2-2478-4ac8-a3df-2eadc4963c1a tempest-CreateVolumesFromSnapshotTest-1571001215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:39:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-2258c2e2-2478-4ac8-a3df-2eadc4963c1a tempest-CreateVolumesFromSnapshotTest-1571001215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:39:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2258c2e2-2478-4ac8-a3df-2eadc4963c1a tempest-CreateVolumesFromSnapshotTest-1571001215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:46 devstack sudo[106822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:39:46 devstack sudo[106822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:46 devstack sudo[106820]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0e13b2a3-1df4-4bf4-bf53-74198afa3f69 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-e6016525-7014-4e87-8698-1763864d7699" returned: 0 in 0.371s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:46 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-0e13b2a3-1df4-4bf4-bf53-74198afa3f69 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] <== create_volume: return (1201ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:39:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-0e13b2a3-1df4-4bf4-bf53-74198afa3f69 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.204s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:39:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-decb911d-99bc-433d-9e72-47b47338c575 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.720s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:39:46 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-decb911d-99bc-433d-9e72-47b47338c575 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:39:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1001036950',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c395f8e7-ea7f-43c2-948a-a370e0ca842c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ba3c09c85ceb4574b747022f8cd53fd4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:39:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:39:43Z,use_quota=True,user_id='06128a4c927b419a936bd45b6c2749fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:39:46 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-decb911d-99bc-433d-9e72-47b47338c575 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Creating volume c395f8e7-ea7f-43c2-948a-a370e0ca842c {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:39:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-decb911d-99bc-433d-9e72-47b47338c575 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:39:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-decb911d-99bc-433d-9e72-47b47338c575 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:39:46 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-decb911d-99bc-433d-9e72-47b47338c575 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:39:46 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-decb911d-99bc-433d-9e72-47b47338c575 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:39:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-decb911d-99bc-433d-9e72-47b47338c575 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:39:46 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-decb911d-99bc-433d-9e72-47b47338c575 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:39:46 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-decb911d-99bc-433d-9e72-47b47338c575 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:39:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-decb911d-99bc-433d-9e72-47b47338c575 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c395f8e7-ea7f-43c2-948a-a370e0ca842c 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:46 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0e13b2a3-1df4-4bf4-bf53-74198afa3f69 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (770f5086-2fc5-4e8d-8181-62dba3d63aa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e6016525-7014-4e87-8698-1763864d7699', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:46 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0e13b2a3-1df4-4bf4-bf53-74198afa3f69 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (133dccf0-1eac-425e-8f49-7cf313a709b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:46 devstack sudo[106826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c395f8e7-ea7f-43c2-948a-a370e0ca842c 1073741824 Sep 15 16:39:46 devstack sudo[106822]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:46 devstack sudo[106826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2258c2e2-2478-4ac8-a3df-2eadc4963c1a tempest-CreateVolumesFromSnapshotTest-1571001215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.300s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:46 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-2258c2e2-2478-4ac8-a3df-2eadc4963c1a tempest-CreateVolumesFromSnapshotTest-1571001215 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:39:46 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-2258c2e2-2478-4ac8-a3df-2eadc4963c1a tempest-CreateVolumesFromSnapshotTest-1571001215 None] Deleted volume successfully. Sep 15 16:39:46 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-0e13b2a3-1df4-4bf4-bf53-74198afa3f69 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Volume volume-e6016525-7014-4e87-8698-1763864d7699 (e6016525-7014-4e87-8698-1763864d7699): created successfully Sep 15 16:39:46 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0e13b2a3-1df4-4bf4-bf53-74198afa3f69 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (133dccf0-1eac-425e-8f49-7cf313a709b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:46 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0e13b2a3-1df4-4bf4-bf53-74198afa3f69 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Flow 'volume_create_manager' (d883c0be-74cc-4cbe-8b09-42a6222ea3d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:39:46 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-0e13b2a3-1df4-4bf4-bf53-74198afa3f69 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Created volume successfully. Sep 15 16:39:46 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-2258c2e2-2478-4ac8-a3df-2eadc4963c1a tempest-CreateVolumesFromSnapshotTest-1571001215 None] Lock "cinder-a237a739-6776-40e3-8aa2-32ca306393c3-delete_volume" released by "delete_volume" :: held 1.648s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:39:46 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-e36a6cd0-b7de-4132-a59b-dac085ffb7e9 tempest-VolumeImageDependencyTests-1330175006 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:39:46 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e36a6cd0-b7de-4132-a59b-dac085ffb7e9 tempest-VolumeImageDependencyTests-1330175006 None] Flow 'volume_create_manager' (f6c1ddae-4846-4567-a458-9e6f5c1c1d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:39:46 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e36a6cd0-b7de-4132-a59b-dac085ffb7e9 tempest-VolumeImageDependencyTests-1330175006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15134d04-7543-4372-b704-ffe904aaabb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:46 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e36a6cd0-b7de-4132-a59b-dac085ffb7e9 tempest-VolumeImageDependencyTests-1330175006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15134d04-7543-4372-b704-ffe904aaabb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:39:46Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd20a52d-6aea-4c91-b49a-38810b893b33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fe50c751b4e4643b9098a315e25c260',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:39:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:39:47Z,use_quota=True,user_id='1307d2b3e82b4f5790129e42a037a1c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:46 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e36a6cd0-b7de-4132-a59b-dac085ffb7e9 tempest-VolumeImageDependencyTests-1330175006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e045c51e-72fe-4f3c-be3b-ca50412a9339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:46 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e36a6cd0-b7de-4132-a59b-dac085ffb7e9 tempest-VolumeImageDependencyTests-1330175006 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e045c51e-72fe-4f3c-be3b-ca50412a9339) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:46 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e36a6cd0-b7de-4132-a59b-dac085ffb7e9 tempest-VolumeImageDependencyTests-1330175006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f921c7ad-f73f-4504-af2b-ac235796f26b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:46 devstack cinder-volume[86082]: DEBUG cinder.image.glance [None req-e36a6cd0-b7de-4132-a59b-dac085ffb7e9 tempest-VolumeImageDependencyTests-1330175006 None] Creating Keystone auth plugin from conf {{(pid=86082) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 15 16:39:46 devstack sudo[106826]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-decb911d-99bc-433d-9e72-47b47338c575 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c395f8e7-ea7f-43c2-948a-a370e0ca842c 1073741824" returned: 0 in 0.544s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-decb911d-99bc-433d-9e72-47b47338c575 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c395f8e7-ea7f-43c2-948a-a370e0ca842c {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:47 devstack sudo[106832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c395f8e7-ea7f-43c2-948a-a370e0ca842c Sep 15 16:39:47 devstack sudo[106832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:47 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e36a6cd0-b7de-4132-a59b-dac085ffb7e9 tempest-VolumeImageDependencyTests-1330175006 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f921c7ad-f73f-4504-af2b-ac235796f26b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'dd20a52d-6aea-4c91-b49a-38810b893b33', 'volume_name': 'volume-dd20a52d-6aea-4c91-b49a-38810b893b33', 'volume_size': 1, 'image_id': '856c23cc-fd1f-496c-8f4a-e4fef2734eca', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/856c23cc-fd1f-496c-8f4a-e4fef2734eca', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5b5009225d15dc7663663d766d8a4d2f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8fe50c751b4e4643b9098a315e25c260', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '527ee3071e583a0e8fde748d77c5e2dc50aa6ca0ed1addb2463222caaab96366ce64e84223197c29158ed8e3af80b238f98ba6fd0559f36dc5864aa9221f9d85', 'id': '856c23cc-fd1f-496c-8f4a-e4fef2734eca', 'created_at': datetime.datetime(2026, 9, 15, 14, 39, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 15, 14, 39, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/856c23cc-fd1f-496c-8f4a-e4fef2734eca/file', 'properties': {}}, 'image_service': }' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:47 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e36a6cd0-b7de-4132-a59b-dac085ffb7e9 tempest-VolumeImageDependencyTests-1330175006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a58a61c9-f0f3-49ee-b0f4-d1b7a0eafb08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:47 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e36a6cd0-b7de-4132-a59b-dac085ffb7e9 tempest-VolumeImageDependencyTests-1330175006 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a58a61c9-f0f3-49ee-b0f4-d1b7a0eafb08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:47 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e36a6cd0-b7de-4132-a59b-dac085ffb7e9 tempest-VolumeImageDependencyTests-1330175006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e382bcaf-5f23-4e9d-a986-cc7ea6dd7f4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:47 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-e36a6cd0-b7de-4132-a59b-dac085ffb7e9 tempest-VolumeImageDependencyTests-1330175006 None] Volume dd20a52d-6aea-4c91-b49a-38810b893b33: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-dd20a52d-6aea-4c91-b49a-38810b893b33', 'volume_size': 1, 'image_id': '856c23cc-fd1f-496c-8f4a-e4fef2734eca', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/856c23cc-fd1f-496c-8f4a-e4fef2734eca', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5b5009225d15dc7663663d766d8a4d2f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8fe50c751b4e4643b9098a315e25c260', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '527ee3071e583a0e8fde748d77c5e2dc50aa6ca0ed1addb2463222caaab96366ce64e84223197c29158ed8e3af80b238f98ba6fd0559f36dc5864aa9221f9d85', 'id': '856c23cc-fd1f-496c-8f4a-e4fef2734eca', 'created_at': datetime.datetime(2026, 9, 15, 14, 39, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 15, 14, 39, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/856c23cc-fd1f-496c-8f4a-e4fef2734eca/file', 'properties': {}}, 'image_service': } Sep 15 16:39:47 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-e36a6cd0-b7de-4132-a59b-dac085ffb7e9 tempest-VolumeImageDependencyTests-1330175006 None] Trying to clone dd20a52d-6aea-4c91-b49a-38810b893b33 from image 856c23cc-fd1f-496c-8f4a-e4fef2734eca at location (None, [{'url': 'file:///opt/stack/data/glance/images/856c23cc-fd1f-496c-8f4a-e4fef2734eca', 'metadata': {}}]). {{(pid=86082) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 15 16:39:47 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-a4bf6cca-04a3-42c8-ac25-ddac1fdcf8d9 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Acquiring lock "cinder-c4148e89-fa2d-4231-a905-c97281596730-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:39:47 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-a4bf6cca-04a3-42c8-ac25-ddac1fdcf8d9 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Lock "cinder-c4148e89-fa2d-4231-a905-c97281596730-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:39:47 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-e36a6cd0-b7de-4132-a59b-dac085ffb7e9 tempest-VolumeImageDependencyTests-1330175006 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_856c23cc-fd1f-496c-8f4a-e4fef2734eca_ovmp10ogdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86082) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 15 16:39:47 devstack cinder-volume[86082]: INFO cinder.image.image_utils [None req-e36a6cd0-b7de-4132-a59b-dac085ffb7e9 tempest-VolumeImageDependencyTests-1330175006 None] Image download 0.00 MB at 0.00 MB/s Sep 15 16:39:47 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-a4bf6cca-04a3-42c8-ac25-ddac1fdcf8d9 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Acquiring lock "cinder-quobyte-c4148e89-fa2d-4231-a905-c97281596730" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:39:47 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-96def75f-61df-40d5-8352-2ecfb5922fca tempest-ProjectMemberTests-1855156353 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:39:47 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-96def75f-61df-40d5-8352-2ecfb5922fca tempest-ProjectMemberTests-1855156353 None] Flow 'volume_create_manager' (3cffdad9-bba5-46f8-b477-dc9bf37dc9e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:39:47 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-96def75f-61df-40d5-8352-2ecfb5922fca tempest-ProjectMemberTests-1855156353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c802e045-1814-4309-b1cd-62e2fbdd3555) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:47 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-a4bf6cca-04a3-42c8-ac25-ddac1fdcf8d9 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Lock "cinder-quobyte-c4148e89-fa2d-4231-a905-c97281596730" acquired by "delete_volume" :: waited 0.058s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:39:47 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-96def75f-61df-40d5-8352-2ecfb5922fca tempest-ProjectMemberTests-1855156353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c802e045-1814-4309-b1cd-62e2fbdd3555) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:39:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-597838521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=514b91ee-3704-4a6a-ac97-8e89377f675e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a303ec1076004f4db43523c2f7b6a446',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:39:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:39:47Z,use_quota=True,user_id='d9953555b80c481b9eaabbc7d416d0b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:47 devstack sudo[106832]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:47 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-96def75f-61df-40d5-8352-2ecfb5922fca tempest-ProjectMemberTests-1855156353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (375e8c7f-cc5c-4e1d-8953-f55ead296f39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:47 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-96def75f-61df-40d5-8352-2ecfb5922fca tempest-ProjectMemberTests-1855156353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (375e8c7f-cc5c-4e1d-8953-f55ead296f39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:47 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-96def75f-61df-40d5-8352-2ecfb5922fca tempest-ProjectMemberTests-1855156353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5781f52-5982-42da-9041-f35ac196c07f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:47 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-96def75f-61df-40d5-8352-2ecfb5922fca tempest-ProjectMemberTests-1855156353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5781f52-5982-42da-9041-f35ac196c07f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '514b91ee-3704-4a6a-ac97-8e89377f675e', 'volume_name': 'volume-514b91ee-3704-4a6a-ac97-8e89377f675e', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:47 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-96def75f-61df-40d5-8352-2ecfb5922fca tempest-ProjectMemberTests-1855156353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d7f48c2-d22b-4ca7-a8c0-26ca4a33b5f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:47 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-96def75f-61df-40d5-8352-2ecfb5922fca tempest-ProjectMemberTests-1855156353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d7f48c2-d22b-4ca7-a8c0-26ca4a33b5f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:47 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-96def75f-61df-40d5-8352-2ecfb5922fca tempest-ProjectMemberTests-1855156353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff8add8b-f64b-45de-a3cb-4f8e6f9fe468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:47 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-96def75f-61df-40d5-8352-2ecfb5922fca tempest-ProjectMemberTests-1855156353 None] Volume 514b91ee-3704-4a6a-ac97-8e89377f675e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-514b91ee-3704-4a6a-ac97-8e89377f675e', 'volume_size': 1} Sep 15 16:39:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-96def75f-61df-40d5-8352-2ecfb5922fca tempest-ProjectMemberTests-1855156353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:39:47 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cd0a121-7ddc-4df8-8bbc-ca984334d538]: (4, 'raw') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:39:47 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d54563b-2621-4b40-a916-94b3f1596cd1]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:39:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e36a6cd0-b7de-4132-a59b-dac085ffb7e9 tempest-VolumeImageDependencyTests-1330175006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_856c23cc-fd1f-496c-8f4a-e4fef2734eca_ovmp10ogdevstack@QuobyteHD {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a4bf6cca-04a3-42c8-ac25-ddac1fdcf8d9 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c4148e89-fa2d-4231-a905-c97281596730 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-decb911d-99bc-433d-9e72-47b47338c575 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c395f8e7-ea7f-43c2-948a-a370e0ca842c" returned: 0 in 0.415s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:47 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-decb911d-99bc-433d-9e72-47b47338c575 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] <== create_volume: return (1014ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:39:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-decb911d-99bc-433d-9e72-47b47338c575 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.018s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:39:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-96def75f-61df-40d5-8352-2ecfb5922fca tempest-ProjectMemberTests-1855156353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.037s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:39:47 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-96def75f-61df-40d5-8352-2ecfb5922fca tempest-ProjectMemberTests-1855156353 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:39:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-597838521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=514b91ee-3704-4a6a-ac97-8e89377f675e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a303ec1076004f4db43523c2f7b6a446',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:39:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:39:47Z,use_quota=True,user_id='d9953555b80c481b9eaabbc7d416d0b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:39:47 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-96def75f-61df-40d5-8352-2ecfb5922fca tempest-ProjectMemberTests-1855156353 None] Creating volume 514b91ee-3704-4a6a-ac97-8e89377f675e {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:39:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-96def75f-61df-40d5-8352-2ecfb5922fca tempest-ProjectMemberTests-1855156353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:39:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-96def75f-61df-40d5-8352-2ecfb5922fca tempest-ProjectMemberTests-1855156353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:39:47 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-96def75f-61df-40d5-8352-2ecfb5922fca tempest-ProjectMemberTests-1855156353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:39:47 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-96def75f-61df-40d5-8352-2ecfb5922fca tempest-ProjectMemberTests-1855156353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:39:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-96def75f-61df-40d5-8352-2ecfb5922fca tempest-ProjectMemberTests-1855156353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:39:47 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-96def75f-61df-40d5-8352-2ecfb5922fca tempest-ProjectMemberTests-1855156353 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:39:47 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-96def75f-61df-40d5-8352-2ecfb5922fca tempest-ProjectMemberTests-1855156353 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:39:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-96def75f-61df-40d5-8352-2ecfb5922fca tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-514b91ee-3704-4a6a-ac97-8e89377f675e 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:47 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-decb911d-99bc-433d-9e72-47b47338c575 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0b0f287-ff14-4e72-bb12-dd55c1997565) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c395f8e7-ea7f-43c2-948a-a370e0ca842c', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:47 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-decb911d-99bc-433d-9e72-47b47338c575 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e086574-7d0d-4420-9818-d5d9408afe9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:47 devstack sudo[106838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-514b91ee-3704-4a6a-ac97-8e89377f675e 1073741824 Sep 15 16:39:47 devstack sudo[106838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:47 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-decb911d-99bc-433d-9e72-47b47338c575 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Volume volume-c395f8e7-ea7f-43c2-948a-a370e0ca842c (c395f8e7-ea7f-43c2-948a-a370e0ca842c): created successfully Sep 15 16:39:47 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-decb911d-99bc-433d-9e72-47b47338c575 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1e086574-7d0d-4420-9818-d5d9408afe9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:47 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-decb911d-99bc-433d-9e72-47b47338c575 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Flow 'volume_create_manager' (5b03f70d-5e29-404c-8a67-e082a29f0096) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:39:47 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-decb911d-99bc-433d-9e72-47b47338c575 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Created volume successfully. Sep 15 16:39:47 devstack sudo[106836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_856c23cc-fd1f-496c-8f4a-e4fef2734eca_ovmp10ogdevstack@QuobyteHD Sep 15 16:39:47 devstack sudo[106836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:47 devstack sudo[106837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c4148e89-fa2d-4231-a905-c97281596730 Sep 15 16:39:47 devstack sudo[106837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:47 devstack sudo[106836]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e36a6cd0-b7de-4132-a59b-dac085ffb7e9 tempest-VolumeImageDependencyTests-1330175006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_856c23cc-fd1f-496c-8f4a-e4fef2734eca_ovmp10ogdevstack@QuobyteHD" returned: 0 in 0.371s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e36a6cd0-b7de-4132-a59b-dac085ffb7e9 tempest-VolumeImageDependencyTests-1330175006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_856c23cc-fd1f-496c-8f4a-e4fef2734eca_ovmp10ogdevstack@QuobyteHD {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:47 devstack sudo[106837]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a4bf6cca-04a3-42c8-ac25-ddac1fdcf8d9 tempest-CreateVolumesFromSnapshotTest-1571001215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c4148e89-fa2d-4231-a905-c97281596730" returned: 0 in 0.384s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a4bf6cca-04a3-42c8-ac25-ddac1fdcf8d9 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c4148e89-fa2d-4231-a905-c97281596730 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:47 devstack sudo[106852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c4148e89-fa2d-4231-a905-c97281596730 Sep 15 16:39:47 devstack sudo[106852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:47 devstack sudo[106851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_856c23cc-fd1f-496c-8f4a-e4fef2734eca_ovmp10ogdevstack@QuobyteHD Sep 15 16:39:47 devstack sudo[106851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:47 devstack sudo[106838]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-96def75f-61df-40d5-8352-2ecfb5922fca tempest-ProjectMemberTests-1855156353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-514b91ee-3704-4a6a-ac97-8e89377f675e 1073741824" returned: 0 in 0.493s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-96def75f-61df-40d5-8352-2ecfb5922fca tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-514b91ee-3704-4a6a-ac97-8e89377f675e {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:48 devstack sudo[106855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-514b91ee-3704-4a6a-ac97-8e89377f675e Sep 15 16:39:48 devstack sudo[106855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:48 devstack sudo[106852]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a4bf6cca-04a3-42c8-ac25-ddac1fdcf8d9 tempest-CreateVolumesFromSnapshotTest-1571001215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c4148e89-fa2d-4231-a905-c97281596730" returned: 0 in 0.325s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:48 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-2b124589-7c38-494d-b638-d2fcab563800 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Acquiring lock "cinder-c395f8e7-ea7f-43c2-948a-a370e0ca842c-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:39:48 devstack sudo[106851]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e36a6cd0-b7de-4132-a59b-dac085ffb7e9 tempest-VolumeImageDependencyTests-1330175006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_856c23cc-fd1f-496c-8f4a-e4fef2734eca_ovmp10ogdevstack@QuobyteHD" returned: 1 in 0.386s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e36a6cd0-b7de-4132-a59b-dac085ffb7e9 tempest-VolumeImageDependencyTests-1330175006 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_856c23cc-fd1f-496c-8f4a-e4fef2734eca_ovmp10ogdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 15 16:39:48 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-e36a6cd0-b7de-4132-a59b-dac085ffb7e9 tempest-VolumeImageDependencyTests-1330175006 None] Temporary image 856c23cc-fd1f-496c-8f4a-e4fef2734eca is fetched for user 1307d2b3e82b4f5790129e42a037a1c4. {{(pid=86082) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 15 16:39:48 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-a4bf6cca-04a3-42c8-ac25-ddac1fdcf8d9 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Lock "cinder-quobyte-c4148e89-fa2d-4231-a905-c97281596730" released by "delete_volume" :: held 0.837s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:39:48 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-2b124589-7c38-494d-b638-d2fcab563800 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Lock "cinder-c395f8e7-ea7f-43c2-948a-a370e0ca842c-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:39:48 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-2b124589-7c38-494d-b638-d2fcab563800 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Acquiring lock "cinder-quobyte-c395f8e7-ea7f-43c2-948a-a370e0ca842c" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:39:48 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-a4bf6cca-04a3-42c8-ac25-ddac1fdcf8d9 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Created reservations ['ab7aecf8-a388-4458-9153-eca879b84aa5', '869252f7-d31e-4988-805c-a5ccec9f27df', '3c53a074-2a1e-41e6-b651-360ac0cab9a2', 'b8f6f1e1-2013-4033-8ce0-e558f83bbd73'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:39:48 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[798f8f27-1a74-49da-a584-35df2eb48f7a]: (4, 'raw') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:39:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e36a6cd0-b7de-4132-a59b-dac085ffb7e9 tempest-VolumeImageDependencyTests-1330175006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_856c23cc-fd1f-496c-8f4a-e4fef2734eca_ovmp10ogdevstack@QuobyteHD {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:48 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-2b124589-7c38-494d-b638-d2fcab563800 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Lock "cinder-quobyte-c395f8e7-ea7f-43c2-948a-a370e0ca842c" acquired by "delete_volume" :: waited 0.050s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:39:48 devstack sudo[106855]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-96def75f-61df-40d5-8352-2ecfb5922fca tempest-ProjectMemberTests-1855156353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-514b91ee-3704-4a6a-ac97-8e89377f675e" returned: 0 in 0.337s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:48 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-96def75f-61df-40d5-8352-2ecfb5922fca tempest-ProjectMemberTests-1855156353 None] <== create_volume: return (903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:39:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-96def75f-61df-40d5-8352-2ecfb5922fca tempest-ProjectMemberTests-1855156353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.906s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:39:48 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e887012-f98a-4fd7-be9c-1823347d7b69]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:39:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2b124589-7c38-494d-b638-d2fcab563800 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c395f8e7-ea7f-43c2-948a-a370e0ca842c {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:48 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-96def75f-61df-40d5-8352-2ecfb5922fca tempest-ProjectMemberTests-1855156353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff8add8b-f64b-45de-a3cb-4f8e6f9fe468) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-514b91ee-3704-4a6a-ac97-8e89377f675e', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:48 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-96def75f-61df-40d5-8352-2ecfb5922fca tempest-ProjectMemberTests-1855156353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76204352-07af-4486-9b54-3778379f772d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:48 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-96def75f-61df-40d5-8352-2ecfb5922fca tempest-ProjectMemberTests-1855156353 None] Volume volume-514b91ee-3704-4a6a-ac97-8e89377f675e (514b91ee-3704-4a6a-ac97-8e89377f675e): created successfully Sep 15 16:39:48 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-96def75f-61df-40d5-8352-2ecfb5922fca tempest-ProjectMemberTests-1855156353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76204352-07af-4486-9b54-3778379f772d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:48 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-96def75f-61df-40d5-8352-2ecfb5922fca tempest-ProjectMemberTests-1855156353 None] Flow 'volume_create_manager' (3cffdad9-bba5-46f8-b477-dc9bf37dc9e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:39:48 devstack sudo[106862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_856c23cc-fd1f-496c-8f4a-e4fef2734eca_ovmp10ogdevstack@QuobyteHD Sep 15 16:39:48 devstack sudo[106862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:48 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-96def75f-61df-40d5-8352-2ecfb5922fca tempest-ProjectMemberTests-1855156353 None] Created volume successfully. Sep 15 16:39:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-a4bf6cca-04a3-42c8-ac25-ddac1fdcf8d9 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:39:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-a4bf6cca-04a3-42c8-ac25-ddac1fdcf8d9 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:39:48 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-a4bf6cca-04a3-42c8-ac25-ddac1fdcf8d9 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:39:48 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-a4bf6cca-04a3-42c8-ac25-ddac1fdcf8d9 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:39:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-a4bf6cca-04a3-42c8-ac25-ddac1fdcf8d9 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:39:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a4bf6cca-04a3-42c8-ac25-ddac1fdcf8d9 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:48 devstack sudo[106863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c395f8e7-ea7f-43c2-948a-a370e0ca842c Sep 15 16:39:48 devstack sudo[106863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:48 devstack sudo[106865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:39:48 devstack sudo[106865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:48 devstack sudo[106862]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e36a6cd0-b7de-4132-a59b-dac085ffb7e9 tempest-VolumeImageDependencyTests-1330175006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_856c23cc-fd1f-496c-8f4a-e4fef2734eca_ovmp10ogdevstack@QuobyteHD" returned: 0 in 0.361s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e36a6cd0-b7de-4132-a59b-dac085ffb7e9 tempest-VolumeImageDependencyTests-1330175006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_856c23cc-fd1f-496c-8f4a-e4fef2734eca_ovmp10ogdevstack@QuobyteHD {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:48 devstack sudo[106865]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a4bf6cca-04a3-42c8-ac25-ddac1fdcf8d9 tempest-CreateVolumesFromSnapshotTest-1571001215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.252s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:48 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-a4bf6cca-04a3-42c8-ac25-ddac1fdcf8d9 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:39:48 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-a4bf6cca-04a3-42c8-ac25-ddac1fdcf8d9 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Deleted volume successfully. Sep 15 16:39:48 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-a4bf6cca-04a3-42c8-ac25-ddac1fdcf8d9 tempest-CreateVolumesFromSnapshotTest-1571001215 None] Lock "cinder-c4148e89-fa2d-4231-a905-c97281596730-delete_volume" released by "delete_volume" :: held 1.536s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:39:48 devstack sudo[106863]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2b124589-7c38-494d-b638-d2fcab563800 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c395f8e7-ea7f-43c2-948a-a370e0ca842c" returned: 0 in 0.418s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2b124589-7c38-494d-b638-d2fcab563800 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c395f8e7-ea7f-43c2-948a-a370e0ca842c {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:48 devstack sudo[106871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_856c23cc-fd1f-496c-8f4a-e4fef2734eca_ovmp10ogdevstack@QuobyteHD Sep 15 16:39:48 devstack sudo[106871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:48 devstack sudo[106876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c395f8e7-ea7f-43c2-948a-a370e0ca842c Sep 15 16:39:48 devstack sudo[106876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:49 devstack sudo[106871]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e36a6cd0-b7de-4132-a59b-dac085ffb7e9 tempest-VolumeImageDependencyTests-1330175006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_856c23cc-fd1f-496c-8f4a-e4fef2734eca_ovmp10ogdevstack@QuobyteHD" returned: 1 in 0.355s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e36a6cd0-b7de-4132-a59b-dac085ffb7e9 tempest-VolumeImageDependencyTests-1330175006 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_856c23cc-fd1f-496c-8f4a-e4fef2734eca_ovmp10ogdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 15 16:39:49 devstack sudo[106876]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-e36a6cd0-b7de-4132-a59b-dac085ffb7e9 tempest-VolumeImageDependencyTests-1330175006 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:39:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-e36a6cd0-b7de-4132-a59b-dac085ffb7e9 tempest-VolumeImageDependencyTests-1330175006 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:39:49 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-e36a6cd0-b7de-4132-a59b-dac085ffb7e9 tempest-VolumeImageDependencyTests-1330175006 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:39:46Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dd20a52d-6aea-4c91-b49a-38810b893b33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fe50c751b4e4643b9098a315e25c260',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:39:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:39:47Z,use_quota=True,user_id='1307d2b3e82b4f5790129e42a037a1c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:39:49 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-e36a6cd0-b7de-4132-a59b-dac085ffb7e9 tempest-VolumeImageDependencyTests-1330175006 None] Creating volume dd20a52d-6aea-4c91-b49a-38810b893b33 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:39:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-e36a6cd0-b7de-4132-a59b-dac085ffb7e9 tempest-VolumeImageDependencyTests-1330175006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:39:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-e36a6cd0-b7de-4132-a59b-dac085ffb7e9 tempest-VolumeImageDependencyTests-1330175006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:39:49 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-e36a6cd0-b7de-4132-a59b-dac085ffb7e9 tempest-VolumeImageDependencyTests-1330175006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:39:49 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-e36a6cd0-b7de-4132-a59b-dac085ffb7e9 tempest-VolumeImageDependencyTests-1330175006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:39:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-e36a6cd0-b7de-4132-a59b-dac085ffb7e9 tempest-VolumeImageDependencyTests-1330175006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:39:49 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-e36a6cd0-b7de-4132-a59b-dac085ffb7e9 tempest-VolumeImageDependencyTests-1330175006 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:39:49 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-e36a6cd0-b7de-4132-a59b-dac085ffb7e9 tempest-VolumeImageDependencyTests-1330175006 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:39:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e36a6cd0-b7de-4132-a59b-dac085ffb7e9 tempest-VolumeImageDependencyTests-1330175006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-dd20a52d-6aea-4c91-b49a-38810b893b33 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2b124589-7c38-494d-b638-d2fcab563800 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c395f8e7-ea7f-43c2-948a-a370e0ca842c" returned: 0 in 0.268s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:49 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-2b124589-7c38-494d-b638-d2fcab563800 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Lock "cinder-quobyte-c395f8e7-ea7f-43c2-948a-a370e0ca842c" released by "delete_volume" :: held 0.741s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:39:49 devstack sudo[106883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-dd20a52d-6aea-4c91-b49a-38810b893b33 1073741824 Sep 15 16:39:49 devstack sudo[106883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:49 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-2b124589-7c38-494d-b638-d2fcab563800 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Created reservations ['f31dc429-8100-4993-934b-7acd75271e05', '91944bd8-16ab-4dde-a374-71bbe1f58cd9', 'af53d93f-31b6-4e17-9d53-dac20c23c5f8', '12ee2b7a-4808-459c-973a-95ba7a9e8ed0'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:39:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-2b124589-7c38-494d-b638-d2fcab563800 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:39:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-2b124589-7c38-494d-b638-d2fcab563800 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:39:49 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-2b124589-7c38-494d-b638-d2fcab563800 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:39:49 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-2b124589-7c38-494d-b638-d2fcab563800 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:39:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-2b124589-7c38-494d-b638-d2fcab563800 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:39:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2b124589-7c38-494d-b638-d2fcab563800 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:49 devstack sudo[106885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:39:49 devstack sudo[106885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:49 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-952da5d5-f491-4a29-9553-a6249209fa45 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Acquiring lock "cinder-e6016525-7014-4e87-8698-1763864d7699-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:39:49 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-952da5d5-f491-4a29-9553-a6249209fa45 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Lock "cinder-e6016525-7014-4e87-8698-1763864d7699-delete_volume" acquired by "delete_volume" :: waited 0.129s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:39:49 devstack sudo[106885]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:49 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-105ab792-5a6e-44d8-892c-8d23d0c0821a tempest-CreateVolumesFromSnapshotTest-1571001215 None] Acquiring lock "cinder-dd388514-09bc-4c0a-b89b-8db9dc161222-delete_snapshot" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:39:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2b124589-7c38-494d-b638-d2fcab563800 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.371s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:49 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-2b124589-7c38-494d-b638-d2fcab563800 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:39:49 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-2b124589-7c38-494d-b638-d2fcab563800 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Deleted volume successfully. Sep 15 16:39:49 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-105ab792-5a6e-44d8-892c-8d23d0c0821a tempest-CreateVolumesFromSnapshotTest-1571001215 None] Lock "cinder-dd388514-09bc-4c0a-b89b-8db9dc161222-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:39:49 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-105ab792-5a6e-44d8-892c-8d23d0c0821a tempest-CreateVolumesFromSnapshotTest-1571001215 None] Acquiring lock "cinder-quobyte-cd71de7d-f827-46c1-af28-384968f04b0b" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:39:49 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-952da5d5-f491-4a29-9553-a6249209fa45 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Acquiring lock "cinder-quobyte-e6016525-7014-4e87-8698-1763864d7699" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:39:49 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-105ab792-5a6e-44d8-892c-8d23d0c0821a tempest-CreateVolumesFromSnapshotTest-1571001215 None] Lock "cinder-quobyte-cd71de7d-f827-46c1-af28-384968f04b0b" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:39:49 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-105ab792-5a6e-44d8-892c-8d23d0c0821a tempest-CreateVolumesFromSnapshotTest-1571001215 None] Acquiring lock "cinder-quobyte-dd388514-09bc-4c0a-b89b-8db9dc161222" by "_delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:39:49 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-952da5d5-f491-4a29-9553-a6249209fa45 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Lock "cinder-quobyte-e6016525-7014-4e87-8698-1763864d7699" acquired by "delete_volume" :: waited 0.025s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:39:49 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-2b124589-7c38-494d-b638-d2fcab563800 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Lock "cinder-c395f8e7-ea7f-43c2-948a-a370e0ca842c-delete_volume" released by "delete_volume" :: held 1.408s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:39:49 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-105ab792-5a6e-44d8-892c-8d23d0c0821a tempest-CreateVolumesFromSnapshotTest-1571001215 None] Lock "cinder-quobyte-dd388514-09bc-4c0a-b89b-8db9dc161222" acquired by "_delete_snapshot" :: waited 0.037s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:39:49 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-105ab792-5a6e-44d8-892c-8d23d0c0821a tempest-CreateVolumesFromSnapshotTest-1571001215 None] Deleting offline snapshot dd388514-09bc-4c0a-b89b-8db9dc161222 of volume cd71de7d-f827-46c1-af28-384968f04b0b {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 15 16:39:49 devstack sudo[106883]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:49 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-105ab792-5a6e-44d8-892c-8d23d0c0821a tempest-CreateVolumesFromSnapshotTest-1571001215 None] snapshot_file for this snap is: volume-cd71de7d-f827-46c1-af28-384968f04b0b.dd388514-09bc-4c0a-b89b-8db9dc161222 {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 15 16:39:49 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[05ca7f41-ae73-4fcf-841b-b567e1c39dfb]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:39:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-952da5d5-f491-4a29-9553-a6249209fa45 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-e6016525-7014-4e87-8698-1763864d7699 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:49 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0940486-9ced-43b1-b110-f6146006aec9]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:39:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-105ab792-5a6e-44d8-892c-8d23d0c0821a tempest-CreateVolumesFromSnapshotTest-1571001215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-cd71de7d-f827-46c1-af28-384968f04b0b.dd388514-09bc-4c0a-b89b-8db9dc161222 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e36a6cd0-b7de-4132-a59b-dac085ffb7e9 tempest-VolumeImageDependencyTests-1330175006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-dd20a52d-6aea-4c91-b49a-38810b893b33 1073741824" returned: 0 in 0.676s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-934dfeaf-c5b1-4be9-bf63-7879425a375d tempest-ProjectMemberTests-1855156353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:39:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e36a6cd0-b7de-4132-a59b-dac085ffb7e9 tempest-VolumeImageDependencyTests-1330175006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-dd20a52d-6aea-4c91-b49a-38810b893b33 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:49 devstack sudo[106891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-e6016525-7014-4e87-8698-1763864d7699 Sep 15 16:39:49 devstack sudo[106891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:49 devstack sudo[106893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-dd20a52d-6aea-4c91-b49a-38810b893b33 Sep 15 16:39:49 devstack sudo[106893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:49 devstack sudo[106892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-cd71de7d-f827-46c1-af28-384968f04b0b.dd388514-09bc-4c0a-b89b-8db9dc161222 Sep 15 16:39:49 devstack sudo[106892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:50 devstack sudo[106893]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e36a6cd0-b7de-4132-a59b-dac085ffb7e9 tempest-VolumeImageDependencyTests-1330175006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-dd20a52d-6aea-4c91-b49a-38810b893b33" returned: 0 in 0.254s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:50 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-e36a6cd0-b7de-4132-a59b-dac085ffb7e9 tempest-VolumeImageDependencyTests-1330175006 None] <== create_volume: return (996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:39:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-e36a6cd0-b7de-4132-a59b-dac085ffb7e9 tempest-VolumeImageDependencyTests-1330175006 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:39:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-934dfeaf-c5b1-4be9-bf63-7879425a375d tempest-ProjectMemberTests-1855156353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.273s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:39:50 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-934dfeaf-c5b1-4be9-bf63-7879425a375d tempest-ProjectMemberTests-1855156353 None] Creating offline snapshot 9c614e56-04ed-44ac-8adc-6f65e29e6afa of volume 514b91ee-3704-4a6a-ac97-8e89377f675e {{(pid=86082) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 15 16:39:50 devstack cinder-volume[86082]: DEBUG cinder.volume.volume_utils [None req-e36a6cd0-b7de-4132-a59b-dac085ffb7e9 tempest-VolumeImageDependencyTests-1330175006 None] Attempting download of 856c23cc-fd1f-496c-8f4a-e4fef2734eca ((None, [{'url': 'file:///opt/stack/data/glance/images/856c23cc-fd1f-496c-8f4a-e4fef2734eca', 'metadata': {}}])) to volume dd20a52d-6aea-4c91-b49a-38810b893b33. {{(pid=86082) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 15 16:39:50 devstack sudo[106891]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:50 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[59d9bdcf-2866-4512-9baf-006d91d6e913]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:39:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-934dfeaf-c5b1-4be9-bf63-7879425a375d tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-514b91ee-3704-4a6a-ac97-8e89377f675e {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-952da5d5-f491-4a29-9553-a6249209fa45 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-e6016525-7014-4e87-8698-1763864d7699" returned: 0 in 0.421s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-952da5d5-f491-4a29-9553-a6249209fa45 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-e6016525-7014-4e87-8698-1763864d7699 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:50 devstack sudo[106892]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-105ab792-5a6e-44d8-892c-8d23d0c0821a tempest-CreateVolumesFromSnapshotTest-1571001215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-cd71de7d-f827-46c1-af28-384968f04b0b.dd388514-09bc-4c0a-b89b-8db9dc161222" returned: 0 in 0.423s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:50 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-105ab792-5a6e-44d8-892c-8d23d0c0821a tempest-CreateVolumesFromSnapshotTest-1571001215 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cd71de7d-f827-46c1-af28-384968f04b0b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 16:39:50 devstack sudo[106905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-e6016525-7014-4e87-8698-1763864d7699 Sep 15 16:39:50 devstack sudo[106905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:50 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1648861-d0e6-4123-8e57-2d33b7508825]: (4, 'raw') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:39:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e36a6cd0-b7de-4132-a59b-dac085ffb7e9 tempest-VolumeImageDependencyTests-1330175006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_856c23cc-fd1f-496c-8f4a-e4fef2734eca_q9d0vc9p {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:50 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b626531-38bc-41db-ae38-4157d139cd88]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:39:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-105ab792-5a6e-44d8-892c-8d23d0c0821a tempest-CreateVolumesFromSnapshotTest-1571001215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-cd71de7d-f827-46c1-af28-384968f04b0b {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:50 devstack sudo[106904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-514b91ee-3704-4a6a-ac97-8e89377f675e Sep 15 16:39:50 devstack sudo[106904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:50 devstack sudo[106907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_856c23cc-fd1f-496c-8f4a-e4fef2734eca_q9d0vc9p Sep 15 16:39:50 devstack sudo[106907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:50 devstack sudo[106908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-cd71de7d-f827-46c1-af28-384968f04b0b Sep 15 16:39:50 devstack sudo[106908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:50 devstack sudo[106905]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-952da5d5-f491-4a29-9553-a6249209fa45 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-e6016525-7014-4e87-8698-1763864d7699" returned: 0 in 0.299s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:50 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-952da5d5-f491-4a29-9553-a6249209fa45 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Lock "cinder-quobyte-e6016525-7014-4e87-8698-1763864d7699" released by "delete_volume" :: held 0.821s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:39:50 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-952da5d5-f491-4a29-9553-a6249209fa45 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Created reservations ['ffb5d33b-b901-4ebe-8695-4de4c6da6cab', 'e2103553-c8ba-4354-8749-7450019bed02', '1ea8a07f-7fcd-409b-be13-4550d1c82fe2', '4ea1d378-cd3e-40f6-8b4c-9cc297c7479d'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:39:50 devstack sudo[106907]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:50 devstack sudo[106904]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e36a6cd0-b7de-4132-a59b-dac085ffb7e9 tempest-VolumeImageDependencyTests-1330175006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_856c23cc-fd1f-496c-8f4a-e4fef2734eca_q9d0vc9p" returned: 0 in 0.364s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e36a6cd0-b7de-4132-a59b-dac085ffb7e9 tempest-VolumeImageDependencyTests-1330175006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_856c23cc-fd1f-496c-8f4a-e4fef2734eca_q9d0vc9p {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-934dfeaf-c5b1-4be9-bf63-7879425a375d tempest-ProjectMemberTests-1855156353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-514b91ee-3704-4a6a-ac97-8e89377f675e" returned: 0 in 0.465s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-934dfeaf-c5b1-4be9-bf63-7879425a375d tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-514b91ee-3704-4a6a-ac97-8e89377f675e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-514b91ee-3704-4a6a-ac97-8e89377f675e.9c614e56-04ed-44ac-8adc-6f65e29e6afa 1G {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:50 devstack sudo[106922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-514b91ee-3704-4a6a-ac97-8e89377f675e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-514b91ee-3704-4a6a-ac97-8e89377f675e.9c614e56-04ed-44ac-8adc-6f65e29e6afa 1G Sep 15 16:39:50 devstack sudo[106922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-952da5d5-f491-4a29-9553-a6249209fa45 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:39:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-952da5d5-f491-4a29-9553-a6249209fa45 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:39:50 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-952da5d5-f491-4a29-9553-a6249209fa45 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:39:50 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-952da5d5-f491-4a29-9553-a6249209fa45 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:39:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-952da5d5-f491-4a29-9553-a6249209fa45 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:39:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-952da5d5-f491-4a29-9553-a6249209fa45 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:50 devstack sudo[106908]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-105ab792-5a6e-44d8-892c-8d23d0c0821a tempest-CreateVolumesFromSnapshotTest-1571001215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-cd71de7d-f827-46c1-af28-384968f04b0b" returned: 0 in 0.469s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-105ab792-5a6e-44d8-892c-8d23d0c0821a tempest-CreateVolumesFromSnapshotTest-1571001215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-cd71de7d-f827-46c1-af28-384968f04b0b.dd388514-09bc-4c0a-b89b-8db9dc161222 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:50 devstack sudo[106924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:39:50 devstack sudo[106924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:50 devstack sudo[106920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_856c23cc-fd1f-496c-8f4a-e4fef2734eca_q9d0vc9p Sep 15 16:39:50 devstack sudo[106920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:50 devstack sudo[106925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-cd71de7d-f827-46c1-af28-384968f04b0b.dd388514-09bc-4c0a-b89b-8db9dc161222 Sep 15 16:39:50 devstack sudo[106925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:50 devstack sudo[106920]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e36a6cd0-b7de-4132-a59b-dac085ffb7e9 tempest-VolumeImageDependencyTests-1330175006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_856c23cc-fd1f-496c-8f4a-e4fef2734eca_q9d0vc9p" returned: 1 in 0.377s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e36a6cd0-b7de-4132-a59b-dac085ffb7e9 tempest-VolumeImageDependencyTests-1330175006 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_856c23cc-fd1f-496c-8f4a-e4fef2734eca_q9d0vc9p' failed. Not Retrying. {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 15 16:39:50 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[205bd77d-b938-4420-9705-3ca96761aff1]: (4, 'raw') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:39:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e36a6cd0-b7de-4132-a59b-dac085ffb7e9 tempest-VolumeImageDependencyTests-1330175006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_856c23cc-fd1f-496c-8f4a-e4fef2734eca_ovmp10ogdevstack@QuobyteHD {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:50 devstack sudo[106924]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-952da5d5-f491-4a29-9553-a6249209fa45 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.299s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:50 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-952da5d5-f491-4a29-9553-a6249209fa45 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:39:50 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-952da5d5-f491-4a29-9553-a6249209fa45 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Deleted volume successfully. Sep 15 16:39:50 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-952da5d5-f491-4a29-9553-a6249209fa45 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Lock "cinder-e6016525-7014-4e87-8698-1763864d7699-delete_volume" released by "delete_volume" :: held 1.482s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:39:51 devstack sudo[106935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_856c23cc-fd1f-496c-8f4a-e4fef2734eca_ovmp10ogdevstack@QuobyteHD Sep 15 16:39:51 devstack sudo[106935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:51 devstack sudo[106922]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-934dfeaf-c5b1-4be9-bf63-7879425a375d tempest-ProjectMemberTests-1855156353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-514b91ee-3704-4a6a-ac97-8e89377f675e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-514b91ee-3704-4a6a-ac97-8e89377f675e.9c614e56-04ed-44ac-8adc-6f65e29e6afa 1G" returned: 0 in 0.529s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-934dfeaf-c5b1-4be9-bf63-7879425a375d tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-514b91ee-3704-4a6a-ac97-8e89377f675e -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-514b91ee-3704-4a6a-ac97-8e89377f675e.9c614e56-04ed-44ac-8adc-6f65e29e6afa {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:51 devstack sudo[106925]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-105ab792-5a6e-44d8-892c-8d23d0c0821a tempest-CreateVolumesFromSnapshotTest-1571001215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-cd71de7d-f827-46c1-af28-384968f04b0b.dd388514-09bc-4c0a-b89b-8db9dc161222" returned: 0 in 0.454s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-105ab792-5a6e-44d8-892c-8d23d0c0821a tempest-CreateVolumesFromSnapshotTest-1571001215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-cd71de7d-f827-46c1-af28-384968f04b0b.dd388514-09bc-4c0a-b89b-8db9dc161222 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:51 devstack sudo[106941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-514b91ee-3704-4a6a-ac97-8e89377f675e -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-514b91ee-3704-4a6a-ac97-8e89377f675e.9c614e56-04ed-44ac-8adc-6f65e29e6afa Sep 15 16:39:51 devstack sudo[106941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:51 devstack sudo[106942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-cd71de7d-f827-46c1-af28-384968f04b0b.dd388514-09bc-4c0a-b89b-8db9dc161222 Sep 15 16:39:51 devstack sudo[106942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:51 devstack sudo[106935]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e36a6cd0-b7de-4132-a59b-dac085ffb7e9 tempest-VolumeImageDependencyTests-1330175006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_856c23cc-fd1f-496c-8f4a-e4fef2734eca_ovmp10ogdevstack@QuobyteHD" returned: 0 in 0.363s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e36a6cd0-b7de-4132-a59b-dac085ffb7e9 tempest-VolumeImageDependencyTests-1330175006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_856c23cc-fd1f-496c-8f4a-e4fef2734eca_ovmp10ogdevstack@QuobyteHD {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:51 devstack sudo[106942]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-105ab792-5a6e-44d8-892c-8d23d0c0821a tempest-CreateVolumesFromSnapshotTest-1571001215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-cd71de7d-f827-46c1-af28-384968f04b0b.dd388514-09bc-4c0a-b89b-8db9dc161222" returned: 0 in 0.264s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:51 devstack sudo[106941]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-934dfeaf-c5b1-4be9-bf63-7879425a375d tempest-ProjectMemberTests-1855156353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-514b91ee-3704-4a6a-ac97-8e89377f675e -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-514b91ee-3704-4a6a-ac97-8e89377f675e.9c614e56-04ed-44ac-8adc-6f65e29e6afa" returned: 0 in 0.329s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:51 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-934dfeaf-c5b1-4be9-bf63-7879425a375d tempest-ProjectMemberTests-1855156353 None] /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-514b91ee-3704-4a6a-ac97-8e89377f675e.9c614e56-04ed-44ac-8adc-6f65e29e6afa is being set with open permissions: ugo+rw Sep 15 16:39:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-934dfeaf-c5b1-4be9-bf63-7879425a375d tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-514b91ee-3704-4a6a-ac97-8e89377f675e.9c614e56-04ed-44ac-8adc-6f65e29e6afa {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:51 devstack sudo[106947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_856c23cc-fd1f-496c-8f4a-e4fef2734eca_ovmp10ogdevstack@QuobyteHD Sep 15 16:39:51 devstack sudo[106947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:51 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-105ab792-5a6e-44d8-892c-8d23d0c0821a tempest-CreateVolumesFromSnapshotTest-1571001215 None] Lock "cinder-quobyte-dd388514-09bc-4c0a-b89b-8db9dc161222" released by "_delete_snapshot" :: held 1.791s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:39:51 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-105ab792-5a6e-44d8-892c-8d23d0c0821a tempest-CreateVolumesFromSnapshotTest-1571001215 None] Lock "cinder-quobyte-cd71de7d-f827-46c1-af28-384968f04b0b" released by "delete_snapshot" :: held 1.840s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:39:51 devstack sudo[106953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-514b91ee-3704-4a6a-ac97-8e89377f675e.9c614e56-04ed-44ac-8adc-6f65e29e6afa Sep 15 16:39:51 devstack sudo[106953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:51 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-105ab792-5a6e-44d8-892c-8d23d0c0821a tempest-CreateVolumesFromSnapshotTest-1571001215 None] Created reservations ['fda95d36-84e2-4382-a97c-4f3ab3af395f', '91384838-4b25-43f6-b001-adcae0f1298e', 'f37cce6d-1576-48ab-9e86-81083c718975', '8b3d600f-8323-45ed-8819-121a54fb4c29'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:39:51 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-105ab792-5a6e-44d8-892c-8d23d0c0821a tempest-CreateVolumesFromSnapshotTest-1571001215 None] Delete snapshot completed successfully. Sep 15 16:39:51 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-105ab792-5a6e-44d8-892c-8d23d0c0821a tempest-CreateVolumesFromSnapshotTest-1571001215 None] Lock "cinder-dd388514-09bc-4c0a-b89b-8db9dc161222-delete_snapshot" released by "delete_snapshot" :: held 1.992s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:39:51 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-7cb28069-5110-4719-bdf7-f9aa66c43643 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Acquiring lock "cinder-38e58d5e-b7c6-4840-b5ff-07fcca57efcc-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:39:51 devstack sudo[106947]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e36a6cd0-b7de-4132-a59b-dac085ffb7e9 tempest-VolumeImageDependencyTests-1330175006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_856c23cc-fd1f-496c-8f4a-e4fef2734eca_ovmp10ogdevstack@QuobyteHD" returned: 1 in 0.409s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e36a6cd0-b7de-4132-a59b-dac085ffb7e9 tempest-VolumeImageDependencyTests-1330175006 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_856c23cc-fd1f-496c-8f4a-e4fef2734eca_ovmp10ogdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 15 16:39:51 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-e36a6cd0-b7de-4132-a59b-dac085ffb7e9 tempest-VolumeImageDependencyTests-1330175006 None] 856c23cc-fd1f-496c-8f4a-e4fef2734eca was raw, converting to qcow2 {{(pid=86082) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 15 16:39:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e36a6cd0-b7de-4132-a59b-dac085ffb7e9 tempest-VolumeImageDependencyTests-1330175006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_856c23cc-fd1f-496c-8f4a-e4fef2734eca_ovmp10ogdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-dd20a52d-6aea-4c91-b49a-38810b893b33 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:51 devstack sudo[106953]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:51 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-7cb28069-5110-4719-bdf7-f9aa66c43643 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Lock "cinder-38e58d5e-b7c6-4840-b5ff-07fcca57efcc-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:39:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-934dfeaf-c5b1-4be9-bf63-7879425a375d tempest-ProjectMemberTests-1855156353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-514b91ee-3704-4a6a-ac97-8e89377f675e.9c614e56-04ed-44ac-8adc-6f65e29e6afa" returned: 0 in 0.314s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:51 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-582bf6d6-8612-48df-b8ab-9119ca63a05f tempest-CreateVolumesFromSnapshotTest-1571001215 None] Acquiring lock "cinder-cd71de7d-f827-46c1-af28-384968f04b0b-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:39:51 devstack sudo[106959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_856c23cc-fd1f-496c-8f4a-e4fef2734eca_ovmp10ogdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-dd20a52d-6aea-4c91-b49a-38810b893b33 Sep 15 16:39:51 devstack sudo[106959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:51 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-582bf6d6-8612-48df-b8ab-9119ca63a05f tempest-CreateVolumesFromSnapshotTest-1571001215 None] Lock "cinder-cd71de7d-f827-46c1-af28-384968f04b0b-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:39:51 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-7cb28069-5110-4719-bdf7-f9aa66c43643 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Acquiring lock "cinder-quobyte-38e58d5e-b7c6-4840-b5ff-07fcca57efcc" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:39:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-934dfeaf-c5b1-4be9-bf63-7879425a375d tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-514b91ee-3704-4a6a-ac97-8e89377f675e.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:51 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-582bf6d6-8612-48df-b8ab-9119ca63a05f tempest-CreateVolumesFromSnapshotTest-1571001215 None] Acquiring lock "cinder-quobyte-cd71de7d-f827-46c1-af28-384968f04b0b" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:39:51 devstack sudo[106961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-514b91ee-3704-4a6a-ac97-8e89377f675e.info Sep 15 16:39:51 devstack sudo[106961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:51 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-7cb28069-5110-4719-bdf7-f9aa66c43643 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Lock "cinder-quobyte-38e58d5e-b7c6-4840-b5ff-07fcca57efcc" acquired by "delete_volume" :: waited 0.069s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:39:51 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-582bf6d6-8612-48df-b8ab-9119ca63a05f tempest-CreateVolumesFromSnapshotTest-1571001215 None] Lock "cinder-quobyte-cd71de7d-f827-46c1-af28-384968f04b0b" acquired by "delete_volume" :: waited 0.043s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:39:51 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[37297872-9ec4-4075-89d0-aa3d08be1fdd]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:39:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7cb28069-5110-4719-bdf7-f9aa66c43643 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-38e58d5e-b7c6-4840-b5ff-07fcca57efcc {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:51 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[54d42d25-fe1f-41fe-8081-60d83e6ca09c]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:39:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-582bf6d6-8612-48df-b8ab-9119ca63a05f tempest-CreateVolumesFromSnapshotTest-1571001215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-cd71de7d-f827-46c1-af28-384968f04b0b {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:52 devstack sudo[106965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-38e58d5e-b7c6-4840-b5ff-07fcca57efcc Sep 15 16:39:52 devstack sudo[106965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:52 devstack sudo[106967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-cd71de7d-f827-46c1-af28-384968f04b0b Sep 15 16:39:52 devstack sudo[106967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:52 devstack sudo[106961]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-934dfeaf-c5b1-4be9-bf63-7879425a375d tempest-ProjectMemberTests-1855156353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-514b91ee-3704-4a6a-ac97-8e89377f675e.info" returned: 0 in 0.358s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:52 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-934dfeaf-c5b1-4be9-bf63-7879425a375d tempest-ProjectMemberTests-1855156353 None] /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-514b91ee-3704-4a6a-ac97-8e89377f675e.info is being set with open permissions: ugo+rw Sep 15 16:39:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-934dfeaf-c5b1-4be9-bf63-7879425a375d tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-514b91ee-3704-4a6a-ac97-8e89377f675e.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:52 devstack sudo[106975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-514b91ee-3704-4a6a-ac97-8e89377f675e.info Sep 15 16:39:52 devstack sudo[106975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:52 devstack sudo[106959]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e36a6cd0-b7de-4132-a59b-dac085ffb7e9 tempest-VolumeImageDependencyTests-1330175006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_856c23cc-fd1f-496c-8f4a-e4fef2734eca_ovmp10ogdevstack@QuobyteHD /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-dd20a52d-6aea-4c91-b49a-38810b893b33" returned: 0 in 0.615s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:52 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-e36a6cd0-b7de-4132-a59b-dac085ffb7e9 tempest-VolumeImageDependencyTests-1330175006 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_856c23cc-fd1f-496c-8f4a-e4fef2734eca_ovmp10ogdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-dd20a52d-6aea-4c91-b49a-38810b893b33 {{(pid=86082) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 15 16:39:52 devstack cinder-volume[86082]: INFO cinder.image.image_utils [None req-e36a6cd0-b7de-4132-a59b-dac085ffb7e9 tempest-VolumeImageDependencyTests-1330175006 None] Converted 0.00 MB image at 0.00 MB/s Sep 15 16:39:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e36a6cd0-b7de-4132-a59b-dac085ffb7e9 tempest-VolumeImageDependencyTests-1330175006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-dd20a52d-6aea-4c91-b49a-38810b893b33 1G {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:52 devstack sudo[106977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-dd20a52d-6aea-4c91-b49a-38810b893b33 1G Sep 15 16:39:52 devstack sudo[106977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:52 devstack sudo[106965]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7cb28069-5110-4719-bdf7-f9aa66c43643 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-38e58d5e-b7c6-4840-b5ff-07fcca57efcc" returned: 0 in 0.477s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7cb28069-5110-4719-bdf7-f9aa66c43643 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-38e58d5e-b7c6-4840-b5ff-07fcca57efcc {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:52 devstack sudo[106987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-38e58d5e-b7c6-4840-b5ff-07fcca57efcc Sep 15 16:39:52 devstack sudo[106987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:52 devstack sudo[106967]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-582bf6d6-8612-48df-b8ab-9119ca63a05f tempest-CreateVolumesFromSnapshotTest-1571001215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-cd71de7d-f827-46c1-af28-384968f04b0b" returned: 0 in 0.497s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-582bf6d6-8612-48df-b8ab-9119ca63a05f tempest-CreateVolumesFromSnapshotTest-1571001215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-cd71de7d-f827-46c1-af28-384968f04b0b {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:52 devstack sudo[106990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-cd71de7d-f827-46c1-af28-384968f04b0b Sep 15 16:39:52 devstack sudo[106990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:52 devstack sudo[106975]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-934dfeaf-c5b1-4be9-bf63-7879425a375d tempest-ProjectMemberTests-1855156353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-514b91ee-3704-4a6a-ac97-8e89377f675e.info" returned: 0 in 0.330s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-934dfeaf-c5b1-4be9-bf63-7879425a375d tempest-ProjectMemberTests-1855156353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.549s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:39:52 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-934dfeaf-c5b1-4be9-bf63-7879425a375d tempest-ProjectMemberTests-1855156353 None] Create snapshot completed successfully Sep 15 16:39:52 devstack sudo[106977]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-e36a6cd0-b7de-4132-a59b-dac085ffb7e9 tempest-VolumeImageDependencyTests-1330175006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-dd20a52d-6aea-4c91-b49a-38810b893b33 1G" returned: 0 in 0.365s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:52 devstack cinder-volume[86082]: DEBUG cinder.volume.volume_utils [None req-e36a6cd0-b7de-4132-a59b-dac085ffb7e9 tempest-VolumeImageDependencyTests-1330175006 None] Downloaded image 856c23cc-fd1f-496c-8f4a-e4fef2734eca ((None, [{'url': 'file:///opt/stack/data/glance/images/856c23cc-fd1f-496c-8f4a-e4fef2734eca', 'metadata': {}}])) to volume dd20a52d-6aea-4c91-b49a-38810b893b33 successfully. {{(pid=86082) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 15 16:39:52 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-e36a6cd0-b7de-4132-a59b-dac085ffb7e9 tempest-VolumeImageDependencyTests-1330175006 None] Temporary image 856c23cc-fd1f-496c-8f4a-e4fef2734eca for user 1307d2b3e82b4f5790129e42a037a1c4 is deleted. {{(pid=86082) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 15 16:39:52 devstack cinder-volume[86082]: DEBUG cinder.volume.volume_utils [None req-e36a6cd0-b7de-4132-a59b-dac085ffb7e9 tempest-VolumeImageDependencyTests-1330175006 None] Marking volume dd20a52d-6aea-4c91-b49a-38810b893b33 as bootable. {{(pid=86082) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 15 16:39:52 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-e36a6cd0-b7de-4132-a59b-dac085ffb7e9 tempest-VolumeImageDependencyTests-1330175006 None] Copying metadata from image 856c23cc-fd1f-496c-8f4a-e4fef2734eca to dd20a52d-6aea-4c91-b49a-38810b893b33. {{(pid=86082) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 15 16:39:52 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-e36a6cd0-b7de-4132-a59b-dac085ffb7e9 tempest-VolumeImageDependencyTests-1330175006 None] Creating volume glance metadata for volume dd20a52d-6aea-4c91-b49a-38810b893b33 backed by image 856c23cc-fd1f-496c-8f4a-e4fef2734eca with: {'image_id': '856c23cc-fd1f-496c-8f4a-e4fef2734eca', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '5b5009225d15dc7663663d766d8a4d2f', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86082) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 15 16:39:52 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e36a6cd0-b7de-4132-a59b-dac085ffb7e9 tempest-VolumeImageDependencyTests-1330175006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e382bcaf-5f23-4e9d-a986-cc7ea6dd7f4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dd20a52d-6aea-4c91-b49a-38810b893b33', 'volume_size': 1, 'image_id': '856c23cc-fd1f-496c-8f4a-e4fef2734eca', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/856c23cc-fd1f-496c-8f4a-e4fef2734eca', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5b5009225d15dc7663663d766d8a4d2f', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '8fe50c751b4e4643b9098a315e25c260', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '527ee3071e583a0e8fde748d77c5e2dc50aa6ca0ed1addb2463222caaab96366ce64e84223197c29158ed8e3af80b238f98ba6fd0559f36dc5864aa9221f9d85', 'id': '856c23cc-fd1f-496c-8f4a-e4fef2734eca', 'created_at': datetime.datetime(2026, 9, 15, 14, 39, 44, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 15, 14, 39, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/856c23cc-fd1f-496c-8f4a-e4fef2734eca/file', 'properties': {}}, 'image_service': }' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:52 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e36a6cd0-b7de-4132-a59b-dac085ffb7e9 tempest-VolumeImageDependencyTests-1330175006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50a305e4-3301-48cb-93c4-c99302c78bde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:52 devstack sudo[106987]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7cb28069-5110-4719-bdf7-f9aa66c43643 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-38e58d5e-b7c6-4840-b5ff-07fcca57efcc" returned: 0 in 0.327s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:52 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-e36a6cd0-b7de-4132-a59b-dac085ffb7e9 tempest-VolumeImageDependencyTests-1330175006 None] Volume volume-dd20a52d-6aea-4c91-b49a-38810b893b33 (dd20a52d-6aea-4c91-b49a-38810b893b33): created successfully Sep 15 16:39:52 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e36a6cd0-b7de-4132-a59b-dac085ffb7e9 tempest-VolumeImageDependencyTests-1330175006 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50a305e4-3301-48cb-93c4-c99302c78bde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:52 devstack sudo[106990]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:52 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-e36a6cd0-b7de-4132-a59b-dac085ffb7e9 tempest-VolumeImageDependencyTests-1330175006 None] Flow 'volume_create_manager' (f6c1ddae-4846-4567-a458-9e6f5c1c1d5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:39:52 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-7cb28069-5110-4719-bdf7-f9aa66c43643 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Lock "cinder-quobyte-38e58d5e-b7c6-4840-b5ff-07fcca57efcc" released by "delete_volume" :: held 0.922s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:39:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-582bf6d6-8612-48df-b8ab-9119ca63a05f tempest-CreateVolumesFromSnapshotTest-1571001215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-cd71de7d-f827-46c1-af28-384968f04b0b" returned: 0 in 0.328s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:52 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-582bf6d6-8612-48df-b8ab-9119ca63a05f tempest-CreateVolumesFromSnapshotTest-1571001215 None] Lock "cinder-quobyte-cd71de7d-f827-46c1-af28-384968f04b0b" released by "delete_volume" :: held 0.910s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:39:52 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-e36a6cd0-b7de-4132-a59b-dac085ffb7e9 tempest-VolumeImageDependencyTests-1330175006 None] Created volume successfully. Sep 15 16:39:52 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-7cb28069-5110-4719-bdf7-f9aa66c43643 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Created reservations ['12822d4c-08c5-4707-8897-5b5b663700f1', '811c7232-f5c9-471e-888b-3e9e02a5700c', 'ed4583ff-8aca-4a21-ae07-120a6f98dbe0', '60bcb15c-9924-4f21-9c9d-13e2bb9ab5d5'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:39:52 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-582bf6d6-8612-48df-b8ab-9119ca63a05f tempest-CreateVolumesFromSnapshotTest-1571001215 None] Created reservations ['053bfdfe-4d9d-46d2-8140-d7ab7885c527', 'ebf15711-0235-47d0-9d31-592969883787', '53d428f2-cbe4-48e0-9f3f-1adc46a75c1c', '2edfb85b-df2d-4701-a742-d88389f927ed'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:39:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-7cb28069-5110-4719-bdf7-f9aa66c43643 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:39:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-7cb28069-5110-4719-bdf7-f9aa66c43643 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:39:52 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-7cb28069-5110-4719-bdf7-f9aa66c43643 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:39:52 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-7cb28069-5110-4719-bdf7-f9aa66c43643 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:39:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-7cb28069-5110-4719-bdf7-f9aa66c43643 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:39:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7cb28069-5110-4719-bdf7-f9aa66c43643 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:53 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-bc8946af-abe2-438e-828c-259be330c587 tempest-ProjectMemberTests-1855156353 None] Acquiring lock "cinder-9c614e56-04ed-44ac-8adc-6f65e29e6afa-delete_snapshot" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:39:53 devstack sudo[106998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:39:53 devstack sudo[106998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:53 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-bc8946af-abe2-438e-828c-259be330c587 tempest-ProjectMemberTests-1855156353 None] Lock "cinder-9c614e56-04ed-44ac-8adc-6f65e29e6afa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:39:53 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-bc8946af-abe2-438e-828c-259be330c587 tempest-ProjectMemberTests-1855156353 None] Acquiring lock "cinder-quobyte-514b91ee-3704-4a6a-ac97-8e89377f675e" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:39:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-582bf6d6-8612-48df-b8ab-9119ca63a05f tempest-CreateVolumesFromSnapshotTest-1571001215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:39:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-582bf6d6-8612-48df-b8ab-9119ca63a05f tempest-CreateVolumesFromSnapshotTest-1571001215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:39:53 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-582bf6d6-8612-48df-b8ab-9119ca63a05f tempest-CreateVolumesFromSnapshotTest-1571001215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:39:53 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-582bf6d6-8612-48df-b8ab-9119ca63a05f tempest-CreateVolumesFromSnapshotTest-1571001215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:39:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-582bf6d6-8612-48df-b8ab-9119ca63a05f tempest-CreateVolumesFromSnapshotTest-1571001215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:39:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-582bf6d6-8612-48df-b8ab-9119ca63a05f tempest-CreateVolumesFromSnapshotTest-1571001215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:53 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-bc8946af-abe2-438e-828c-259be330c587 tempest-ProjectMemberTests-1855156353 None] Lock "cinder-quobyte-514b91ee-3704-4a6a-ac97-8e89377f675e" acquired by "delete_snapshot" :: waited 0.038s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:39:53 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-bc8946af-abe2-438e-828c-259be330c587 tempest-ProjectMemberTests-1855156353 None] Acquiring lock "cinder-quobyte-9c614e56-04ed-44ac-8adc-6f65e29e6afa" by "_delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:39:53 devstack sudo[107000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:39:53 devstack sudo[107000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:53 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-bc8946af-abe2-438e-828c-259be330c587 tempest-ProjectMemberTests-1855156353 None] Lock "cinder-quobyte-9c614e56-04ed-44ac-8adc-6f65e29e6afa" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:39:53 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-bc8946af-abe2-438e-828c-259be330c587 tempest-ProjectMemberTests-1855156353 None] Deleting offline snapshot 9c614e56-04ed-44ac-8adc-6f65e29e6afa of volume 514b91ee-3704-4a6a-ac97-8e89377f675e {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 15 16:39:53 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-bc8946af-abe2-438e-828c-259be330c587 tempest-ProjectMemberTests-1855156353 None] snapshot_file for this snap is: volume-514b91ee-3704-4a6a-ac97-8e89377f675e.9c614e56-04ed-44ac-8adc-6f65e29e6afa {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 15 16:39:53 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-d490afec-87da-4c8a-bbd2-d2ea2d5e72c9 tempest-VolumeImageDependencyTests-1330175006 None] Acquiring lock "cinder-dd20a52d-6aea-4c91-b49a-38810b893b33-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:39:53 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f9995c0-b2a2-43b5-a99a-89430851163c]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:39:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-bc8946af-abe2-438e-828c-259be330c587 tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-514b91ee-3704-4a6a-ac97-8e89377f675e.9c614e56-04ed-44ac-8adc-6f65e29e6afa {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:53 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-d490afec-87da-4c8a-bbd2-d2ea2d5e72c9 tempest-VolumeImageDependencyTests-1330175006 None] Lock "cinder-dd20a52d-6aea-4c91-b49a-38810b893b33-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:39:53 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-d490afec-87da-4c8a-bbd2-d2ea2d5e72c9 tempest-VolumeImageDependencyTests-1330175006 None] Acquiring lock "cinder-quobyte-dd20a52d-6aea-4c91-b49a-38810b893b33" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:39:53 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-d490afec-87da-4c8a-bbd2-d2ea2d5e72c9 tempest-VolumeImageDependencyTests-1330175006 None] Lock "cinder-quobyte-dd20a52d-6aea-4c91-b49a-38810b893b33" acquired by "delete_volume" :: waited 0.043s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:39:53 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb2637a3-3603-4453-828e-65850abbd6f6]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:39:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d490afec-87da-4c8a-bbd2-d2ea2d5e72c9 tempest-VolumeImageDependencyTests-1330175006 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-dd20a52d-6aea-4c91-b49a-38810b893b33 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:53 devstack sudo[107002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-514b91ee-3704-4a6a-ac97-8e89377f675e.9c614e56-04ed-44ac-8adc-6f65e29e6afa Sep 15 16:39:53 devstack sudo[107002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:53 devstack sudo[107000]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-582bf6d6-8612-48df-b8ab-9119ca63a05f tempest-CreateVolumesFromSnapshotTest-1571001215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.301s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:53 devstack sudo[106998]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:53 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-582bf6d6-8612-48df-b8ab-9119ca63a05f tempest-CreateVolumesFromSnapshotTest-1571001215 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:39:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7cb28069-5110-4719-bdf7-f9aa66c43643 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.377s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:53 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-7cb28069-5110-4719-bdf7-f9aa66c43643 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:39:53 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-582bf6d6-8612-48df-b8ab-9119ca63a05f tempest-CreateVolumesFromSnapshotTest-1571001215 None] Deleted volume successfully. Sep 15 16:39:53 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-582bf6d6-8612-48df-b8ab-9119ca63a05f tempest-CreateVolumesFromSnapshotTest-1571001215 None] Lock "cinder-cd71de7d-f827-46c1-af28-384968f04b0b-delete_volume" released by "delete_volume" :: held 1.643s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:39:53 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-7cb28069-5110-4719-bdf7-f9aa66c43643 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Deleted volume successfully. Sep 15 16:39:53 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-7cb28069-5110-4719-bdf7-f9aa66c43643 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Lock "cinder-38e58d5e-b7c6-4840-b5ff-07fcca57efcc-delete_volume" released by "delete_volume" :: held 1.730s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:39:53 devstack sudo[107004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-dd20a52d-6aea-4c91-b49a-38810b893b33 Sep 15 16:39:53 devstack sudo[107004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:53 devstack sudo[107002]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-bc8946af-abe2-438e-828c-259be330c587 tempest-ProjectMemberTests-1855156353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-514b91ee-3704-4a6a-ac97-8e89377f675e.9c614e56-04ed-44ac-8adc-6f65e29e6afa" returned: 0 in 0.431s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:53 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-bc8946af-abe2-438e-828c-259be330c587 tempest-ProjectMemberTests-1855156353 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-514b91ee-3704-4a6a-ac97-8e89377f675e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 16:39:53 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8fdfd4c-2d74-44ce-9dad-4bbce82e59d8]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:39:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-bc8946af-abe2-438e-828c-259be330c587 tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-514b91ee-3704-4a6a-ac97-8e89377f675e {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:53 devstack sudo[107004]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d490afec-87da-4c8a-bbd2-d2ea2d5e72c9 tempest-VolumeImageDependencyTests-1330175006 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-dd20a52d-6aea-4c91-b49a-38810b893b33" returned: 0 in 0.405s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d490afec-87da-4c8a-bbd2-d2ea2d5e72c9 tempest-VolumeImageDependencyTests-1330175006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-dd20a52d-6aea-4c91-b49a-38810b893b33 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:53 devstack sudo[107016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-dd20a52d-6aea-4c91-b49a-38810b893b33 Sep 15 16:39:53 devstack sudo[107016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:53 devstack sudo[107013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-514b91ee-3704-4a6a-ac97-8e89377f675e Sep 15 16:39:53 devstack sudo[107013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:53 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-6ac3cdf7-d9ac-4eec-bc89-1a27aa35f73a tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Acquiring lock "cinder-52d8b18b-8f27-40d2-a0d7-0c9a47c0b1aa-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:39:53 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-6ac3cdf7-d9ac-4eec-bc89-1a27aa35f73a tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Lock "cinder-52d8b18b-8f27-40d2-a0d7-0c9a47c0b1aa-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:39:54 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-6ac3cdf7-d9ac-4eec-bc89-1a27aa35f73a tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Acquiring lock "cinder-quobyte-52d8b18b-8f27-40d2-a0d7-0c9a47c0b1aa" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:39:54 devstack sudo[107016]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:54 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-6ac3cdf7-d9ac-4eec-bc89-1a27aa35f73a tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Lock "cinder-quobyte-52d8b18b-8f27-40d2-a0d7-0c9a47c0b1aa" acquired by "delete_volume" :: waited 0.014s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:39:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d490afec-87da-4c8a-bbd2-d2ea2d5e72c9 tempest-VolumeImageDependencyTests-1330175006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-dd20a52d-6aea-4c91-b49a-38810b893b33" returned: 0 in 0.326s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:54 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-d490afec-87da-4c8a-bbd2-d2ea2d5e72c9 tempest-VolumeImageDependencyTests-1330175006 None] Lock "cinder-quobyte-dd20a52d-6aea-4c91-b49a-38810b893b33" released by "delete_volume" :: held 0.786s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:39:54 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed11b16a-30cc-497d-977e-4375361c412e]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:39:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-6ac3cdf7-d9ac-4eec-bc89-1a27aa35f73a tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-52d8b18b-8f27-40d2-a0d7-0c9a47c0b1aa {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:54 devstack sudo[107013]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-bc8946af-abe2-438e-828c-259be330c587 tempest-ProjectMemberTests-1855156353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-514b91ee-3704-4a6a-ac97-8e89377f675e" returned: 0 in 0.453s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-bc8946af-abe2-438e-828c-259be330c587 tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-514b91ee-3704-4a6a-ac97-8e89377f675e.9c614e56-04ed-44ac-8adc-6f65e29e6afa {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:54 devstack sudo[107024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-514b91ee-3704-4a6a-ac97-8e89377f675e.9c614e56-04ed-44ac-8adc-6f65e29e6afa Sep 15 16:39:54 devstack sudo[107024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:54 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-d490afec-87da-4c8a-bbd2-d2ea2d5e72c9 tempest-VolumeImageDependencyTests-1330175006 None] Created reservations ['d0b5dcbf-c0c5-4a70-9b1d-3ff1c003cbaf', 'd03610e7-8e6f-43a3-941c-8016136b510d', 'bd2bdab4-ae8e-41f2-b9dc-8f2cc69552dc', '86a01573-f6d5-4c89-bede-a35fe9fc0001'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:39:54 devstack sudo[107023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-52d8b18b-8f27-40d2-a0d7-0c9a47c0b1aa Sep 15 16:39:54 devstack sudo[107023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-d490afec-87da-4c8a-bbd2-d2ea2d5e72c9 tempest-VolumeImageDependencyTests-1330175006 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:39:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-d490afec-87da-4c8a-bbd2-d2ea2d5e72c9 tempest-VolumeImageDependencyTests-1330175006 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:39:54 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-d490afec-87da-4c8a-bbd2-d2ea2d5e72c9 tempest-VolumeImageDependencyTests-1330175006 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:39:54 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-d490afec-87da-4c8a-bbd2-d2ea2d5e72c9 tempest-VolumeImageDependencyTests-1330175006 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:39:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-d490afec-87da-4c8a-bbd2-d2ea2d5e72c9 tempest-VolumeImageDependencyTests-1330175006 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:39:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d490afec-87da-4c8a-bbd2-d2ea2d5e72c9 tempest-VolumeImageDependencyTests-1330175006 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:54 devstack sudo[107027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:39:54 devstack sudo[107027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:54 devstack sudo[107023]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-6ac3cdf7-d9ac-4eec-bc89-1a27aa35f73a tempest-CreateVolumesFromSourceVolumeTest-983402188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-52d8b18b-8f27-40d2-a0d7-0c9a47c0b1aa" returned: 0 in 0.473s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-6ac3cdf7-d9ac-4eec-bc89-1a27aa35f73a tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-52d8b18b-8f27-40d2-a0d7-0c9a47c0b1aa {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:54 devstack sudo[107024]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-bc8946af-abe2-438e-828c-259be330c587 tempest-ProjectMemberTests-1855156353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-514b91ee-3704-4a6a-ac97-8e89377f675e.9c614e56-04ed-44ac-8adc-6f65e29e6afa" returned: 0 in 0.480s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-bc8946af-abe2-438e-828c-259be330c587 tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-514b91ee-3704-4a6a-ac97-8e89377f675e.9c614e56-04ed-44ac-8adc-6f65e29e6afa {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:54 devstack sudo[107037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-52d8b18b-8f27-40d2-a0d7-0c9a47c0b1aa Sep 15 16:39:54 devstack sudo[107037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:54 devstack sudo[107027]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d490afec-87da-4c8a-bbd2-d2ea2d5e72c9 tempest-VolumeImageDependencyTests-1330175006 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.347s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:54 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-d490afec-87da-4c8a-bbd2-d2ea2d5e72c9 tempest-VolumeImageDependencyTests-1330175006 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:39:54 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-d490afec-87da-4c8a-bbd2-d2ea2d5e72c9 tempest-VolumeImageDependencyTests-1330175006 None] Deleted volume successfully. Sep 15 16:39:54 devstack sudo[107039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-514b91ee-3704-4a6a-ac97-8e89377f675e.9c614e56-04ed-44ac-8adc-6f65e29e6afa Sep 15 16:39:54 devstack sudo[107039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:54 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-d490afec-87da-4c8a-bbd2-d2ea2d5e72c9 tempest-VolumeImageDependencyTests-1330175006 None] Lock "cinder-dd20a52d-6aea-4c91-b49a-38810b893b33-delete_volume" released by "delete_volume" :: held 1.472s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:39:54 devstack sudo[107037]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-6ac3cdf7-d9ac-4eec-bc89-1a27aa35f73a tempest-CreateVolumesFromSourceVolumeTest-983402188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-52d8b18b-8f27-40d2-a0d7-0c9a47c0b1aa" returned: 0 in 0.316s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:54 devstack sudo[107039]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:54 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-6ac3cdf7-d9ac-4eec-bc89-1a27aa35f73a tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Lock "cinder-quobyte-52d8b18b-8f27-40d2-a0d7-0c9a47c0b1aa" released by "delete_volume" :: held 0.867s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:39:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-bc8946af-abe2-438e-828c-259be330c587 tempest-ProjectMemberTests-1855156353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-514b91ee-3704-4a6a-ac97-8e89377f675e.9c614e56-04ed-44ac-8adc-6f65e29e6afa" returned: 0 in 0.325s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:54 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-bc8946af-abe2-438e-828c-259be330c587 tempest-ProjectMemberTests-1855156353 None] Lock "cinder-quobyte-9c614e56-04ed-44ac-8adc-6f65e29e6afa" released by "_delete_snapshot" :: held 1.850s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:39:54 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-bc8946af-abe2-438e-828c-259be330c587 tempest-ProjectMemberTests-1855156353 None] Lock "cinder-quobyte-514b91ee-3704-4a6a-ac97-8e89377f675e" released by "delete_snapshot" :: held 1.885s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:39:55 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-6ac3cdf7-d9ac-4eec-bc89-1a27aa35f73a tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Created reservations ['842e7840-ab08-4c41-9baa-6462f241b405', '8361f0a7-1201-456b-85d8-4e56a9feec89', '737b66c0-5a8a-4976-89a9-9f3403b2c553', 'e2aeb1cf-3af0-4634-b7c3-f9c67e6f6b3c'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:39:55 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-bc8946af-abe2-438e-828c-259be330c587 tempest-ProjectMemberTests-1855156353 None] Created reservations ['20b28986-22af-48cf-87a9-3893fffde5e0', '7a78470a-e96a-4f48-aa27-738fbb72022f', 'dfa4e3b4-f6e3-4d45-bc8f-be8b76d4fd77', 'f18852ca-f7cb-4201-8037-095679e367ad'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:39:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-6ac3cdf7-d9ac-4eec-bc89-1a27aa35f73a tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:39:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-6ac3cdf7-d9ac-4eec-bc89-1a27aa35f73a tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:39:55 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-6ac3cdf7-d9ac-4eec-bc89-1a27aa35f73a tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:39:55 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-6ac3cdf7-d9ac-4eec-bc89-1a27aa35f73a tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:39:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-6ac3cdf7-d9ac-4eec-bc89-1a27aa35f73a tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:39:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-6ac3cdf7-d9ac-4eec-bc89-1a27aa35f73a tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:55 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-bc8946af-abe2-438e-828c-259be330c587 tempest-ProjectMemberTests-1855156353 None] Delete snapshot completed successfully. Sep 15 16:39:55 devstack sudo[107043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:39:55 devstack sudo[107043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:55 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-bc8946af-abe2-438e-828c-259be330c587 tempest-ProjectMemberTests-1855156353 None] Lock "cinder-9c614e56-04ed-44ac-8adc-6f65e29e6afa-delete_snapshot" released by "delete_snapshot" :: held 2.192s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:39:55 devstack sudo[107043]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-6ac3cdf7-d9ac-4eec-bc89-1a27aa35f73a tempest-CreateVolumesFromSourceVolumeTest-983402188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.285s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:55 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-6ac3cdf7-d9ac-4eec-bc89-1a27aa35f73a tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:39:55 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-6ac3cdf7-d9ac-4eec-bc89-1a27aa35f73a tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Deleted volume successfully. Sep 15 16:39:55 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-6ac3cdf7-d9ac-4eec-bc89-1a27aa35f73a tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Lock "cinder-52d8b18b-8f27-40d2-a0d7-0c9a47c0b1aa-delete_volume" released by "delete_volume" :: held 1.554s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:39:56 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-aa65f2a9-89f0-4e37-9c58-c2ec3c4635a3 tempest-ProjectMemberTests-1855156353 None] Acquiring lock "cinder-514b91ee-3704-4a6a-ac97-8e89377f675e-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:39:56 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-aa65f2a9-89f0-4e37-9c58-c2ec3c4635a3 tempest-ProjectMemberTests-1855156353 None] Lock "cinder-514b91ee-3704-4a6a-ac97-8e89377f675e-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:39:56 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-94197a24-652a-426d-a733-a55a189faff2 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Acquiring lock "cinder-dcb07027-338e-49ed-b34a-1aeb25fb9a2f-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:39:56 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-94197a24-652a-426d-a733-a55a189faff2 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Lock "cinder-dcb07027-338e-49ed-b34a-1aeb25fb9a2f-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:39:56 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-aa65f2a9-89f0-4e37-9c58-c2ec3c4635a3 tempest-ProjectMemberTests-1855156353 None] Acquiring lock "cinder-quobyte-514b91ee-3704-4a6a-ac97-8e89377f675e" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:39:56 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-94197a24-652a-426d-a733-a55a189faff2 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Acquiring lock "cinder-quobyte-dcb07027-338e-49ed-b34a-1aeb25fb9a2f" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:39:56 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-aa65f2a9-89f0-4e37-9c58-c2ec3c4635a3 tempest-ProjectMemberTests-1855156353 None] Lock "cinder-quobyte-514b91ee-3704-4a6a-ac97-8e89377f675e" acquired by "delete_volume" :: waited 0.026s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:39:56 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-94197a24-652a-426d-a733-a55a189faff2 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Lock "cinder-quobyte-dcb07027-338e-49ed-b34a-1aeb25fb9a2f" acquired by "delete_volume" :: waited 0.056s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:39:56 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa46bcc2-8923-4ef6-8d67-2ddee0a73fb6]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:39:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-aa65f2a9-89f0-4e37-9c58-c2ec3c4635a3 tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-514b91ee-3704-4a6a-ac97-8e89377f675e {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:56 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b0ecb0a-16dc-47e0-8ec2-ea51e728e1f1]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:39:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-94197a24-652a-426d-a733-a55a189faff2 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-dcb07027-338e-49ed-b34a-1aeb25fb9a2f {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:56 devstack sudo[107046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-514b91ee-3704-4a6a-ac97-8e89377f675e Sep 15 16:39:56 devstack sudo[107046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:56 devstack sudo[107047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-dcb07027-338e-49ed-b34a-1aeb25fb9a2f Sep 15 16:39:56 devstack sudo[107047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:56 devstack sudo[107046]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-aa65f2a9-89f0-4e37-9c58-c2ec3c4635a3 tempest-ProjectMemberTests-1855156353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-514b91ee-3704-4a6a-ac97-8e89377f675e" returned: 0 in 0.478s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:56 devstack sudo[107047]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-aa65f2a9-89f0-4e37-9c58-c2ec3c4635a3 tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-514b91ee-3704-4a6a-ac97-8e89377f675e {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-94197a24-652a-426d-a733-a55a189faff2 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-dcb07027-338e-49ed-b34a-1aeb25fb9a2f" returned: 0 in 0.471s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-94197a24-652a-426d-a733-a55a189faff2 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-dcb07027-338e-49ed-b34a-1aeb25fb9a2f {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:56 devstack sudo[107056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-514b91ee-3704-4a6a-ac97-8e89377f675e Sep 15 16:39:56 devstack sudo[107056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:56 devstack sudo[107057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-dcb07027-338e-49ed-b34a-1aeb25fb9a2f Sep 15 16:39:56 devstack sudo[107057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:57 devstack sudo[107056]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-aa65f2a9-89f0-4e37-9c58-c2ec3c4635a3 tempest-ProjectMemberTests-1855156353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-514b91ee-3704-4a6a-ac97-8e89377f675e" returned: 0 in 0.282s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:57 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-aa65f2a9-89f0-4e37-9c58-c2ec3c4635a3 tempest-ProjectMemberTests-1855156353 None] Lock "cinder-quobyte-514b91ee-3704-4a6a-ac97-8e89377f675e" released by "delete_volume" :: held 0.850s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:39:57 devstack sudo[107057]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-94197a24-652a-426d-a733-a55a189faff2 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-dcb07027-338e-49ed-b34a-1aeb25fb9a2f" returned: 0 in 0.304s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:57 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-94197a24-652a-426d-a733-a55a189faff2 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Lock "cinder-quobyte-dcb07027-338e-49ed-b34a-1aeb25fb9a2f" released by "delete_volume" :: held 0.834s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:39:57 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-aa65f2a9-89f0-4e37-9c58-c2ec3c4635a3 tempest-ProjectMemberTests-1855156353 None] Created reservations ['d6233789-32a7-40cf-a8e3-beb000c22901', '0964972f-6b66-4216-b6dc-196bdbf6cee3', '7264fdf3-4961-430c-9c1b-b0a553da5d22', '24e793e5-d658-42be-ae9b-049b45a66953'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:39:57 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-94197a24-652a-426d-a733-a55a189faff2 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Created reservations ['e5a2e202-dddb-46a0-91ad-12903c2032e0', 'bac09db4-6c89-489c-a32c-464bb4658521', 'f8a22968-80c2-4512-9d48-cf804778331f', '6dcfa0c3-a2ea-428c-9df9-eb688cb521f2'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:39:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-aa65f2a9-89f0-4e37-9c58-c2ec3c4635a3 tempest-ProjectMemberTests-1855156353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:39:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-aa65f2a9-89f0-4e37-9c58-c2ec3c4635a3 tempest-ProjectMemberTests-1855156353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:39:57 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-aa65f2a9-89f0-4e37-9c58-c2ec3c4635a3 tempest-ProjectMemberTests-1855156353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:39:57 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-aa65f2a9-89f0-4e37-9c58-c2ec3c4635a3 tempest-ProjectMemberTests-1855156353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:39:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-aa65f2a9-89f0-4e37-9c58-c2ec3c4635a3 tempest-ProjectMemberTests-1855156353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:39:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-aa65f2a9-89f0-4e37-9c58-c2ec3c4635a3 tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-94197a24-652a-426d-a733-a55a189faff2 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:39:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-94197a24-652a-426d-a733-a55a189faff2 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:39:57 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-94197a24-652a-426d-a733-a55a189faff2 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:39:57 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-94197a24-652a-426d-a733-a55a189faff2 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:39:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-94197a24-652a-426d-a733-a55a189faff2 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:39:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-94197a24-652a-426d-a733-a55a189faff2 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:57 devstack sudo[107063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:39:57 devstack sudo[107063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:57 devstack sudo[107064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:39:57 devstack sudo[107064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:57 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-42a6de36-7239-4f97-8711-30a54eb179fd tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Acquiring lock "cinder-b9c1d8a2-7109-4e9b-a1d5-4dc6f9c5ce95-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:39:57 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-42a6de36-7239-4f97-8711-30a54eb179fd tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Lock "cinder-b9c1d8a2-7109-4e9b-a1d5-4dc6f9c5ce95-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:39:57 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-42a6de36-7239-4f97-8711-30a54eb179fd tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Acquiring lock "cinder-quobyte-b9c1d8a2-7109-4e9b-a1d5-4dc6f9c5ce95" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:39:57 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-42a6de36-7239-4f97-8711-30a54eb179fd tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Lock "cinder-quobyte-b9c1d8a2-7109-4e9b-a1d5-4dc6f9c5ce95" acquired by "delete_volume" :: waited 0.028s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:39:57 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[30bd59ca-f70b-4006-9455-9d59e70817b0]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:39:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-42a6de36-7239-4f97-8711-30a54eb179fd tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b9c1d8a2-7109-4e9b-a1d5-4dc6f9c5ce95 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:57 devstack sudo[107064]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-94197a24-652a-426d-a733-a55a189faff2 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.432s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:57 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-94197a24-652a-426d-a733-a55a189faff2 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:39:57 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-94197a24-652a-426d-a733-a55a189faff2 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Deleted volume successfully. Sep 15 16:39:57 devstack sudo[107063]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-aa65f2a9-89f0-4e37-9c58-c2ec3c4635a3 tempest-ProjectMemberTests-1855156353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.538s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:57 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-aa65f2a9-89f0-4e37-9c58-c2ec3c4635a3 tempest-ProjectMemberTests-1855156353 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:39:57 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-94197a24-652a-426d-a733-a55a189faff2 tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Lock "cinder-dcb07027-338e-49ed-b34a-1aeb25fb9a2f-delete_volume" released by "delete_volume" :: held 1.680s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:39:58 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-aa65f2a9-89f0-4e37-9c58-c2ec3c4635a3 tempest-ProjectMemberTests-1855156353 None] Deleted volume successfully. Sep 15 16:39:58 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-aa65f2a9-89f0-4e37-9c58-c2ec3c4635a3 tempest-ProjectMemberTests-1855156353 None] Lock "cinder-514b91ee-3704-4a6a-ac97-8e89377f675e-delete_volume" released by "delete_volume" :: held 1.758s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:39:58 devstack sudo[107067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b9c1d8a2-7109-4e9b-a1d5-4dc6f9c5ce95 Sep 15 16:39:58 devstack sudo[107067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:58 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d68fe4d-e6fe-4f1b-aa4f-efe71668e987 tempest-ProjectMemberTests-1855156353 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:39:58 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5d68fe4d-e6fe-4f1b-aa4f-efe71668e987 tempest-ProjectMemberTests-1855156353 None] Flow 'volume_create_manager' (388909ca-ceac-440d-8fe0-3959f6d45078) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:39:58 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5d68fe4d-e6fe-4f1b-aa4f-efe71668e987 tempest-ProjectMemberTests-1855156353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf6cfcfa-e0a7-49ad-8324-477fb2a88785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:58 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5d68fe4d-e6fe-4f1b-aa4f-efe71668e987 tempest-ProjectMemberTests-1855156353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bf6cfcfa-e0a7-49ad-8324-477fb2a88785) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:39:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-864447743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52bc9fd8-6acd-4b3e-a9be-e488d73cbf4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a303ec1076004f4db43523c2f7b6a446',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:39:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:39:58Z,use_quota=True,user_id='d9953555b80c481b9eaabbc7d416d0b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:58 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5d68fe4d-e6fe-4f1b-aa4f-efe71668e987 tempest-ProjectMemberTests-1855156353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1340b0e-883d-4f3c-b99a-fe9cba3b8d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:58 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5d68fe4d-e6fe-4f1b-aa4f-efe71668e987 tempest-ProjectMemberTests-1855156353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1340b0e-883d-4f3c-b99a-fe9cba3b8d32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:58 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5d68fe4d-e6fe-4f1b-aa4f-efe71668e987 tempest-ProjectMemberTests-1855156353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cf33362-0388-42d3-b863-8fa48e564548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:58 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5d68fe4d-e6fe-4f1b-aa4f-efe71668e987 tempest-ProjectMemberTests-1855156353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2cf33362-0388-42d3-b863-8fa48e564548) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52bc9fd8-6acd-4b3e-a9be-e488d73cbf4c', 'volume_name': 'volume-52bc9fd8-6acd-4b3e-a9be-e488d73cbf4c', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:58 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5d68fe4d-e6fe-4f1b-aa4f-efe71668e987 tempest-ProjectMemberTests-1855156353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1aa76f58-1bda-4dda-a3b0-6c7ff853b17b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:58 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5d68fe4d-e6fe-4f1b-aa4f-efe71668e987 tempest-ProjectMemberTests-1855156353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1aa76f58-1bda-4dda-a3b0-6c7ff853b17b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:58 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5d68fe4d-e6fe-4f1b-aa4f-efe71668e987 tempest-ProjectMemberTests-1855156353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47e53709-d620-4e02-91cb-e5fa37bd8777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:58 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-5d68fe4d-e6fe-4f1b-aa4f-efe71668e987 tempest-ProjectMemberTests-1855156353 None] Volume 52bc9fd8-6acd-4b3e-a9be-e488d73cbf4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52bc9fd8-6acd-4b3e-a9be-e488d73cbf4c', 'volume_size': 1} Sep 15 16:39:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-5d68fe4d-e6fe-4f1b-aa4f-efe71668e987 tempest-ProjectMemberTests-1855156353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:39:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-5d68fe4d-e6fe-4f1b-aa4f-efe71668e987 tempest-ProjectMemberTests-1855156353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:39:58 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-5d68fe4d-e6fe-4f1b-aa4f-efe71668e987 tempest-ProjectMemberTests-1855156353 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:39:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-864447743',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52bc9fd8-6acd-4b3e-a9be-e488d73cbf4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a303ec1076004f4db43523c2f7b6a446',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:39:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:39:58Z,use_quota=True,user_id='d9953555b80c481b9eaabbc7d416d0b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:39:58 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-5d68fe4d-e6fe-4f1b-aa4f-efe71668e987 tempest-ProjectMemberTests-1855156353 None] Creating volume 52bc9fd8-6acd-4b3e-a9be-e488d73cbf4c {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:39:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-5d68fe4d-e6fe-4f1b-aa4f-efe71668e987 tempest-ProjectMemberTests-1855156353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:39:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-5d68fe4d-e6fe-4f1b-aa4f-efe71668e987 tempest-ProjectMemberTests-1855156353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:39:58 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-5d68fe4d-e6fe-4f1b-aa4f-efe71668e987 tempest-ProjectMemberTests-1855156353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:39:58 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-5d68fe4d-e6fe-4f1b-aa4f-efe71668e987 tempest-ProjectMemberTests-1855156353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:39:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-5d68fe4d-e6fe-4f1b-aa4f-efe71668e987 tempest-ProjectMemberTests-1855156353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:39:58 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-5d68fe4d-e6fe-4f1b-aa4f-efe71668e987 tempest-ProjectMemberTests-1855156353 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:39:58 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-5d68fe4d-e6fe-4f1b-aa4f-efe71668e987 tempest-ProjectMemberTests-1855156353 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:39:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5d68fe4d-e6fe-4f1b-aa4f-efe71668e987 tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-52bc9fd8-6acd-4b3e-a9be-e488d73cbf4c 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:58 devstack sudo[107074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-52bc9fd8-6acd-4b3e-a9be-e488d73cbf4c 1073741824 Sep 15 16:39:58 devstack sudo[107074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:58 devstack sudo[107067]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-42a6de36-7239-4f97-8711-30a54eb179fd tempest-CreateVolumesFromSourceVolumeTest-983402188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b9c1d8a2-7109-4e9b-a1d5-4dc6f9c5ce95" returned: 0 in 0.608s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-42a6de36-7239-4f97-8711-30a54eb179fd tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b9c1d8a2-7109-4e9b-a1d5-4dc6f9c5ce95 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:58 devstack sudo[107076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b9c1d8a2-7109-4e9b-a1d5-4dc6f9c5ce95 Sep 15 16:39:58 devstack sudo[107076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:58 devstack sudo[107076]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-42a6de36-7239-4f97-8711-30a54eb179fd tempest-CreateVolumesFromSourceVolumeTest-983402188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b9c1d8a2-7109-4e9b-a1d5-4dc6f9c5ce95" returned: 0 in 0.269s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:58 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-42a6de36-7239-4f97-8711-30a54eb179fd tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Lock "cinder-quobyte-b9c1d8a2-7109-4e9b-a1d5-4dc6f9c5ce95" released by "delete_volume" :: held 0.969s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:39:58 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-42a6de36-7239-4f97-8711-30a54eb179fd tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Created reservations ['16a70d5d-24d7-41bb-b37a-9c55d67d62d9', 'e86de041-4209-4b4c-aae6-48f019be497d', '616defe1-1071-4177-a7f2-dc110eb6c790', 'd3fbe9e4-fbd7-48b3-84f1-7b6ae177463c'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:39:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-42a6de36-7239-4f97-8711-30a54eb179fd tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:39:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-42a6de36-7239-4f97-8711-30a54eb179fd tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:39:58 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-42a6de36-7239-4f97-8711-30a54eb179fd tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:39:58 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-42a6de36-7239-4f97-8711-30a54eb179fd tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:39:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-42a6de36-7239-4f97-8711-30a54eb179fd tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:39:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-42a6de36-7239-4f97-8711-30a54eb179fd tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:58 devstack sudo[107083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:39:58 devstack sudo[107083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:58 devstack sudo[107074]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5d68fe4d-e6fe-4f1b-aa4f-efe71668e987 tempest-ProjectMemberTests-1855156353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-52bc9fd8-6acd-4b3e-a9be-e488d73cbf4c 1073741824" returned: 0 in 0.601s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5d68fe4d-e6fe-4f1b-aa4f-efe71668e987 tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-52bc9fd8-6acd-4b3e-a9be-e488d73cbf4c {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:59 devstack sudo[107085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-52bc9fd8-6acd-4b3e-a9be-e488d73cbf4c Sep 15 16:39:59 devstack sudo[107085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:39:59 devstack sudo[107083]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:59 devstack sudo[107085]: pam_unix(sudo:session): session closed for user root Sep 15 16:39:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5d68fe4d-e6fe-4f1b-aa4f-efe71668e987 tempest-ProjectMemberTests-1855156353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-52bc9fd8-6acd-4b3e-a9be-e488d73cbf4c" returned: 0 in 0.297s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:59 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-5d68fe4d-e6fe-4f1b-aa4f-efe71668e987 tempest-ProjectMemberTests-1855156353 None] <== create_volume: return (971ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:39:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-5d68fe4d-e6fe-4f1b-aa4f-efe71668e987 tempest-ProjectMemberTests-1855156353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.974s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:39:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-42a6de36-7239-4f97-8711-30a54eb179fd tempest-CreateVolumesFromSourceVolumeTest-983402188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.454s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:39:59 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-42a6de36-7239-4f97-8711-30a54eb179fd tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:39:59 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5d68fe4d-e6fe-4f1b-aa4f-efe71668e987 tempest-ProjectMemberTests-1855156353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47e53709-d620-4e02-91cb-e5fa37bd8777) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52bc9fd8-6acd-4b3e-a9be-e488d73cbf4c', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:59 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5d68fe4d-e6fe-4f1b-aa4f-efe71668e987 tempest-ProjectMemberTests-1855156353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fb59e6e-b2d8-4917-abbe-1471575df5e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:39:59 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-42a6de36-7239-4f97-8711-30a54eb179fd tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Deleted volume successfully. Sep 15 16:39:59 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-5d68fe4d-e6fe-4f1b-aa4f-efe71668e987 tempest-ProjectMemberTests-1855156353 None] Volume volume-52bc9fd8-6acd-4b3e-a9be-e488d73cbf4c (52bc9fd8-6acd-4b3e-a9be-e488d73cbf4c): created successfully Sep 15 16:39:59 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5d68fe4d-e6fe-4f1b-aa4f-efe71668e987 tempest-ProjectMemberTests-1855156353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fb59e6e-b2d8-4917-abbe-1471575df5e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:39:59 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-5d68fe4d-e6fe-4f1b-aa4f-efe71668e987 tempest-ProjectMemberTests-1855156353 None] Flow 'volume_create_manager' (388909ca-ceac-440d-8fe0-3959f6d45078) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:39:59 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-42a6de36-7239-4f97-8711-30a54eb179fd tempest-CreateVolumesFromSourceVolumeTest-983402188 None] Lock "cinder-b9c1d8a2-7109-4e9b-a1d5-4dc6f9c5ce95-delete_volume" released by "delete_volume" :: held 1.765s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:39:59 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-5d68fe4d-e6fe-4f1b-aa4f-efe71668e987 tempest-ProjectMemberTests-1855156353 None] Created volume successfully. Sep 15 16:39:59 devstack cinder-volume[86082]: DEBUG oslo_service.periodic_task [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86082) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 15 16:39:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:39:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:39:59 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:39:59 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:39:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:39:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:39:59 devstack sudo[107089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:39:59 devstack sudo[107089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:00 devstack sudo[107089]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.272s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:00 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:40:00 devstack cinder-volume[86082]: DEBUG oslo_service.periodic_task [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Running periodic task VolumeManager._thread_info {{(pid=86082) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 15 16:40:00 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] thread count: 29 {{(pid=86082) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 15 16:40:00 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] thread info: [<_MainThread(MainThread, started 124875935469696)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86082) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 15 16:40:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c8979125-f48e-4f4f-bd70-31e3fd3854da tempest-ProjectMemberTests-1855156353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:40:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c8979125-f48e-4f4f-bd70-31e3fd3854da tempest-ProjectMemberTests-1855156353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:40:00 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-c8979125-f48e-4f4f-bd70-31e3fd3854da tempest-ProjectMemberTests-1855156353 None] Creating offline snapshot 1468bd92-23a5-4b18-ad1a-3b7ff6a76b98 of volume 52bc9fd8-6acd-4b3e-a9be-e488d73cbf4c {{(pid=86082) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 15 16:40:00 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd470d7d-bbc4-43c4-9e9a-3e3afd241e4f]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:40:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c8979125-f48e-4f4f-bd70-31e3fd3854da tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-52bc9fd8-6acd-4b3e-a9be-e488d73cbf4c {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:00 devstack sudo[107092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-52bc9fd8-6acd-4b3e-a9be-e488d73cbf4c Sep 15 16:40:00 devstack sudo[107092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:01 devstack sudo[107092]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c8979125-f48e-4f4f-bd70-31e3fd3854da tempest-ProjectMemberTests-1855156353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-52bc9fd8-6acd-4b3e-a9be-e488d73cbf4c" returned: 0 in 0.571s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c8979125-f48e-4f4f-bd70-31e3fd3854da tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-52bc9fd8-6acd-4b3e-a9be-e488d73cbf4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-52bc9fd8-6acd-4b3e-a9be-e488d73cbf4c.1468bd92-23a5-4b18-ad1a-3b7ff6a76b98 1G {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:01 devstack sudo[107097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-52bc9fd8-6acd-4b3e-a9be-e488d73cbf4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-52bc9fd8-6acd-4b3e-a9be-e488d73cbf4c.1468bd92-23a5-4b18-ad1a-3b7ff6a76b98 1G Sep 15 16:40:01 devstack sudo[107097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:01 devstack sudo[107097]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c8979125-f48e-4f4f-bd70-31e3fd3854da tempest-ProjectMemberTests-1855156353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-52bc9fd8-6acd-4b3e-a9be-e488d73cbf4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-52bc9fd8-6acd-4b3e-a9be-e488d73cbf4c.1468bd92-23a5-4b18-ad1a-3b7ff6a76b98 1G" returned: 0 in 0.583s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c8979125-f48e-4f4f-bd70-31e3fd3854da tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52bc9fd8-6acd-4b3e-a9be-e488d73cbf4c -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-52bc9fd8-6acd-4b3e-a9be-e488d73cbf4c.1468bd92-23a5-4b18-ad1a-3b7ff6a76b98 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:01 devstack sudo[107103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52bc9fd8-6acd-4b3e-a9be-e488d73cbf4c -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-52bc9fd8-6acd-4b3e-a9be-e488d73cbf4c.1468bd92-23a5-4b18-ad1a-3b7ff6a76b98 Sep 15 16:40:01 devstack sudo[107103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:02 devstack sudo[107103]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c8979125-f48e-4f4f-bd70-31e3fd3854da tempest-ProjectMemberTests-1855156353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-52bc9fd8-6acd-4b3e-a9be-e488d73cbf4c -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-52bc9fd8-6acd-4b3e-a9be-e488d73cbf4c.1468bd92-23a5-4b18-ad1a-3b7ff6a76b98" returned: 0 in 0.400s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:02 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-c8979125-f48e-4f4f-bd70-31e3fd3854da tempest-ProjectMemberTests-1855156353 None] /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-52bc9fd8-6acd-4b3e-a9be-e488d73cbf4c.1468bd92-23a5-4b18-ad1a-3b7ff6a76b98 is being set with open permissions: ugo+rw Sep 15 16:40:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c8979125-f48e-4f4f-bd70-31e3fd3854da tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-52bc9fd8-6acd-4b3e-a9be-e488d73cbf4c.1468bd92-23a5-4b18-ad1a-3b7ff6a76b98 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:02 devstack sudo[107108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-52bc9fd8-6acd-4b3e-a9be-e488d73cbf4c.1468bd92-23a5-4b18-ad1a-3b7ff6a76b98 Sep 15 16:40:02 devstack sudo[107108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:02 devstack sudo[107108]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c8979125-f48e-4f4f-bd70-31e3fd3854da tempest-ProjectMemberTests-1855156353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-52bc9fd8-6acd-4b3e-a9be-e488d73cbf4c.1468bd92-23a5-4b18-ad1a-3b7ff6a76b98" returned: 0 in 0.281s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c8979125-f48e-4f4f-bd70-31e3fd3854da tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-52bc9fd8-6acd-4b3e-a9be-e488d73cbf4c.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:02 devstack sudo[107111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-52bc9fd8-6acd-4b3e-a9be-e488d73cbf4c.info Sep 15 16:40:02 devstack sudo[107111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:02 devstack sudo[107111]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c8979125-f48e-4f4f-bd70-31e3fd3854da tempest-ProjectMemberTests-1855156353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-52bc9fd8-6acd-4b3e-a9be-e488d73cbf4c.info" returned: 0 in 0.293s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:02 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-c8979125-f48e-4f4f-bd70-31e3fd3854da tempest-ProjectMemberTests-1855156353 None] /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-52bc9fd8-6acd-4b3e-a9be-e488d73cbf4c.info is being set with open permissions: ugo+rw Sep 15 16:40:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c8979125-f48e-4f4f-bd70-31e3fd3854da tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-52bc9fd8-6acd-4b3e-a9be-e488d73cbf4c.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:02 devstack sudo[107114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-52bc9fd8-6acd-4b3e-a9be-e488d73cbf4c.info Sep 15 16:40:02 devstack sudo[107114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:03 devstack sudo[107114]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c8979125-f48e-4f4f-bd70-31e3fd3854da tempest-ProjectMemberTests-1855156353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-52bc9fd8-6acd-4b3e-a9be-e488d73cbf4c.info" returned: 0 in 0.288s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c8979125-f48e-4f4f-bd70-31e3fd3854da tempest-ProjectMemberTests-1855156353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.546s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:40:03 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-c8979125-f48e-4f4f-bd70-31e3fd3854da tempest-ProjectMemberTests-1855156353 None] Create snapshot completed successfully Sep 15 16:40:03 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-bb1a9c1e-130f-42b3-9fce-2448d3e2bd8e tempest-ProjectMemberTests-1855156353 None] Acquiring lock "cinder-1468bd92-23a5-4b18-ad1a-3b7ff6a76b98-delete_snapshot" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:40:03 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-bb1a9c1e-130f-42b3-9fce-2448d3e2bd8e tempest-ProjectMemberTests-1855156353 None] Lock "cinder-1468bd92-23a5-4b18-ad1a-3b7ff6a76b98-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:40:03 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-bb1a9c1e-130f-42b3-9fce-2448d3e2bd8e tempest-ProjectMemberTests-1855156353 None] Acquiring lock "cinder-quobyte-52bc9fd8-6acd-4b3e-a9be-e488d73cbf4c" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:40:03 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-bb1a9c1e-130f-42b3-9fce-2448d3e2bd8e tempest-ProjectMemberTests-1855156353 None] Lock "cinder-quobyte-52bc9fd8-6acd-4b3e-a9be-e488d73cbf4c" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:40:03 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-bb1a9c1e-130f-42b3-9fce-2448d3e2bd8e tempest-ProjectMemberTests-1855156353 None] Acquiring lock "cinder-quobyte-1468bd92-23a5-4b18-ad1a-3b7ff6a76b98" by "_delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:40:03 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-bb1a9c1e-130f-42b3-9fce-2448d3e2bd8e tempest-ProjectMemberTests-1855156353 None] Lock "cinder-quobyte-1468bd92-23a5-4b18-ad1a-3b7ff6a76b98" acquired by "_delete_snapshot" :: waited 0.045s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:40:03 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-bb1a9c1e-130f-42b3-9fce-2448d3e2bd8e tempest-ProjectMemberTests-1855156353 None] Deleting offline snapshot 1468bd92-23a5-4b18-ad1a-3b7ff6a76b98 of volume 52bc9fd8-6acd-4b3e-a9be-e488d73cbf4c {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 15 16:40:03 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-bb1a9c1e-130f-42b3-9fce-2448d3e2bd8e tempest-ProjectMemberTests-1855156353 None] snapshot_file for this snap is: volume-52bc9fd8-6acd-4b3e-a9be-e488d73cbf4c.1468bd92-23a5-4b18-ad1a-3b7ff6a76b98 {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 15 16:40:03 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f429992-a805-4b7f-bc2f-d09a28f32118]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:40:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-bb1a9c1e-130f-42b3-9fce-2448d3e2bd8e tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-52bc9fd8-6acd-4b3e-a9be-e488d73cbf4c.1468bd92-23a5-4b18-ad1a-3b7ff6a76b98 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:04 devstack sudo[107117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-52bc9fd8-6acd-4b3e-a9be-e488d73cbf4c.1468bd92-23a5-4b18-ad1a-3b7ff6a76b98 Sep 15 16:40:04 devstack sudo[107117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:04 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8f96768-bb44-4d24-9856-f6d77969577b tempest-VolumeDependencyTests-804367213 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:40:04 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c8f96768-bb44-4d24-9856-f6d77969577b tempest-VolumeDependencyTests-804367213 None] Flow 'volume_create_manager' (ceafd0fd-3057-4396-aa20-857654c503cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:40:04 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c8f96768-bb44-4d24-9856-f6d77969577b tempest-VolumeDependencyTests-804367213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca795dbc-c8cd-4e8e-8c8f-684d83f1ee73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:40:04 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c8f96768-bb44-4d24-9856-f6d77969577b tempest-VolumeDependencyTests-804367213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca795dbc-c8cd-4e8e-8c8f-684d83f1ee73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:40:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1382908016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f5fa330-3bab-41e6-b208-255c853043fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c079e3aafae540eaa101f0301da9fa86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:40:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:40:04Z,use_quota=True,user_id='c8142ebcc0eb4b63817e952f0f4c3299',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:40:04 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c8f96768-bb44-4d24-9856-f6d77969577b tempest-VolumeDependencyTests-804367213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e39b9c6-8308-4ab6-92f6-80fba44a6fac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:40:04 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c8f96768-bb44-4d24-9856-f6d77969577b tempest-VolumeDependencyTests-804367213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e39b9c6-8308-4ab6-92f6-80fba44a6fac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:40:04 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c8f96768-bb44-4d24-9856-f6d77969577b tempest-VolumeDependencyTests-804367213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b194298d-e8b3-4403-adc5-9d641cd319c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:40:04 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c8f96768-bb44-4d24-9856-f6d77969577b tempest-VolumeDependencyTests-804367213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b194298d-e8b3-4403-adc5-9d641cd319c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f5fa330-3bab-41e6-b208-255c853043fa', 'volume_name': 'volume-0f5fa330-3bab-41e6-b208-255c853043fa', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:40:04 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c8f96768-bb44-4d24-9856-f6d77969577b tempest-VolumeDependencyTests-804367213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fe80b09-d342-4da6-9875-26f648dce631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:40:04 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c8f96768-bb44-4d24-9856-f6d77969577b tempest-VolumeDependencyTests-804367213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fe80b09-d342-4da6-9875-26f648dce631) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:40:04 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c8f96768-bb44-4d24-9856-f6d77969577b tempest-VolumeDependencyTests-804367213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ad04dfe-565a-46e3-829d-70e9d6bf27fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:40:04 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-c8f96768-bb44-4d24-9856-f6d77969577b tempest-VolumeDependencyTests-804367213 None] Volume 0f5fa330-3bab-41e6-b208-255c853043fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f5fa330-3bab-41e6-b208-255c853043fa', 'volume_size': 1} Sep 15 16:40:04 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c8f96768-bb44-4d24-9856-f6d77969577b tempest-VolumeDependencyTests-804367213 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:40:04 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c8f96768-bb44-4d24-9856-f6d77969577b tempest-VolumeDependencyTests-804367213 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:40:04 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c8f96768-bb44-4d24-9856-f6d77969577b tempest-VolumeDependencyTests-804367213 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:40:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1382908016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f5fa330-3bab-41e6-b208-255c853043fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c079e3aafae540eaa101f0301da9fa86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:40:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:40:04Z,use_quota=True,user_id='c8142ebcc0eb4b63817e952f0f4c3299',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:40:04 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-c8f96768-bb44-4d24-9856-f6d77969577b tempest-VolumeDependencyTests-804367213 None] Creating volume 0f5fa330-3bab-41e6-b208-255c853043fa {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:40:04 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c8f96768-bb44-4d24-9856-f6d77969577b tempest-VolumeDependencyTests-804367213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:40:04 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c8f96768-bb44-4d24-9856-f6d77969577b tempest-VolumeDependencyTests-804367213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:40:04 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c8f96768-bb44-4d24-9856-f6d77969577b tempest-VolumeDependencyTests-804367213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:40:04 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c8f96768-bb44-4d24-9856-f6d77969577b tempest-VolumeDependencyTests-804367213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:40:04 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c8f96768-bb44-4d24-9856-f6d77969577b tempest-VolumeDependencyTests-804367213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:40:04 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c8f96768-bb44-4d24-9856-f6d77969577b tempest-VolumeDependencyTests-804367213 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:40:04 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-c8f96768-bb44-4d24-9856-f6d77969577b tempest-VolumeDependencyTests-804367213 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:40:04 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c8f96768-bb44-4d24-9856-f6d77969577b tempest-VolumeDependencyTests-804367213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0f5fa330-3bab-41e6-b208-255c853043fa 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:04 devstack sudo[107122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0f5fa330-3bab-41e6-b208-255c853043fa 1073741824 Sep 15 16:40:04 devstack sudo[107122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:04 devstack sudo[107117]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:04 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-bb1a9c1e-130f-42b3-9fce-2448d3e2bd8e tempest-ProjectMemberTests-1855156353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-52bc9fd8-6acd-4b3e-a9be-e488d73cbf4c.1468bd92-23a5-4b18-ad1a-3b7ff6a76b98" returned: 0 in 0.460s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:04 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-bb1a9c1e-130f-42b3-9fce-2448d3e2bd8e tempest-ProjectMemberTests-1855156353 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-52bc9fd8-6acd-4b3e-a9be-e488d73cbf4c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 16:40:04 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6bd6dba-0cd6-4fd9-8988-34ac9bc94fdc]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:40:04 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-bb1a9c1e-130f-42b3-9fce-2448d3e2bd8e tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-52bc9fd8-6acd-4b3e-a9be-e488d73cbf4c {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:04 devstack sudo[107124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-52bc9fd8-6acd-4b3e-a9be-e488d73cbf4c Sep 15 16:40:04 devstack sudo[107124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:04 devstack sudo[107122]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:04 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c8f96768-bb44-4d24-9856-f6d77969577b tempest-VolumeDependencyTests-804367213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0f5fa330-3bab-41e6-b208-255c853043fa 1073741824" returned: 0 in 0.605s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c8f96768-bb44-4d24-9856-f6d77969577b tempest-VolumeDependencyTests-804367213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0f5fa330-3bab-41e6-b208-255c853043fa {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:05 devstack sudo[107124]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-bb1a9c1e-130f-42b3-9fce-2448d3e2bd8e tempest-ProjectMemberTests-1855156353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-52bc9fd8-6acd-4b3e-a9be-e488d73cbf4c" returned: 0 in 0.568s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-bb1a9c1e-130f-42b3-9fce-2448d3e2bd8e tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-52bc9fd8-6acd-4b3e-a9be-e488d73cbf4c.1468bd92-23a5-4b18-ad1a-3b7ff6a76b98 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:05 devstack sudo[107139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0f5fa330-3bab-41e6-b208-255c853043fa Sep 15 16:40:05 devstack sudo[107139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:05 devstack sudo[107140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-52bc9fd8-6acd-4b3e-a9be-e488d73cbf4c.1468bd92-23a5-4b18-ad1a-3b7ff6a76b98 Sep 15 16:40:05 devstack sudo[107140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:05 devstack sudo[107139]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c8f96768-bb44-4d24-9856-f6d77969577b tempest-VolumeDependencyTests-804367213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0f5fa330-3bab-41e6-b208-255c853043fa" returned: 0 in 0.349s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:05 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c8f96768-bb44-4d24-9856-f6d77969577b tempest-VolumeDependencyTests-804367213 None] <== create_volume: return (1028ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:40:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c8f96768-bb44-4d24-9856-f6d77969577b tempest-VolumeDependencyTests-804367213 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.031s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:40:05 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c8f96768-bb44-4d24-9856-f6d77969577b tempest-VolumeDependencyTests-804367213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ad04dfe-565a-46e3-829d-70e9d6bf27fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f5fa330-3bab-41e6-b208-255c853043fa', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:40:05 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c8f96768-bb44-4d24-9856-f6d77969577b tempest-VolumeDependencyTests-804367213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31827906-9c9b-4246-b771-21624c19f50b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:40:05 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-c8f96768-bb44-4d24-9856-f6d77969577b tempest-VolumeDependencyTests-804367213 None] Volume volume-0f5fa330-3bab-41e6-b208-255c853043fa (0f5fa330-3bab-41e6-b208-255c853043fa): created successfully Sep 15 16:40:05 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c8f96768-bb44-4d24-9856-f6d77969577b tempest-VolumeDependencyTests-804367213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31827906-9c9b-4246-b771-21624c19f50b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:40:05 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c8f96768-bb44-4d24-9856-f6d77969577b tempest-VolumeDependencyTests-804367213 None] Flow 'volume_create_manager' (ceafd0fd-3057-4396-aa20-857654c503cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:40:05 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-c8f96768-bb44-4d24-9856-f6d77969577b tempest-VolumeDependencyTests-804367213 None] Created volume successfully. Sep 15 16:40:05 devstack sudo[107140]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-bb1a9c1e-130f-42b3-9fce-2448d3e2bd8e tempest-ProjectMemberTests-1855156353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-52bc9fd8-6acd-4b3e-a9be-e488d73cbf4c.1468bd92-23a5-4b18-ad1a-3b7ff6a76b98" returned: 0 in 0.471s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-bb1a9c1e-130f-42b3-9fce-2448d3e2bd8e tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-52bc9fd8-6acd-4b3e-a9be-e488d73cbf4c.1468bd92-23a5-4b18-ad1a-3b7ff6a76b98 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:05 devstack sudo[107148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-52bc9fd8-6acd-4b3e-a9be-e488d73cbf4c.1468bd92-23a5-4b18-ad1a-3b7ff6a76b98 Sep 15 16:40:05 devstack sudo[107148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:05 devstack sudo[107148]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-bb1a9c1e-130f-42b3-9fce-2448d3e2bd8e tempest-ProjectMemberTests-1855156353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-52bc9fd8-6acd-4b3e-a9be-e488d73cbf4c.1468bd92-23a5-4b18-ad1a-3b7ff6a76b98" returned: 0 in 0.279s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:05 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-bb1a9c1e-130f-42b3-9fce-2448d3e2bd8e tempest-ProjectMemberTests-1855156353 None] Lock "cinder-quobyte-1468bd92-23a5-4b18-ad1a-3b7ff6a76b98" released by "_delete_snapshot" :: held 1.952s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:40:05 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-bb1a9c1e-130f-42b3-9fce-2448d3e2bd8e tempest-ProjectMemberTests-1855156353 None] Lock "cinder-quobyte-52bc9fd8-6acd-4b3e-a9be-e488d73cbf4c" released by "delete_snapshot" :: held 2.010s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:40:05 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-bb1a9c1e-130f-42b3-9fce-2448d3e2bd8e tempest-ProjectMemberTests-1855156353 None] Created reservations ['57c13475-530b-4029-9de4-0a85b4e88012', '22b6256e-9b13-4629-96b4-9a98121e4fb5', 'b807f547-0e45-4cac-9d01-bc7a9f0aff66', '2ff83a81-7170-4c39-9e40-6f084bc13d5a'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:40:05 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-bb1a9c1e-130f-42b3-9fce-2448d3e2bd8e tempest-ProjectMemberTests-1855156353 None] Delete snapshot completed successfully. Sep 15 16:40:05 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-bb1a9c1e-130f-42b3-9fce-2448d3e2bd8e tempest-ProjectMemberTests-1855156353 None] Lock "cinder-1468bd92-23a5-4b18-ad1a-3b7ff6a76b98-delete_snapshot" released by "delete_snapshot" :: held 2.200s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:40:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-cb0c84e2-d8b7-41c8-8ddc-cbd583e4b6d1 tempest-VolumeDependencyTests-804367213 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:40:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-cb0c84e2-d8b7-41c8-8ddc-cbd583e4b6d1 tempest-VolumeDependencyTests-804367213 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:40:06 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-cb0c84e2-d8b7-41c8-8ddc-cbd583e4b6d1 tempest-VolumeDependencyTests-804367213 None] Creating offline snapshot 53bde034-159b-4615-8336-f16ceb0ce5e8 of volume 0f5fa330-3bab-41e6-b208-255c853043fa {{(pid=86082) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 15 16:40:06 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[19bd7d3f-acd4-41e3-8abd-41c78c792b47]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:40:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-cb0c84e2-d8b7-41c8-8ddc-cbd583e4b6d1 tempest-VolumeDependencyTests-804367213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0f5fa330-3bab-41e6-b208-255c853043fa {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:06 devstack sudo[107151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0f5fa330-3bab-41e6-b208-255c853043fa Sep 15 16:40:06 devstack sudo[107151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:07 devstack sudo[107151]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-cb0c84e2-d8b7-41c8-8ddc-cbd583e4b6d1 tempest-VolumeDependencyTests-804367213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0f5fa330-3bab-41e6-b208-255c853043fa" returned: 0 in 0.477s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-cb0c84e2-d8b7-41c8-8ddc-cbd583e4b6d1 tempest-VolumeDependencyTests-804367213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0f5fa330-3bab-41e6-b208-255c853043fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0f5fa330-3bab-41e6-b208-255c853043fa.53bde034-159b-4615-8336-f16ceb0ce5e8 1G {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:07 devstack sudo[107156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0f5fa330-3bab-41e6-b208-255c853043fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0f5fa330-3bab-41e6-b208-255c853043fa.53bde034-159b-4615-8336-f16ceb0ce5e8 1G Sep 15 16:40:07 devstack sudo[107156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:07 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-442e72d5-f749-4ad5-b1e8-970bf08a596d tempest-ProjectMemberTests-1855156353 None] Acquiring lock "cinder-52bc9fd8-6acd-4b3e-a9be-e488d73cbf4c-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:40:07 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-442e72d5-f749-4ad5-b1e8-970bf08a596d tempest-ProjectMemberTests-1855156353 None] Lock "cinder-52bc9fd8-6acd-4b3e-a9be-e488d73cbf4c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:40:07 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-442e72d5-f749-4ad5-b1e8-970bf08a596d tempest-ProjectMemberTests-1855156353 None] Acquiring lock "cinder-quobyte-52bc9fd8-6acd-4b3e-a9be-e488d73cbf4c" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:40:07 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-442e72d5-f749-4ad5-b1e8-970bf08a596d tempest-ProjectMemberTests-1855156353 None] Lock "cinder-quobyte-52bc9fd8-6acd-4b3e-a9be-e488d73cbf4c" acquired by "delete_volume" :: waited 0.024s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:40:07 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ef98fa9-6edc-4b7e-84c7-3ddafa13aa29]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:40:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-442e72d5-f749-4ad5-b1e8-970bf08a596d tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-52bc9fd8-6acd-4b3e-a9be-e488d73cbf4c {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:07 devstack sudo[107159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-52bc9fd8-6acd-4b3e-a9be-e488d73cbf4c Sep 15 16:40:07 devstack sudo[107159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:07 devstack sudo[107156]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-cb0c84e2-d8b7-41c8-8ddc-cbd583e4b6d1 tempest-VolumeDependencyTests-804367213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0f5fa330-3bab-41e6-b208-255c853043fa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0f5fa330-3bab-41e6-b208-255c853043fa.53bde034-159b-4615-8336-f16ceb0ce5e8 1G" returned: 0 in 0.589s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-cb0c84e2-d8b7-41c8-8ddc-cbd583e4b6d1 tempest-VolumeDependencyTests-804367213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f5fa330-3bab-41e6-b208-255c853043fa -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0f5fa330-3bab-41e6-b208-255c853043fa.53bde034-159b-4615-8336-f16ceb0ce5e8 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:07 devstack sudo[107165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f5fa330-3bab-41e6-b208-255c853043fa -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0f5fa330-3bab-41e6-b208-255c853043fa.53bde034-159b-4615-8336-f16ceb0ce5e8 Sep 15 16:40:07 devstack sudo[107165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:07 devstack sudo[107159]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-442e72d5-f749-4ad5-b1e8-970bf08a596d tempest-ProjectMemberTests-1855156353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-52bc9fd8-6acd-4b3e-a9be-e488d73cbf4c" returned: 0 in 0.503s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-442e72d5-f749-4ad5-b1e8-970bf08a596d tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-52bc9fd8-6acd-4b3e-a9be-e488d73cbf4c {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:07 devstack sudo[107170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-52bc9fd8-6acd-4b3e-a9be-e488d73cbf4c Sep 15 16:40:07 devstack sudo[107170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:07 devstack sudo[107165]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-cb0c84e2-d8b7-41c8-8ddc-cbd583e4b6d1 tempest-VolumeDependencyTests-804367213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f5fa330-3bab-41e6-b208-255c853043fa -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0f5fa330-3bab-41e6-b208-255c853043fa.53bde034-159b-4615-8336-f16ceb0ce5e8" returned: 0 in 0.360s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:07 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-cb0c84e2-d8b7-41c8-8ddc-cbd583e4b6d1 tempest-VolumeDependencyTests-804367213 None] /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0f5fa330-3bab-41e6-b208-255c853043fa.53bde034-159b-4615-8336-f16ceb0ce5e8 is being set with open permissions: ugo+rw Sep 15 16:40:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-cb0c84e2-d8b7-41c8-8ddc-cbd583e4b6d1 tempest-VolumeDependencyTests-804367213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0f5fa330-3bab-41e6-b208-255c853043fa.53bde034-159b-4615-8336-f16ceb0ce5e8 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:08 devstack sudo[107175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0f5fa330-3bab-41e6-b208-255c853043fa.53bde034-159b-4615-8336-f16ceb0ce5e8 Sep 15 16:40:08 devstack sudo[107175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:08 devstack sudo[107170]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-442e72d5-f749-4ad5-b1e8-970bf08a596d tempest-ProjectMemberTests-1855156353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-52bc9fd8-6acd-4b3e-a9be-e488d73cbf4c" returned: 0 in 0.280s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:08 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-442e72d5-f749-4ad5-b1e8-970bf08a596d tempest-ProjectMemberTests-1855156353 None] Lock "cinder-quobyte-52bc9fd8-6acd-4b3e-a9be-e488d73cbf4c" released by "delete_volume" :: held 0.912s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:40:08 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-442e72d5-f749-4ad5-b1e8-970bf08a596d tempest-ProjectMemberTests-1855156353 None] Created reservations ['45b42f39-ea81-4b05-96bf-4afe0a5cc21b', 'f6c61650-dab6-4f69-a060-1bab4334e617', 'a00f3dab-7650-4a57-8906-dc952c6c3b72', 'f36da411-0e3a-4965-b1d1-2ce722ea8a28'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:40:08 devstack sudo[107175]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-cb0c84e2-d8b7-41c8-8ddc-cbd583e4b6d1 tempest-VolumeDependencyTests-804367213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0f5fa330-3bab-41e6-b208-255c853043fa.53bde034-159b-4615-8336-f16ceb0ce5e8" returned: 0 in 0.306s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-442e72d5-f749-4ad5-b1e8-970bf08a596d tempest-ProjectMemberTests-1855156353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:40:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-442e72d5-f749-4ad5-b1e8-970bf08a596d tempest-ProjectMemberTests-1855156353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:40:08 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-442e72d5-f749-4ad5-b1e8-970bf08a596d tempest-ProjectMemberTests-1855156353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:40:08 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-442e72d5-f749-4ad5-b1e8-970bf08a596d tempest-ProjectMemberTests-1855156353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:40:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-442e72d5-f749-4ad5-b1e8-970bf08a596d tempest-ProjectMemberTests-1855156353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:40:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-442e72d5-f749-4ad5-b1e8-970bf08a596d tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-cb0c84e2-d8b7-41c8-8ddc-cbd583e4b6d1 tempest-VolumeDependencyTests-804367213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0f5fa330-3bab-41e6-b208-255c853043fa.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:08 devstack sudo[107179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:40:08 devstack sudo[107179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:08 devstack sudo[107180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0f5fa330-3bab-41e6-b208-255c853043fa.info Sep 15 16:40:08 devstack sudo[107180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:08 devstack sudo[107179]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-442e72d5-f749-4ad5-b1e8-970bf08a596d tempest-ProjectMemberTests-1855156353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.290s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:08 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-442e72d5-f749-4ad5-b1e8-970bf08a596d tempest-ProjectMemberTests-1855156353 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:40:08 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-442e72d5-f749-4ad5-b1e8-970bf08a596d tempest-ProjectMemberTests-1855156353 None] Deleted volume successfully. Sep 15 16:40:08 devstack sudo[107180]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-cb0c84e2-d8b7-41c8-8ddc-cbd583e4b6d1 tempest-VolumeDependencyTests-804367213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0f5fa330-3bab-41e6-b208-255c853043fa.info" returned: 0 in 0.309s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:08 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-cb0c84e2-d8b7-41c8-8ddc-cbd583e4b6d1 tempest-VolumeDependencyTests-804367213 None] /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0f5fa330-3bab-41e6-b208-255c853043fa.info is being set with open permissions: ugo+rw Sep 15 16:40:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-cb0c84e2-d8b7-41c8-8ddc-cbd583e4b6d1 tempest-VolumeDependencyTests-804367213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0f5fa330-3bab-41e6-b208-255c853043fa.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:08 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-442e72d5-f749-4ad5-b1e8-970bf08a596d tempest-ProjectMemberTests-1855156353 None] Lock "cinder-52bc9fd8-6acd-4b3e-a9be-e488d73cbf4c-delete_volume" released by "delete_volume" :: held 1.541s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:40:08 devstack sudo[107185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0f5fa330-3bab-41e6-b208-255c853043fa.info Sep 15 16:40:08 devstack sudo[107185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:08 devstack sudo[107185]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-cb0c84e2-d8b7-41c8-8ddc-cbd583e4b6d1 tempest-VolumeDependencyTests-804367213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0f5fa330-3bab-41e6-b208-255c853043fa.info" returned: 0 in 0.291s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-cb0c84e2-d8b7-41c8-8ddc-cbd583e4b6d1 tempest-VolumeDependencyTests-804367213 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.466s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:40:09 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-cb0c84e2-d8b7-41c8-8ddc-cbd583e4b6d1 tempest-VolumeDependencyTests-804367213 None] Create snapshot completed successfully Sep 15 16:40:09 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-2cb45ca0-6be6-46c7-986d-cb1b7c19fe3f tempest-ProjectMemberTests-1855156353 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:40:09 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2cb45ca0-6be6-46c7-986d-cb1b7c19fe3f tempest-ProjectMemberTests-1855156353 None] Flow 'volume_create_manager' (3ebd5396-f7e8-44b5-be1d-bf4eaee0890c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:40:09 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2cb45ca0-6be6-46c7-986d-cb1b7c19fe3f tempest-ProjectMemberTests-1855156353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (579bf0c1-aad7-4bb7-9362-2eca5a5765ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:40:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2cb45ca0-6be6-46c7-986d-cb1b7c19fe3f tempest-ProjectMemberTests-1855156353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (579bf0c1-aad7-4bb7-9362-2eca5a5765ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:40:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1665345477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e75c4782-0484-4ba2-a1ce-0edda64aab20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a303ec1076004f4db43523c2f7b6a446',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:40:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:40:10Z,use_quota=True,user_id='d9953555b80c481b9eaabbc7d416d0b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:40:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2cb45ca0-6be6-46c7-986d-cb1b7c19fe3f tempest-ProjectMemberTests-1855156353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2f29775-fe35-40f5-8255-b5b2d6a9c255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:40:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2cb45ca0-6be6-46c7-986d-cb1b7c19fe3f tempest-ProjectMemberTests-1855156353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2f29775-fe35-40f5-8255-b5b2d6a9c255) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:40:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2cb45ca0-6be6-46c7-986d-cb1b7c19fe3f tempest-ProjectMemberTests-1855156353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a335aabb-498e-40e4-9142-56ee4d891b2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:40:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2cb45ca0-6be6-46c7-986d-cb1b7c19fe3f tempest-ProjectMemberTests-1855156353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a335aabb-498e-40e4-9142-56ee4d891b2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e75c4782-0484-4ba2-a1ce-0edda64aab20', 'volume_name': 'volume-e75c4782-0484-4ba2-a1ce-0edda64aab20', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:40:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2cb45ca0-6be6-46c7-986d-cb1b7c19fe3f tempest-ProjectMemberTests-1855156353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcc924a5-98da-4592-94cc-6a0767884a81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:40:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2cb45ca0-6be6-46c7-986d-cb1b7c19fe3f tempest-ProjectMemberTests-1855156353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fcc924a5-98da-4592-94cc-6a0767884a81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:40:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2cb45ca0-6be6-46c7-986d-cb1b7c19fe3f tempest-ProjectMemberTests-1855156353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea819dc4-5daf-49f8-8a71-f1f1d7a29dbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:40:10 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-2cb45ca0-6be6-46c7-986d-cb1b7c19fe3f tempest-ProjectMemberTests-1855156353 None] Volume e75c4782-0484-4ba2-a1ce-0edda64aab20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e75c4782-0484-4ba2-a1ce-0edda64aab20', 'volume_size': 1} Sep 15 16:40:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-2cb45ca0-6be6-46c7-986d-cb1b7c19fe3f tempest-ProjectMemberTests-1855156353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:40:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-2cb45ca0-6be6-46c7-986d-cb1b7c19fe3f tempest-ProjectMemberTests-1855156353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:40:10 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-2cb45ca0-6be6-46c7-986d-cb1b7c19fe3f tempest-ProjectMemberTests-1855156353 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:40:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1665345477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e75c4782-0484-4ba2-a1ce-0edda64aab20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a303ec1076004f4db43523c2f7b6a446',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:40:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:40:10Z,use_quota=True,user_id='d9953555b80c481b9eaabbc7d416d0b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:40:10 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-2cb45ca0-6be6-46c7-986d-cb1b7c19fe3f tempest-ProjectMemberTests-1855156353 None] Creating volume e75c4782-0484-4ba2-a1ce-0edda64aab20 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:40:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-2cb45ca0-6be6-46c7-986d-cb1b7c19fe3f tempest-ProjectMemberTests-1855156353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:40:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-2cb45ca0-6be6-46c7-986d-cb1b7c19fe3f tempest-ProjectMemberTests-1855156353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:40:10 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-2cb45ca0-6be6-46c7-986d-cb1b7c19fe3f tempest-ProjectMemberTests-1855156353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:40:10 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-2cb45ca0-6be6-46c7-986d-cb1b7c19fe3f tempest-ProjectMemberTests-1855156353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:40:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-2cb45ca0-6be6-46c7-986d-cb1b7c19fe3f tempest-ProjectMemberTests-1855156353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:40:10 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-2cb45ca0-6be6-46c7-986d-cb1b7c19fe3f tempest-ProjectMemberTests-1855156353 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:40:10 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-2cb45ca0-6be6-46c7-986d-cb1b7c19fe3f tempest-ProjectMemberTests-1855156353 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:40:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2cb45ca0-6be6-46c7-986d-cb1b7c19fe3f tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-e75c4782-0484-4ba2-a1ce-0edda64aab20 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:10 devstack sudo[107188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-e75c4782-0484-4ba2-a1ce-0edda64aab20 1073741824 Sep 15 16:40:10 devstack sudo[107188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:10 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ef222cc-1505-4d01-b269-08d2bd988e0f tempest-VolumeDependencyTests-804367213 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:40:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9ef222cc-1505-4d01-b269-08d2bd988e0f tempest-VolumeDependencyTests-804367213 None] Flow 'volume_create_manager' (28a7968e-88e4-4fcb-b4d8-d6c9cc4fa027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:40:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9ef222cc-1505-4d01-b269-08d2bd988e0f tempest-VolumeDependencyTests-804367213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba998f97-ac30-47cb-9f9f-6c1761e58edb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:40:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9ef222cc-1505-4d01-b269-08d2bd988e0f tempest-VolumeDependencyTests-804367213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba998f97-ac30-47cb-9f9f-6c1761e58edb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:40:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1362328255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=baf39207-4c10-4091-a3fe-19d3afcf5b80,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c079e3aafae540eaa101f0301da9fa86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:40:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=53bde034-159b-4615-8336-f16ceb0ce5e8,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:40:10Z,use_quota=True,user_id='c8142ebcc0eb4b63817e952f0f4c3299',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:40:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9ef222cc-1505-4d01-b269-08d2bd988e0f tempest-VolumeDependencyTests-804367213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd57a5d1-9f99-4a73-a04e-dc959dd448ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:40:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9ef222cc-1505-4d01-b269-08d2bd988e0f tempest-VolumeDependencyTests-804367213 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd57a5d1-9f99-4a73-a04e-dc959dd448ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:40:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9ef222cc-1505-4d01-b269-08d2bd988e0f tempest-VolumeDependencyTests-804367213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d9df4fd-0ba4-4af8-9c21-fd6fbe6bc8b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:40:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9ef222cc-1505-4d01-b269-08d2bd988e0f tempest-VolumeDependencyTests-804367213 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d9df4fd-0ba4-4af8-9c21-fd6fbe6bc8b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'baf39207-4c10-4091-a3fe-19d3afcf5b80', 'volume_name': 'volume-baf39207-4c10-4091-a3fe-19d3afcf5b80', 'volume_size': 1, 'snapshot_id': '53bde034-159b-4615-8336-f16ceb0ce5e8'}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:40:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9ef222cc-1505-4d01-b269-08d2bd988e0f tempest-VolumeDependencyTests-804367213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62ddb5be-c331-4e49-89e5-81d8c3418c2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:40:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9ef222cc-1505-4d01-b269-08d2bd988e0f tempest-VolumeDependencyTests-804367213 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62ddb5be-c331-4e49-89e5-81d8c3418c2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:40:10 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9ef222cc-1505-4d01-b269-08d2bd988e0f tempest-VolumeDependencyTests-804367213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29781944-ec24-4ed9-b066-e823ca1203ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:40:10 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-9ef222cc-1505-4d01-b269-08d2bd988e0f tempest-VolumeDependencyTests-804367213 None] Volume baf39207-4c10-4091-a3fe-19d3afcf5b80: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-baf39207-4c10-4091-a3fe-19d3afcf5b80', 'volume_size': 1, 'snapshot_id': '53bde034-159b-4615-8336-f16ceb0ce5e8'} Sep 15 16:40:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-9ef222cc-1505-4d01-b269-08d2bd988e0f tempest-VolumeDependencyTests-804367213 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:40:10 devstack sudo[107188]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2cb45ca0-6be6-46c7-986d-cb1b7c19fe3f tempest-ProjectMemberTests-1855156353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-e75c4782-0484-4ba2-a1ce-0edda64aab20 1073741824" returned: 0 in 0.596s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2cb45ca0-6be6-46c7-986d-cb1b7c19fe3f tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-e75c4782-0484-4ba2-a1ce-0edda64aab20 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:10 devstack sudo[107194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-e75c4782-0484-4ba2-a1ce-0edda64aab20 Sep 15 16:40:10 devstack sudo[107194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:10 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-b99d4aea-f560-44b5-966f-2934ab7420df tempest-ProjectReaderTests-1222292119 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:40:11 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b99d4aea-f560-44b5-966f-2934ab7420df tempest-ProjectReaderTests-1222292119 None] Flow 'volume_create_manager' (edd254ef-df96-490b-8577-915ee3200934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:40:11 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b99d4aea-f560-44b5-966f-2934ab7420df tempest-ProjectReaderTests-1222292119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6377f24f-115b-4079-bb29-7b4993d88074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:40:11 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b99d4aea-f560-44b5-966f-2934ab7420df tempest-ProjectReaderTests-1222292119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6377f24f-115b-4079-bb29-7b4993d88074) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:40:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-426457219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86a3466d-fb44-46fb-8f3a-c311234fdce6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00865779659d4fad89bd76494c8544b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:40:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:40:11Z,use_quota=True,user_id='d3de3e08584e4e9aaa0e1f0ccaeb73c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:40:11 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b99d4aea-f560-44b5-966f-2934ab7420df tempest-ProjectReaderTests-1222292119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5051f6fb-c3f3-45bc-b377-4461cdd54b10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:40:11 devstack sudo[107194]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:11 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b99d4aea-f560-44b5-966f-2934ab7420df tempest-ProjectReaderTests-1222292119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5051f6fb-c3f3-45bc-b377-4461cdd54b10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:40:11 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b99d4aea-f560-44b5-966f-2934ab7420df tempest-ProjectReaderTests-1222292119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7080d88c-6eb7-48a9-887b-3e81a32a32c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:40:11 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b99d4aea-f560-44b5-966f-2934ab7420df tempest-ProjectReaderTests-1222292119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7080d88c-6eb7-48a9-887b-3e81a32a32c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86a3466d-fb44-46fb-8f3a-c311234fdce6', 'volume_name': 'volume-86a3466d-fb44-46fb-8f3a-c311234fdce6', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:40:11 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b99d4aea-f560-44b5-966f-2934ab7420df tempest-ProjectReaderTests-1222292119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7229fa39-e820-4d5d-abe9-f928ad9913a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:40:11 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b99d4aea-f560-44b5-966f-2934ab7420df tempest-ProjectReaderTests-1222292119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7229fa39-e820-4d5d-abe9-f928ad9913a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:40:11 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b99d4aea-f560-44b5-966f-2934ab7420df tempest-ProjectReaderTests-1222292119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16116aef-c911-40cb-af18-7e61b6755a50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:40:11 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-b99d4aea-f560-44b5-966f-2934ab7420df tempest-ProjectReaderTests-1222292119 None] Volume 86a3466d-fb44-46fb-8f3a-c311234fdce6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86a3466d-fb44-46fb-8f3a-c311234fdce6', 'volume_size': 1} Sep 15 16:40:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b99d4aea-f560-44b5-966f-2934ab7420df tempest-ProjectReaderTests-1222292119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:40:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2cb45ca0-6be6-46c7-986d-cb1b7c19fe3f tempest-ProjectMemberTests-1855156353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-e75c4782-0484-4ba2-a1ce-0edda64aab20" returned: 0 in 0.374s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:11 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-2cb45ca0-6be6-46c7-986d-cb1b7c19fe3f tempest-ProjectMemberTests-1855156353 None] <== create_volume: return (1027ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:40:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-2cb45ca0-6be6-46c7-986d-cb1b7c19fe3f tempest-ProjectMemberTests-1855156353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.032s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:40:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-9ef222cc-1505-4d01-b269-08d2bd988e0f tempest-VolumeDependencyTests-804367213 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.480s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:40:11 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-9ef222cc-1505-4d01-b269-08d2bd988e0f tempest-VolumeDependencyTests-804367213 None] Acquiring lock "cinder-quobyte-53bde034-159b-4615-8336-f16ceb0ce5e8-baf39207-4c10-4091-a3fe-19d3afcf5b80" by "_create_volume_from_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:40:11 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2cb45ca0-6be6-46c7-986d-cb1b7c19fe3f tempest-ProjectMemberTests-1855156353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ea819dc4-5daf-49f8-8a71-f1f1d7a29dbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e75c4782-0484-4ba2-a1ce-0edda64aab20', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:40:11 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2cb45ca0-6be6-46c7-986d-cb1b7c19fe3f tempest-ProjectMemberTests-1855156353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98b472c1-0e12-4974-ab7d-a5699b3f65d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:40:11 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-9ef222cc-1505-4d01-b269-08d2bd988e0f tempest-VolumeDependencyTests-804367213 None] Lock "cinder-quobyte-53bde034-159b-4615-8336-f16ceb0ce5e8-baf39207-4c10-4091-a3fe-19d3afcf5b80" acquired by "_create_volume_from_snapshot" :: waited 0.029s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:40:11 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-9ef222cc-1505-4d01-b269-08d2bd988e0f tempest-VolumeDependencyTests-804367213 None] Creating volume baf39207-4c10-4091-a3fe-19d3afcf5b80 from snapshot 53bde034-159b-4615-8336-f16ceb0ce5e8 {{(pid=86082) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 15 16:40:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-9ef222cc-1505-4d01-b269-08d2bd988e0f tempest-VolumeDependencyTests-804367213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:40:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-9ef222cc-1505-4d01-b269-08d2bd988e0f tempest-VolumeDependencyTests-804367213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:40:11 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-9ef222cc-1505-4d01-b269-08d2bd988e0f tempest-VolumeDependencyTests-804367213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:40:11 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-9ef222cc-1505-4d01-b269-08d2bd988e0f tempest-VolumeDependencyTests-804367213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:40:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-9ef222cc-1505-4d01-b269-08d2bd988e0f tempest-VolumeDependencyTests-804367213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:40:11 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-9ef222cc-1505-4d01-b269-08d2bd988e0f tempest-VolumeDependencyTests-804367213 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:40:11 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-9ef222cc-1505-4d01-b269-08d2bd988e0f tempest-VolumeDependencyTests-804367213 None] Acquiring lock "cinder-quobyte-baf39207-4c10-4091-a3fe-19d3afcf5b80" by "_copy_volume_from_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:40:11 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-2cb45ca0-6be6-46c7-986d-cb1b7c19fe3f tempest-ProjectMemberTests-1855156353 None] Volume volume-e75c4782-0484-4ba2-a1ce-0edda64aab20 (e75c4782-0484-4ba2-a1ce-0edda64aab20): created successfully Sep 15 16:40:11 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2cb45ca0-6be6-46c7-986d-cb1b7c19fe3f tempest-ProjectMemberTests-1855156353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98b472c1-0e12-4974-ab7d-a5699b3f65d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:40:11 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2cb45ca0-6be6-46c7-986d-cb1b7c19fe3f tempest-ProjectMemberTests-1855156353 None] Flow 'volume_create_manager' (3ebd5396-f7e8-44b5-be1d-bf4eaee0890c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:40:11 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-9ef222cc-1505-4d01-b269-08d2bd988e0f tempest-VolumeDependencyTests-804367213 None] Lock "cinder-quobyte-baf39207-4c10-4091-a3fe-19d3afcf5b80" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:40:11 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-9ef222cc-1505-4d01-b269-08d2bd988e0f tempest-VolumeDependencyTests-804367213 None] snapshot: 53bde034-159b-4615-8336-f16ceb0ce5e8, volume: baf39207-4c10-4091-a3fe-19d3afcf5b80, {{(pid=86082) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 15 16:40:11 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-2cb45ca0-6be6-46c7-986d-cb1b7c19fe3f tempest-ProjectMemberTests-1855156353 None] Created volume successfully. Sep 15 16:40:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-9ef222cc-1505-4d01-b269-08d2bd988e0f tempest-VolumeDependencyTests-804367213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:40:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-9ef222cc-1505-4d01-b269-08d2bd988e0f tempest-VolumeDependencyTests-804367213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:40:11 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-9ef222cc-1505-4d01-b269-08d2bd988e0f tempest-VolumeDependencyTests-804367213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:40:11 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-9ef222cc-1505-4d01-b269-08d2bd988e0f tempest-VolumeDependencyTests-804367213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:40:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-9ef222cc-1505-4d01-b269-08d2bd988e0f tempest-VolumeDependencyTests-804367213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:40:11 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[653c5c0e-ba7e-4fff-acb5-eb5b7395aef4]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:40:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9ef222cc-1505-4d01-b269-08d2bd988e0f tempest-VolumeDependencyTests-804367213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0f5fa330-3bab-41e6-b208-255c853043fa.53bde034-159b-4615-8336-f16ceb0ce5e8 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:11 devstack sudo[107197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0f5fa330-3bab-41e6-b208-255c853043fa.53bde034-159b-4615-8336-f16ceb0ce5e8 Sep 15 16:40:11 devstack sudo[107197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:11 devstack sudo[107197]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9ef222cc-1505-4d01-b269-08d2bd988e0f tempest-VolumeDependencyTests-804367213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0f5fa330-3bab-41e6-b208-255c853043fa.53bde034-159b-4615-8336-f16ceb0ce5e8" returned: 0 in 0.385s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:11 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-9ef222cc-1505-4d01-b269-08d2bd988e0f tempest-VolumeDependencyTests-804367213 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f5fa330-3bab-41e6-b208-255c853043fa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 16:40:11 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce604671-62e5-4806-96a7-5d4a88f24cb5]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:40:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9ef222cc-1505-4d01-b269-08d2bd988e0f tempest-VolumeDependencyTests-804367213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0f5fa330-3bab-41e6-b208-255c853043fa {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:11 devstack sudo[107202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0f5fa330-3bab-41e6-b208-255c853043fa Sep 15 16:40:11 devstack sudo[107202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:12 devstack sudo[107202]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9ef222cc-1505-4d01-b269-08d2bd988e0f tempest-VolumeDependencyTests-804367213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0f5fa330-3bab-41e6-b208-255c853043fa" returned: 0 in 0.393s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:12 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-9ef222cc-1505-4d01-b269-08d2bd988e0f tempest-VolumeDependencyTests-804367213 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0f5fa330-3bab-41e6-b208-255c853043fa {{(pid=86082) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 15 16:40:12 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-9ef222cc-1505-4d01-b269-08d2bd988e0f tempest-VolumeDependencyTests-804367213 None] Creating direct copy from snapshot {{(pid=86082) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 15 16:40:12 devstack cinder-volume[86082]: DEBUG cinder.utils [None req-9ef222cc-1505-4d01-b269-08d2bd988e0f tempest-VolumeDependencyTests-804367213 None] Path /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-baf39207-4c10-4091-a3fe-19d3afcf5b80 not found in is_blk_device check {{(pid=86082) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 15 16:40:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9ef222cc-1505-4d01-b269-08d2bd988e0f tempest-VolumeDependencyTests-804367213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0f5fa330-3bab-41e6-b208-255c853043fa /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-baf39207-4c10-4091-a3fe-19d3afcf5b80 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:12 devstack sudo[107207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0f5fa330-3bab-41e6-b208-255c853043fa /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-baf39207-4c10-4091-a3fe-19d3afcf5b80 Sep 15 16:40:12 devstack sudo[107207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-6731ca89-38c3-4c99-9d01-d89e2e9b9063 tempest-ProjectMemberTests-1855156353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:40:19 devstack sudo[107207]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9ef222cc-1505-4d01-b269-08d2bd988e0f tempest-VolumeDependencyTests-804367213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0f5fa330-3bab-41e6-b208-255c853043fa /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-baf39207-4c10-4091-a3fe-19d3afcf5b80" returned: 0 in 7.040s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:19 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-9ef222cc-1505-4d01-b269-08d2bd988e0f tempest-VolumeDependencyTests-804367213 None] Image conversion details: src /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0f5fa330-3bab-41e6-b208-255c853043fa, size 1024.00 MB, duration 7.04 sec, destination /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-baf39207-4c10-4091-a3fe-19d3afcf5b80 {{(pid=86082) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 15 16:40:19 devstack cinder-volume[86082]: INFO cinder.image.image_utils [None req-9ef222cc-1505-4d01-b269-08d2bd988e0f tempest-VolumeDependencyTests-804367213 None] Converted 1024.00 MB image at 145.44 MB/s Sep 15 16:40:19 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-9ef222cc-1505-4d01-b269-08d2bd988e0f tempest-VolumeDependencyTests-804367213 None] /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-baf39207-4c10-4091-a3fe-19d3afcf5b80 is being set with open permissions: ugo+rw Sep 15 16:40:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9ef222cc-1505-4d01-b269-08d2bd988e0f tempest-VolumeDependencyTests-804367213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-baf39207-4c10-4091-a3fe-19d3afcf5b80 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:19 devstack sudo[107221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-baf39207-4c10-4091-a3fe-19d3afcf5b80 Sep 15 16:40:19 devstack sudo[107221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:19 devstack sudo[107221]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9ef222cc-1505-4d01-b269-08d2bd988e0f tempest-VolumeDependencyTests-804367213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-baf39207-4c10-4091-a3fe-19d3afcf5b80" returned: 0 in 0.254s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:19 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-9ef222cc-1505-4d01-b269-08d2bd988e0f tempest-VolumeDependencyTests-804367213 None] Lock "cinder-quobyte-baf39207-4c10-4091-a3fe-19d3afcf5b80" released by "_copy_volume_from_snapshot" :: held 8.169s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:40:19 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:UPDATE=295,cinder:SELECT=215,cinder:INSERT=89,cinder:DELETE=31 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 16:40:19 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:SELECT=224,cinder:UPDATE=293,cinder:DELETE=22,cinder:INSERT=68 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 16:40:19 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-9ef222cc-1505-4d01-b269-08d2bd988e0f tempest-VolumeDependencyTests-804367213 None] Lock "cinder-quobyte-53bde034-159b-4615-8336-f16ceb0ce5e8-baf39207-4c10-4091-a3fe-19d3afcf5b80" released by "_create_volume_from_snapshot" :: held 8.258s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:40:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-9ef222cc-1505-4d01-b269-08d2bd988e0f tempest-VolumeDependencyTests-804367213 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.288s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:40:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b99d4aea-f560-44b5-966f-2934ab7420df tempest-ProjectReaderTests-1222292119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.296s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:40:19 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-b99d4aea-f560-44b5-966f-2934ab7420df tempest-ProjectReaderTests-1222292119 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:40:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-426457219',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86a3466d-fb44-46fb-8f3a-c311234fdce6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00865779659d4fad89bd76494c8544b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:40:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:40:11Z,use_quota=True,user_id='d3de3e08584e4e9aaa0e1f0ccaeb73c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:40:19 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-b99d4aea-f560-44b5-966f-2934ab7420df tempest-ProjectReaderTests-1222292119 None] Creating volume 86a3466d-fb44-46fb-8f3a-c311234fdce6 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:40:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b99d4aea-f560-44b5-966f-2934ab7420df tempest-ProjectReaderTests-1222292119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:40:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b99d4aea-f560-44b5-966f-2934ab7420df tempest-ProjectReaderTests-1222292119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:40:19 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-b99d4aea-f560-44b5-966f-2934ab7420df tempest-ProjectReaderTests-1222292119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:40:19 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-b99d4aea-f560-44b5-966f-2934ab7420df tempest-ProjectReaderTests-1222292119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:40:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b99d4aea-f560-44b5-966f-2934ab7420df tempest-ProjectReaderTests-1222292119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:40:19 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-b99d4aea-f560-44b5-966f-2934ab7420df tempest-ProjectReaderTests-1222292119 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:40:19 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-b99d4aea-f560-44b5-966f-2934ab7420df tempest-ProjectReaderTests-1222292119 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:40:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b99d4aea-f560-44b5-966f-2934ab7420df tempest-ProjectReaderTests-1222292119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-86a3466d-fb44-46fb-8f3a-c311234fdce6 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:19 devstack sudo[107224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-86a3466d-fb44-46fb-8f3a-c311234fdce6 1073741824 Sep 15 16:40:19 devstack sudo[107224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:19 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9ef222cc-1505-4d01-b269-08d2bd988e0f tempest-VolumeDependencyTests-804367213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29781944-ec24-4ed9-b066-e823ca1203ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-baf39207-4c10-4091-a3fe-19d3afcf5b80', 'volume_size': 1, 'snapshot_id': '53bde034-159b-4615-8336-f16ceb0ce5e8'}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:40:19 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9ef222cc-1505-4d01-b269-08d2bd988e0f tempest-VolumeDependencyTests-804367213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e60c4e7a-0630-4116-9fdb-dd1908ecae1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:40:19 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-9ef222cc-1505-4d01-b269-08d2bd988e0f tempest-VolumeDependencyTests-804367213 None] Volume volume-baf39207-4c10-4091-a3fe-19d3afcf5b80 (baf39207-4c10-4091-a3fe-19d3afcf5b80): created successfully Sep 15 16:40:19 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9ef222cc-1505-4d01-b269-08d2bd988e0f tempest-VolumeDependencyTests-804367213 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e60c4e7a-0630-4116-9fdb-dd1908ecae1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:40:19 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-9ef222cc-1505-4d01-b269-08d2bd988e0f tempest-VolumeDependencyTests-804367213 None] Flow 'volume_create_manager' (28a7968e-88e4-4fcb-b4d8-d6c9cc4fa027) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:40:19 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-9ef222cc-1505-4d01-b269-08d2bd988e0f tempest-VolumeDependencyTests-804367213 None] Created volume successfully. Sep 15 16:40:19 devstack sudo[107224]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b99d4aea-f560-44b5-966f-2934ab7420df tempest-ProjectReaderTests-1222292119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-86a3466d-fb44-46fb-8f3a-c311234fdce6 1073741824" returned: 0 in 0.478s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b99d4aea-f560-44b5-966f-2934ab7420df tempest-ProjectReaderTests-1222292119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-86a3466d-fb44-46fb-8f3a-c311234fdce6 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:19 devstack sudo[107230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-86a3466d-fb44-46fb-8f3a-c311234fdce6 Sep 15 16:40:19 devstack sudo[107230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:20 devstack sudo[107230]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b99d4aea-f560-44b5-966f-2934ab7420df tempest-ProjectReaderTests-1222292119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-86a3466d-fb44-46fb-8f3a-c311234fdce6" returned: 0 in 0.312s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:20 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-b99d4aea-f560-44b5-966f-2934ab7420df tempest-ProjectReaderTests-1222292119 None] <== create_volume: return (832ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:40:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-b99d4aea-f560-44b5-966f-2934ab7420df tempest-ProjectReaderTests-1222292119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.835s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:40:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-6731ca89-38c3-4c99-9d01-d89e2e9b9063 tempest-ProjectMemberTests-1855156353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.968s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:40:20 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b99d4aea-f560-44b5-966f-2934ab7420df tempest-ProjectReaderTests-1222292119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16116aef-c911-40cb-af18-7e61b6755a50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86a3466d-fb44-46fb-8f3a-c311234fdce6', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:40:20 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b99d4aea-f560-44b5-966f-2934ab7420df tempest-ProjectReaderTests-1222292119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4268703-bffd-4309-bc6a-28c77cbc3723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:40:20 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-6731ca89-38c3-4c99-9d01-d89e2e9b9063 tempest-ProjectMemberTests-1855156353 None] Creating offline snapshot 5ebe6120-4c35-4806-8825-af56be7258d7 of volume e75c4782-0484-4ba2-a1ce-0edda64aab20 {{(pid=86082) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 15 16:40:20 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-b99d4aea-f560-44b5-966f-2934ab7420df tempest-ProjectReaderTests-1222292119 None] Volume volume-86a3466d-fb44-46fb-8f3a-c311234fdce6 (86a3466d-fb44-46fb-8f3a-c311234fdce6): created successfully Sep 15 16:40:20 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b99d4aea-f560-44b5-966f-2934ab7420df tempest-ProjectReaderTests-1222292119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4268703-bffd-4309-bc6a-28c77cbc3723) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:40:20 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-b99d4aea-f560-44b5-966f-2934ab7420df tempest-ProjectReaderTests-1222292119 None] Flow 'volume_create_manager' (edd254ef-df96-490b-8577-915ee3200934) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:40:20 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-b99d4aea-f560-44b5-966f-2934ab7420df tempest-ProjectReaderTests-1222292119 None] Created volume successfully. Sep 15 16:40:20 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fd47002-fc6d-487a-85b3-65c67ee7b6b2]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:40:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-6731ca89-38c3-4c99-9d01-d89e2e9b9063 tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-e75c4782-0484-4ba2-a1ce-0edda64aab20 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:20 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-8776bb32-c30d-4c7e-94c0-248e0c6e3d52 tempest-VolumeDependencyTests-804367213 None] Acquiring lock "cinder-53bde034-159b-4615-8336-f16ceb0ce5e8-delete_snapshot" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:40:20 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-8776bb32-c30d-4c7e-94c0-248e0c6e3d52 tempest-VolumeDependencyTests-804367213 None] Lock "cinder-53bde034-159b-4615-8336-f16ceb0ce5e8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:40:20 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-8776bb32-c30d-4c7e-94c0-248e0c6e3d52 tempest-VolumeDependencyTests-804367213 None] Acquiring lock "cinder-quobyte-0f5fa330-3bab-41e6-b208-255c853043fa" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:40:20 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-8776bb32-c30d-4c7e-94c0-248e0c6e3d52 tempest-VolumeDependencyTests-804367213 None] Lock "cinder-quobyte-0f5fa330-3bab-41e6-b208-255c853043fa" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:40:20 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-8776bb32-c30d-4c7e-94c0-248e0c6e3d52 tempest-VolumeDependencyTests-804367213 None] Acquiring lock "cinder-quobyte-53bde034-159b-4615-8336-f16ceb0ce5e8" by "_delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:40:20 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-8776bb32-c30d-4c7e-94c0-248e0c6e3d52 tempest-VolumeDependencyTests-804367213 None] Lock "cinder-quobyte-53bde034-159b-4615-8336-f16ceb0ce5e8" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:40:20 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-8776bb32-c30d-4c7e-94c0-248e0c6e3d52 tempest-VolumeDependencyTests-804367213 None] Deleting offline snapshot 53bde034-159b-4615-8336-f16ceb0ce5e8 of volume 0f5fa330-3bab-41e6-b208-255c853043fa {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 15 16:40:20 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-8776bb32-c30d-4c7e-94c0-248e0c6e3d52 tempest-VolumeDependencyTests-804367213 None] snapshot_file for this snap is: volume-0f5fa330-3bab-41e6-b208-255c853043fa.53bde034-159b-4615-8336-f16ceb0ce5e8 {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 15 16:40:20 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[63a23e6e-3359-4cf4-8a45-5924b81fd709]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:40:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8776bb32-c30d-4c7e-94c0-248e0c6e3d52 tempest-VolumeDependencyTests-804367213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0f5fa330-3bab-41e6-b208-255c853043fa.53bde034-159b-4615-8336-f16ceb0ce5e8 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:20 devstack sudo[107267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-e75c4782-0484-4ba2-a1ce-0edda64aab20 Sep 15 16:40:20 devstack sudo[107267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:20 devstack sudo[107271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0f5fa330-3bab-41e6-b208-255c853043fa.53bde034-159b-4615-8336-f16ceb0ce5e8 Sep 15 16:40:20 devstack sudo[107271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:20 devstack sudo[107267]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-6731ca89-38c3-4c99-9d01-d89e2e9b9063 tempest-ProjectMemberTests-1855156353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-e75c4782-0484-4ba2-a1ce-0edda64aab20" returned: 0 in 0.474s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-6731ca89-38c3-4c99-9d01-d89e2e9b9063 tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-e75c4782-0484-4ba2-a1ce-0edda64aab20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-e75c4782-0484-4ba2-a1ce-0edda64aab20.5ebe6120-4c35-4806-8825-af56be7258d7 1G {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:20 devstack sudo[107278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-e75c4782-0484-4ba2-a1ce-0edda64aab20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-e75c4782-0484-4ba2-a1ce-0edda64aab20.5ebe6120-4c35-4806-8825-af56be7258d7 1G Sep 15 16:40:20 devstack sudo[107278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:20 devstack sudo[107271]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8776bb32-c30d-4c7e-94c0-248e0c6e3d52 tempest-VolumeDependencyTests-804367213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0f5fa330-3bab-41e6-b208-255c853043fa.53bde034-159b-4615-8336-f16ceb0ce5e8" returned: 0 in 0.412s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:20 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-8776bb32-c30d-4c7e-94c0-248e0c6e3d52 tempest-VolumeDependencyTests-804367213 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f5fa330-3bab-41e6-b208-255c853043fa(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 16:40:20 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[af6340f6-e317-4f35-8c60-ceb1afea6a72]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:40:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8776bb32-c30d-4c7e-94c0-248e0c6e3d52 tempest-VolumeDependencyTests-804367213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0f5fa330-3bab-41e6-b208-255c853043fa {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:21 devstack sudo[107281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0f5fa330-3bab-41e6-b208-255c853043fa Sep 15 16:40:21 devstack sudo[107281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:21 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-3692e24a-f37e-4637-b55a-4e44d0a03486 tempest-ProjectReaderTests-1222292119 None] Acquiring lock "cinder-86a3466d-fb44-46fb-8f3a-c311234fdce6-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:40:21 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-3692e24a-f37e-4637-b55a-4e44d0a03486 tempest-ProjectReaderTests-1222292119 None] Lock "cinder-86a3466d-fb44-46fb-8f3a-c311234fdce6-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:40:21 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-3692e24a-f37e-4637-b55a-4e44d0a03486 tempest-ProjectReaderTests-1222292119 None] Acquiring lock "cinder-quobyte-86a3466d-fb44-46fb-8f3a-c311234fdce6" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:40:21 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-3692e24a-f37e-4637-b55a-4e44d0a03486 tempest-ProjectReaderTests-1222292119 None] Lock "cinder-quobyte-86a3466d-fb44-46fb-8f3a-c311234fdce6" acquired by "delete_volume" :: waited 0.036s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:40:21 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b8394cf-a4e3-46de-915b-bc3f794b8edf]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:40:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3692e24a-f37e-4637-b55a-4e44d0a03486 tempest-ProjectReaderTests-1222292119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-86a3466d-fb44-46fb-8f3a-c311234fdce6 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:21 devstack sudo[107278]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-6731ca89-38c3-4c99-9d01-d89e2e9b9063 tempest-ProjectMemberTests-1855156353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-e75c4782-0484-4ba2-a1ce-0edda64aab20,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-e75c4782-0484-4ba2-a1ce-0edda64aab20.5ebe6120-4c35-4806-8825-af56be7258d7 1G" returned: 0 in 0.602s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-6731ca89-38c3-4c99-9d01-d89e2e9b9063 tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e75c4782-0484-4ba2-a1ce-0edda64aab20 -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-e75c4782-0484-4ba2-a1ce-0edda64aab20.5ebe6120-4c35-4806-8825-af56be7258d7 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:21 devstack sudo[107291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e75c4782-0484-4ba2-a1ce-0edda64aab20 -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-e75c4782-0484-4ba2-a1ce-0edda64aab20.5ebe6120-4c35-4806-8825-af56be7258d7 Sep 15 16:40:21 devstack sudo[107291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:21 devstack sudo[107290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-86a3466d-fb44-46fb-8f3a-c311234fdce6 Sep 15 16:40:21 devstack sudo[107290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:21 devstack sudo[107281]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8776bb32-c30d-4c7e-94c0-248e0c6e3d52 tempest-VolumeDependencyTests-804367213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0f5fa330-3bab-41e6-b208-255c853043fa" returned: 0 in 0.655s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8776bb32-c30d-4c7e-94c0-248e0c6e3d52 tempest-VolumeDependencyTests-804367213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0f5fa330-3bab-41e6-b208-255c853043fa.53bde034-159b-4615-8336-f16ceb0ce5e8 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:21 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-031e32f7-3be9-4a79-9c9b-273bdf821ffa tempest-ProjectReaderTests-1964668024 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:40:21 devstack sudo[107295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0f5fa330-3bab-41e6-b208-255c853043fa.53bde034-159b-4615-8336-f16ceb0ce5e8 Sep 15 16:40:21 devstack sudo[107295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-031e32f7-3be9-4a79-9c9b-273bdf821ffa tempest-ProjectReaderTests-1964668024 None] Flow 'volume_create_manager' (aeb1c5a4-5b48-4a8c-98f7-7db8e81ac532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:40:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-031e32f7-3be9-4a79-9c9b-273bdf821ffa tempest-ProjectReaderTests-1964668024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d511a98-fd7a-45f2-8ba7-7498694e9ec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:40:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-031e32f7-3be9-4a79-9c9b-273bdf821ffa tempest-ProjectReaderTests-1964668024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d511a98-fd7a-45f2-8ba7-7498694e9ec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:40:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-369239640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f34f101d-287e-4c20-a8e3-f78e3110836c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6de9a8446d25410e819cf25f0625d0b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:40:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:40:22Z,use_quota=True,user_id='52cdd2a10b274baf9b545e0df74ebcc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:40:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-031e32f7-3be9-4a79-9c9b-273bdf821ffa tempest-ProjectReaderTests-1964668024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b9c5b93-7952-4f4f-9a2a-5d3fcd12bb8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:40:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-031e32f7-3be9-4a79-9c9b-273bdf821ffa tempest-ProjectReaderTests-1964668024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b9c5b93-7952-4f4f-9a2a-5d3fcd12bb8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:40:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-031e32f7-3be9-4a79-9c9b-273bdf821ffa tempest-ProjectReaderTests-1964668024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe9e74b5-f343-4467-a400-5f0153b6c84b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:40:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-031e32f7-3be9-4a79-9c9b-273bdf821ffa tempest-ProjectReaderTests-1964668024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe9e74b5-f343-4467-a400-5f0153b6c84b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f34f101d-287e-4c20-a8e3-f78e3110836c', 'volume_name': 'volume-f34f101d-287e-4c20-a8e3-f78e3110836c', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:40:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-031e32f7-3be9-4a79-9c9b-273bdf821ffa tempest-ProjectReaderTests-1964668024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3de0d9aa-dcee-40a4-8e9f-cacc47be64e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:40:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-031e32f7-3be9-4a79-9c9b-273bdf821ffa tempest-ProjectReaderTests-1964668024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3de0d9aa-dcee-40a4-8e9f-cacc47be64e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:40:21 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-031e32f7-3be9-4a79-9c9b-273bdf821ffa tempest-ProjectReaderTests-1964668024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (524d8272-ee61-4f5d-b695-b63b52eb4841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:40:21 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-031e32f7-3be9-4a79-9c9b-273bdf821ffa tempest-ProjectReaderTests-1964668024 None] Volume f34f101d-287e-4c20-a8e3-f78e3110836c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f34f101d-287e-4c20-a8e3-f78e3110836c', 'volume_size': 1} Sep 15 16:40:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-031e32f7-3be9-4a79-9c9b-273bdf821ffa tempest-ProjectReaderTests-1964668024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:40:21 devstack sudo[107291]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-6731ca89-38c3-4c99-9d01-d89e2e9b9063 tempest-ProjectMemberTests-1855156353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e75c4782-0484-4ba2-a1ce-0edda64aab20 -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-e75c4782-0484-4ba2-a1ce-0edda64aab20.5ebe6120-4c35-4806-8825-af56be7258d7" returned: 0 in 0.371s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:21 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-6731ca89-38c3-4c99-9d01-d89e2e9b9063 tempest-ProjectMemberTests-1855156353 None] /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-e75c4782-0484-4ba2-a1ce-0edda64aab20.5ebe6120-4c35-4806-8825-af56be7258d7 is being set with open permissions: ugo+rw Sep 15 16:40:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-6731ca89-38c3-4c99-9d01-d89e2e9b9063 tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-e75c4782-0484-4ba2-a1ce-0edda64aab20.5ebe6120-4c35-4806-8825-af56be7258d7 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:21 devstack sudo[107302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-e75c4782-0484-4ba2-a1ce-0edda64aab20.5ebe6120-4c35-4806-8825-af56be7258d7 Sep 15 16:40:21 devstack sudo[107302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:21 devstack sudo[107290]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3692e24a-f37e-4637-b55a-4e44d0a03486 tempest-ProjectReaderTests-1222292119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-86a3466d-fb44-46fb-8f3a-c311234fdce6" returned: 0 in 0.487s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3692e24a-f37e-4637-b55a-4e44d0a03486 tempest-ProjectReaderTests-1222292119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-86a3466d-fb44-46fb-8f3a-c311234fdce6 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:21 devstack sudo[107307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-86a3466d-fb44-46fb-8f3a-c311234fdce6 Sep 15 16:40:21 devstack sudo[107307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:21 devstack sudo[107295]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8776bb32-c30d-4c7e-94c0-248e0c6e3d52 tempest-VolumeDependencyTests-804367213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0f5fa330-3bab-41e6-b208-255c853043fa.53bde034-159b-4615-8336-f16ceb0ce5e8" returned: 0 in 0.404s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8776bb32-c30d-4c7e-94c0-248e0c6e3d52 tempest-VolumeDependencyTests-804367213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0f5fa330-3bab-41e6-b208-255c853043fa.53bde034-159b-4615-8336-f16ceb0ce5e8 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:22 devstack sudo[107311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0f5fa330-3bab-41e6-b208-255c853043fa.53bde034-159b-4615-8336-f16ceb0ce5e8 Sep 15 16:40:22 devstack sudo[107311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:22 devstack sudo[107302]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-6731ca89-38c3-4c99-9d01-d89e2e9b9063 tempest-ProjectMemberTests-1855156353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-e75c4782-0484-4ba2-a1ce-0edda64aab20.5ebe6120-4c35-4806-8825-af56be7258d7" returned: 0 in 0.289s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-6731ca89-38c3-4c99-9d01-d89e2e9b9063 tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-e75c4782-0484-4ba2-a1ce-0edda64aab20.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:22 devstack sudo[107307]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3692e24a-f37e-4637-b55a-4e44d0a03486 tempest-ProjectReaderTests-1222292119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-86a3466d-fb44-46fb-8f3a-c311234fdce6" returned: 0 in 0.265s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:22 devstack sudo[107315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-e75c4782-0484-4ba2-a1ce-0edda64aab20.info Sep 15 16:40:22 devstack sudo[107315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:22 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-3692e24a-f37e-4637-b55a-4e44d0a03486 tempest-ProjectReaderTests-1222292119 None] Lock "cinder-quobyte-86a3466d-fb44-46fb-8f3a-c311234fdce6" released by "delete_volume" :: held 0.832s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:40:22 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-3692e24a-f37e-4637-b55a-4e44d0a03486 tempest-ProjectReaderTests-1222292119 None] Created reservations ['c2634a22-a476-4301-a189-a94fdb24f096', '3a81cf42-6acf-4fbe-a225-7a1aa02c316d', '5522d672-bd32-44f4-81c9-0258b8ac6a0c', '3c1f103a-e6c6-41ac-81f4-56667cf09ec1'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:40:22 devstack sudo[107311]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8776bb32-c30d-4c7e-94c0-248e0c6e3d52 tempest-VolumeDependencyTests-804367213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0f5fa330-3bab-41e6-b208-255c853043fa.53bde034-159b-4615-8336-f16ceb0ce5e8" returned: 0 in 0.274s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-3692e24a-f37e-4637-b55a-4e44d0a03486 tempest-ProjectReaderTests-1222292119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:40:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-3692e24a-f37e-4637-b55a-4e44d0a03486 tempest-ProjectReaderTests-1222292119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:40:22 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-3692e24a-f37e-4637-b55a-4e44d0a03486 tempest-ProjectReaderTests-1222292119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:40:22 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-3692e24a-f37e-4637-b55a-4e44d0a03486 tempest-ProjectReaderTests-1222292119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:40:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-3692e24a-f37e-4637-b55a-4e44d0a03486 tempest-ProjectReaderTests-1222292119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:40:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3692e24a-f37e-4637-b55a-4e44d0a03486 tempest-ProjectReaderTests-1222292119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:22 devstack sudo[107318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:40:22 devstack sudo[107318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:22 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-8776bb32-c30d-4c7e-94c0-248e0c6e3d52 tempest-VolumeDependencyTests-804367213 None] Lock "cinder-quobyte-53bde034-159b-4615-8336-f16ceb0ce5e8" released by "_delete_snapshot" :: held 1.921s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:40:22 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-8776bb32-c30d-4c7e-94c0-248e0c6e3d52 tempest-VolumeDependencyTests-804367213 None] Lock "cinder-quobyte-0f5fa330-3bab-41e6-b208-255c853043fa" released by "delete_snapshot" :: held 1.945s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:40:22 devstack sudo[107315]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-6731ca89-38c3-4c99-9d01-d89e2e9b9063 tempest-ProjectMemberTests-1855156353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-e75c4782-0484-4ba2-a1ce-0edda64aab20.info" returned: 0 in 0.286s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:22 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-6731ca89-38c3-4c99-9d01-d89e2e9b9063 tempest-ProjectMemberTests-1855156353 None] /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-e75c4782-0484-4ba2-a1ce-0edda64aab20.info is being set with open permissions: ugo+rw Sep 15 16:40:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-6731ca89-38c3-4c99-9d01-d89e2e9b9063 tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-e75c4782-0484-4ba2-a1ce-0edda64aab20.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:22 devstack sudo[107321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-e75c4782-0484-4ba2-a1ce-0edda64aab20.info Sep 15 16:40:22 devstack sudo[107321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:22 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-8776bb32-c30d-4c7e-94c0-248e0c6e3d52 tempest-VolumeDependencyTests-804367213 None] Created reservations ['a825c113-ef5a-4a3f-bd4a-e25558a2651c', 'ce557690-6582-4441-917f-72626db4520a', '6d9e1665-34d1-4dfd-9d75-15b13679d0fd', '9f5aef18-8732-4ab4-b8d3-ccb2a30227b3'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:40:22 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-8776bb32-c30d-4c7e-94c0-248e0c6e3d52 tempest-VolumeDependencyTests-804367213 None] Delete snapshot completed successfully. Sep 15 16:40:22 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-8776bb32-c30d-4c7e-94c0-248e0c6e3d52 tempest-VolumeDependencyTests-804367213 None] Lock "cinder-53bde034-159b-4615-8336-f16ceb0ce5e8-delete_snapshot" released by "delete_snapshot" :: held 2.130s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:40:22 devstack sudo[107318]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3692e24a-f37e-4637-b55a-4e44d0a03486 tempest-ProjectReaderTests-1222292119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.312s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:22 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-3692e24a-f37e-4637-b55a-4e44d0a03486 tempest-ProjectReaderTests-1222292119 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:40:22 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-3692e24a-f37e-4637-b55a-4e44d0a03486 tempest-ProjectReaderTests-1222292119 None] Deleted volume successfully. Sep 15 16:40:22 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-3692e24a-f37e-4637-b55a-4e44d0a03486 tempest-ProjectReaderTests-1222292119 None] Lock "cinder-86a3466d-fb44-46fb-8f3a-c311234fdce6-delete_volume" released by "delete_volume" :: held 1.425s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:40:22 devstack sudo[107321]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-6731ca89-38c3-4c99-9d01-d89e2e9b9063 tempest-ProjectMemberTests-1855156353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-e75c4782-0484-4ba2-a1ce-0edda64aab20.info" returned: 0 in 0.288s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-6731ca89-38c3-4c99-9d01-d89e2e9b9063 tempest-ProjectMemberTests-1855156353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.450s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:40:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-031e32f7-3be9-4a79-9c9b-273bdf821ffa tempest-ProjectReaderTests-1964668024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.990s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:40:22 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-031e32f7-3be9-4a79-9c9b-273bdf821ffa tempest-ProjectReaderTests-1964668024 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:40:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-369239640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f34f101d-287e-4c20-a8e3-f78e3110836c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6de9a8446d25410e819cf25f0625d0b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:40:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:40:22Z,use_quota=True,user_id='52cdd2a10b274baf9b545e0df74ebcc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:40:22 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-031e32f7-3be9-4a79-9c9b-273bdf821ffa tempest-ProjectReaderTests-1964668024 None] Creating volume f34f101d-287e-4c20-a8e3-f78e3110836c {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:40:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-031e32f7-3be9-4a79-9c9b-273bdf821ffa tempest-ProjectReaderTests-1964668024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:40:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-031e32f7-3be9-4a79-9c9b-273bdf821ffa tempest-ProjectReaderTests-1964668024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:40:22 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-031e32f7-3be9-4a79-9c9b-273bdf821ffa tempest-ProjectReaderTests-1964668024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:40:22 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-031e32f7-3be9-4a79-9c9b-273bdf821ffa tempest-ProjectReaderTests-1964668024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:40:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-031e32f7-3be9-4a79-9c9b-273bdf821ffa tempest-ProjectReaderTests-1964668024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:40:22 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-031e32f7-3be9-4a79-9c9b-273bdf821ffa tempest-ProjectReaderTests-1964668024 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:40:22 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-031e32f7-3be9-4a79-9c9b-273bdf821ffa tempest-ProjectReaderTests-1964668024 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:40:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-031e32f7-3be9-4a79-9c9b-273bdf821ffa tempest-ProjectReaderTests-1964668024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-f34f101d-287e-4c20-a8e3-f78e3110836c 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:22 devstack sudo[107325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-f34f101d-287e-4c20-a8e3-f78e3110836c 1073741824 Sep 15 16:40:22 devstack sudo[107325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:22 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-6731ca89-38c3-4c99-9d01-d89e2e9b9063 tempest-ProjectMemberTests-1855156353 None] Create snapshot completed successfully Sep 15 16:40:22 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-7ba71534-fe7f-41f7-a489-cbed092cb02d tempest-ProjectMemberTests-1855156353 None] Acquiring lock "cinder-5ebe6120-4c35-4806-8825-af56be7258d7-delete_snapshot" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:40:22 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-7ba71534-fe7f-41f7-a489-cbed092cb02d tempest-ProjectMemberTests-1855156353 None] Lock "cinder-5ebe6120-4c35-4806-8825-af56be7258d7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:40:22 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-7ba71534-fe7f-41f7-a489-cbed092cb02d tempest-ProjectMemberTests-1855156353 None] Acquiring lock "cinder-quobyte-e75c4782-0484-4ba2-a1ce-0edda64aab20" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:40:22 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-7ba71534-fe7f-41f7-a489-cbed092cb02d tempest-ProjectMemberTests-1855156353 None] Lock "cinder-quobyte-e75c4782-0484-4ba2-a1ce-0edda64aab20" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:40:22 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-7ba71534-fe7f-41f7-a489-cbed092cb02d tempest-ProjectMemberTests-1855156353 None] Acquiring lock "cinder-quobyte-5ebe6120-4c35-4806-8825-af56be7258d7" by "_delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:40:22 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-7ba71534-fe7f-41f7-a489-cbed092cb02d tempest-ProjectMemberTests-1855156353 None] Lock "cinder-quobyte-5ebe6120-4c35-4806-8825-af56be7258d7" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:40:22 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-7ba71534-fe7f-41f7-a489-cbed092cb02d tempest-ProjectMemberTests-1855156353 None] Deleting offline snapshot 5ebe6120-4c35-4806-8825-af56be7258d7 of volume e75c4782-0484-4ba2-a1ce-0edda64aab20 {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 15 16:40:22 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-7ba71534-fe7f-41f7-a489-cbed092cb02d tempest-ProjectMemberTests-1855156353 None] snapshot_file for this snap is: volume-e75c4782-0484-4ba2-a1ce-0edda64aab20.5ebe6120-4c35-4806-8825-af56be7258d7 {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 15 16:40:22 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0bc5686-e813-4046-badb-f6fa95b667b8]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:40:22 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7ba71534-fe7f-41f7-a489-cbed092cb02d tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-e75c4782-0484-4ba2-a1ce-0edda64aab20.5ebe6120-4c35-4806-8825-af56be7258d7 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:23 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-ac43490c-9566-44c3-bd11-b4056088e617 tempest-ProjectReaderTests-1222292119 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:40:23 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ac43490c-9566-44c3-bd11-b4056088e617 tempest-ProjectReaderTests-1222292119 None] Flow 'volume_create_manager' (3eff39bd-1751-4888-baa8-25d99d0c6e8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:40:23 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ac43490c-9566-44c3-bd11-b4056088e617 tempest-ProjectReaderTests-1222292119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3d54a0b-b183-484c-83ed-7c2e7b2ee571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:40:23 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ac43490c-9566-44c3-bd11-b4056088e617 tempest-ProjectReaderTests-1222292119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3d54a0b-b183-484c-83ed-7c2e7b2ee571) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:40:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1507474372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c72a2188-ad3b-4a6c-8496-d29ef8d0acb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00865779659d4fad89bd76494c8544b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:40:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:40:23Z,use_quota=True,user_id='d3de3e08584e4e9aaa0e1f0ccaeb73c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:40:23 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ac43490c-9566-44c3-bd11-b4056088e617 tempest-ProjectReaderTests-1222292119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08f82067-e816-4afa-b87a-95528e965ae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:40:23 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ac43490c-9566-44c3-bd11-b4056088e617 tempest-ProjectReaderTests-1222292119 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08f82067-e816-4afa-b87a-95528e965ae9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:40:23 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ac43490c-9566-44c3-bd11-b4056088e617 tempest-ProjectReaderTests-1222292119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56517b9b-dd40-48b9-8839-efd39f395b32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:40:23 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ac43490c-9566-44c3-bd11-b4056088e617 tempest-ProjectReaderTests-1222292119 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56517b9b-dd40-48b9-8839-efd39f395b32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c72a2188-ad3b-4a6c-8496-d29ef8d0acb1', 'volume_name': 'volume-c72a2188-ad3b-4a6c-8496-d29ef8d0acb1', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:40:23 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ac43490c-9566-44c3-bd11-b4056088e617 tempest-ProjectReaderTests-1222292119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85949507-29b0-48ac-a060-a41ba6556983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:40:23 devstack sudo[107330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-e75c4782-0484-4ba2-a1ce-0edda64aab20.5ebe6120-4c35-4806-8825-af56be7258d7 Sep 15 16:40:23 devstack sudo[107330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:23 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ac43490c-9566-44c3-bd11-b4056088e617 tempest-ProjectReaderTests-1222292119 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85949507-29b0-48ac-a060-a41ba6556983) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:40:23 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ac43490c-9566-44c3-bd11-b4056088e617 tempest-ProjectReaderTests-1222292119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (839fdd92-0617-46ff-b67e-80071ae6d513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:40:23 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-ac43490c-9566-44c3-bd11-b4056088e617 tempest-ProjectReaderTests-1222292119 None] Volume c72a2188-ad3b-4a6c-8496-d29ef8d0acb1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c72a2188-ad3b-4a6c-8496-d29ef8d0acb1', 'volume_size': 1} Sep 15 16:40:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-ac43490c-9566-44c3-bd11-b4056088e617 tempest-ProjectReaderTests-1222292119 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:40:23 devstack sudo[107325]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-031e32f7-3be9-4a79-9c9b-273bdf821ffa tempest-ProjectReaderTests-1964668024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-f34f101d-287e-4c20-a8e3-f78e3110836c 1073741824" returned: 0 in 0.566s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-031e32f7-3be9-4a79-9c9b-273bdf821ffa tempest-ProjectReaderTests-1964668024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-f34f101d-287e-4c20-a8e3-f78e3110836c {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:23 devstack sudo[107333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-f34f101d-287e-4c20-a8e3-f78e3110836c Sep 15 16:40:23 devstack sudo[107333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:23 devstack sudo[107330]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7ba71534-fe7f-41f7-a489-cbed092cb02d tempest-ProjectMemberTests-1855156353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-e75c4782-0484-4ba2-a1ce-0edda64aab20.5ebe6120-4c35-4806-8825-af56be7258d7" returned: 0 in 0.427s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:23 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-7ba71534-fe7f-41f7-a489-cbed092cb02d tempest-ProjectMemberTests-1855156353 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e75c4782-0484-4ba2-a1ce-0edda64aab20(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 16:40:23 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8a96e9a-c6e3-4fd5-84ab-a27371ab2c7f]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:40:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7ba71534-fe7f-41f7-a489-cbed092cb02d tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-e75c4782-0484-4ba2-a1ce-0edda64aab20 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:23 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-1c92e911-9ed0-482b-b2bd-3cad4551970d tempest-VolumeDependencyTests-804367213 None] Acquiring lock "cinder-0f5fa330-3bab-41e6-b208-255c853043fa-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:40:23 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-1c92e911-9ed0-482b-b2bd-3cad4551970d tempest-VolumeDependencyTests-804367213 None] Lock "cinder-0f5fa330-3bab-41e6-b208-255c853043fa-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:40:23 devstack sudo[107333]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-031e32f7-3be9-4a79-9c9b-273bdf821ffa tempest-ProjectReaderTests-1964668024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-f34f101d-287e-4c20-a8e3-f78e3110836c" returned: 0 in 0.286s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:23 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-031e32f7-3be9-4a79-9c9b-273bdf821ffa tempest-ProjectReaderTests-1964668024 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:40:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-031e32f7-3be9-4a79-9c9b-273bdf821ffa tempest-ProjectReaderTests-1964668024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.899s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:40:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-ac43490c-9566-44c3-bd11-b4056088e617 tempest-ProjectReaderTests-1222292119 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.413s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:40:23 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-ac43490c-9566-44c3-bd11-b4056088e617 tempest-ProjectReaderTests-1222292119 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:40:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1507474372',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c72a2188-ad3b-4a6c-8496-d29ef8d0acb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00865779659d4fad89bd76494c8544b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:40:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:40:23Z,use_quota=True,user_id='d3de3e08584e4e9aaa0e1f0ccaeb73c5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:40:23 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-ac43490c-9566-44c3-bd11-b4056088e617 tempest-ProjectReaderTests-1222292119 None] Creating volume c72a2188-ad3b-4a6c-8496-d29ef8d0acb1 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:40:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-ac43490c-9566-44c3-bd11-b4056088e617 tempest-ProjectReaderTests-1222292119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:40:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-ac43490c-9566-44c3-bd11-b4056088e617 tempest-ProjectReaderTests-1222292119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:40:23 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-ac43490c-9566-44c3-bd11-b4056088e617 tempest-ProjectReaderTests-1222292119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:40:23 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-ac43490c-9566-44c3-bd11-b4056088e617 tempest-ProjectReaderTests-1222292119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:40:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-ac43490c-9566-44c3-bd11-b4056088e617 tempest-ProjectReaderTests-1222292119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:40:23 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-ac43490c-9566-44c3-bd11-b4056088e617 tempest-ProjectReaderTests-1222292119 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:40:23 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-ac43490c-9566-44c3-bd11-b4056088e617 tempest-ProjectReaderTests-1222292119 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:40:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ac43490c-9566-44c3-bd11-b4056088e617 tempest-ProjectReaderTests-1222292119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c72a2188-ad3b-4a6c-8496-d29ef8d0acb1 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:23 devstack sudo[107338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-e75c4782-0484-4ba2-a1ce-0edda64aab20 Sep 15 16:40:23 devstack sudo[107338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:23 devstack sudo[107340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c72a2188-ad3b-4a6c-8496-d29ef8d0acb1 1073741824 Sep 15 16:40:23 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-1c92e911-9ed0-482b-b2bd-3cad4551970d tempest-VolumeDependencyTests-804367213 None] Acquiring lock "cinder-quobyte-0f5fa330-3bab-41e6-b208-255c853043fa" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:40:23 devstack sudo[107340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:23 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-031e32f7-3be9-4a79-9c9b-273bdf821ffa tempest-ProjectReaderTests-1964668024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (524d8272-ee61-4f5d-b695-b63b52eb4841) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f34f101d-287e-4c20-a8e3-f78e3110836c', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:40:23 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-031e32f7-3be9-4a79-9c9b-273bdf821ffa tempest-ProjectReaderTests-1964668024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1408342e-1231-4490-b70b-0505f89e9705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:40:23 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-1c92e911-9ed0-482b-b2bd-3cad4551970d tempest-VolumeDependencyTests-804367213 None] Lock "cinder-quobyte-0f5fa330-3bab-41e6-b208-255c853043fa" acquired by "delete_volume" :: waited 0.044s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:40:23 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-031e32f7-3be9-4a79-9c9b-273bdf821ffa tempest-ProjectReaderTests-1964668024 None] Volume volume-f34f101d-287e-4c20-a8e3-f78e3110836c (f34f101d-287e-4c20-a8e3-f78e3110836c): created successfully Sep 15 16:40:23 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-031e32f7-3be9-4a79-9c9b-273bdf821ffa tempest-ProjectReaderTests-1964668024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1408342e-1231-4490-b70b-0505f89e9705) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:40:23 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-031e32f7-3be9-4a79-9c9b-273bdf821ffa tempest-ProjectReaderTests-1964668024 None] Flow 'volume_create_manager' (aeb1c5a4-5b48-4a8c-98f7-7db8e81ac532) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:40:23 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6867330-2aa3-46b6-89f3-26c6821302a9]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:40:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-1c92e911-9ed0-482b-b2bd-3cad4551970d tempest-VolumeDependencyTests-804367213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0f5fa330-3bab-41e6-b208-255c853043fa {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:23 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-031e32f7-3be9-4a79-9c9b-273bdf821ffa tempest-ProjectReaderTests-1964668024 None] Created volume successfully. Sep 15 16:40:23 devstack sudo[107343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0f5fa330-3bab-41e6-b208-255c853043fa Sep 15 16:40:23 devstack sudo[107343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:23 devstack sudo[107338]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7ba71534-fe7f-41f7-a489-cbed092cb02d tempest-ProjectMemberTests-1855156353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-e75c4782-0484-4ba2-a1ce-0edda64aab20" returned: 0 in 0.456s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:23 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7ba71534-fe7f-41f7-a489-cbed092cb02d tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-e75c4782-0484-4ba2-a1ce-0edda64aab20.5ebe6120-4c35-4806-8825-af56be7258d7 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:23 devstack sudo[107351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-e75c4782-0484-4ba2-a1ce-0edda64aab20.5ebe6120-4c35-4806-8825-af56be7258d7 Sep 15 16:40:23 devstack sudo[107351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:24 devstack sudo[107340]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ac43490c-9566-44c3-bd11-b4056088e617 tempest-ProjectReaderTests-1222292119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c72a2188-ad3b-4a6c-8496-d29ef8d0acb1 1073741824" returned: 0 in 0.529s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ac43490c-9566-44c3-bd11-b4056088e617 tempest-ProjectReaderTests-1222292119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c72a2188-ad3b-4a6c-8496-d29ef8d0acb1 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:24 devstack sudo[107358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c72a2188-ad3b-4a6c-8496-d29ef8d0acb1 Sep 15 16:40:24 devstack sudo[107358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:24 devstack sudo[107343]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-1c92e911-9ed0-482b-b2bd-3cad4551970d tempest-VolumeDependencyTests-804367213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0f5fa330-3bab-41e6-b208-255c853043fa" returned: 0 in 0.468s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-1c92e911-9ed0-482b-b2bd-3cad4551970d tempest-VolumeDependencyTests-804367213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0f5fa330-3bab-41e6-b208-255c853043fa {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:24 devstack sudo[107362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0f5fa330-3bab-41e6-b208-255c853043fa Sep 15 16:40:24 devstack sudo[107362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:24 devstack sudo[107351]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7ba71534-fe7f-41f7-a489-cbed092cb02d tempest-ProjectMemberTests-1855156353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-e75c4782-0484-4ba2-a1ce-0edda64aab20.5ebe6120-4c35-4806-8825-af56be7258d7" returned: 0 in 0.391s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7ba71534-fe7f-41f7-a489-cbed092cb02d tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-e75c4782-0484-4ba2-a1ce-0edda64aab20.5ebe6120-4c35-4806-8825-af56be7258d7 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:24 devstack sudo[107364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-e75c4782-0484-4ba2-a1ce-0edda64aab20.5ebe6120-4c35-4806-8825-af56be7258d7 Sep 15 16:40:24 devstack sudo[107364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:24 devstack sudo[107358]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ac43490c-9566-44c3-bd11-b4056088e617 tempest-ProjectReaderTests-1222292119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c72a2188-ad3b-4a6c-8496-d29ef8d0acb1" returned: 0 in 0.281s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:24 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-ac43490c-9566-44c3-bd11-b4056088e617 tempest-ProjectReaderTests-1222292119 None] <== create_volume: return (860ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:40:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-ac43490c-9566-44c3-bd11-b4056088e617 tempest-ProjectReaderTests-1222292119 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.863s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:40:24 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ac43490c-9566-44c3-bd11-b4056088e617 tempest-ProjectReaderTests-1222292119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (839fdd92-0617-46ff-b67e-80071ae6d513) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c72a2188-ad3b-4a6c-8496-d29ef8d0acb1', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:40:24 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ac43490c-9566-44c3-bd11-b4056088e617 tempest-ProjectReaderTests-1222292119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acf61312-41d5-437c-a9ae-1d69ae0f088e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:40:24 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-ac43490c-9566-44c3-bd11-b4056088e617 tempest-ProjectReaderTests-1222292119 None] Volume volume-c72a2188-ad3b-4a6c-8496-d29ef8d0acb1 (c72a2188-ad3b-4a6c-8496-d29ef8d0acb1): created successfully Sep 15 16:40:24 devstack sudo[107362]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:24 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ac43490c-9566-44c3-bd11-b4056088e617 tempest-ProjectReaderTests-1222292119 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (acf61312-41d5-437c-a9ae-1d69ae0f088e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:40:24 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ac43490c-9566-44c3-bd11-b4056088e617 tempest-ProjectReaderTests-1222292119 None] Flow 'volume_create_manager' (3eff39bd-1751-4888-baa8-25d99d0c6e8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:40:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-1c92e911-9ed0-482b-b2bd-3cad4551970d tempest-VolumeDependencyTests-804367213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-0f5fa330-3bab-41e6-b208-255c853043fa" returned: 0 in 0.282s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:24 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-ac43490c-9566-44c3-bd11-b4056088e617 tempest-ProjectReaderTests-1222292119 None] Created volume successfully. Sep 15 16:40:24 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-1c92e911-9ed0-482b-b2bd-3cad4551970d tempest-VolumeDependencyTests-804367213 None] Lock "cinder-quobyte-0f5fa330-3bab-41e6-b208-255c853043fa" released by "delete_volume" :: held 0.842s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:40:24 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-1c92e911-9ed0-482b-b2bd-3cad4551970d tempest-VolumeDependencyTests-804367213 None] Created reservations ['50c5baba-ccf0-4150-8108-117588dc6003', 'f5c06ec1-de1f-4b46-a29a-3dde2aee4750', '75778e43-670f-425b-ba82-8733c5b1e902', '12b9b372-b9af-46d3-a4b8-e9ee96bfbd01'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:40:24 devstack sudo[107364]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7ba71534-fe7f-41f7-a489-cbed092cb02d tempest-ProjectMemberTests-1855156353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-e75c4782-0484-4ba2-a1ce-0edda64aab20.5ebe6120-4c35-4806-8825-af56be7258d7" returned: 0 in 0.269s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:24 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-7ba71534-fe7f-41f7-a489-cbed092cb02d tempest-ProjectMemberTests-1855156353 None] Lock "cinder-quobyte-5ebe6120-4c35-4806-8825-af56be7258d7" released by "_delete_snapshot" :: held 1.680s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:40:24 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-7ba71534-fe7f-41f7-a489-cbed092cb02d tempest-ProjectMemberTests-1855156353 None] Lock "cinder-quobyte-e75c4782-0484-4ba2-a1ce-0edda64aab20" released by "delete_snapshot" :: held 1.705s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:40:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-1c92e911-9ed0-482b-b2bd-3cad4551970d tempest-VolumeDependencyTests-804367213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:40:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-1c92e911-9ed0-482b-b2bd-3cad4551970d tempest-VolumeDependencyTests-804367213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:40:24 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-1c92e911-9ed0-482b-b2bd-3cad4551970d tempest-VolumeDependencyTests-804367213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:40:24 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-1c92e911-9ed0-482b-b2bd-3cad4551970d tempest-VolumeDependencyTests-804367213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:40:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-1c92e911-9ed0-482b-b2bd-3cad4551970d tempest-VolumeDependencyTests-804367213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:40:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-1c92e911-9ed0-482b-b2bd-3cad4551970d tempest-VolumeDependencyTests-804367213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:24 devstack sudo[107369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:40:24 devstack sudo[107369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:24 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-7ba71534-fe7f-41f7-a489-cbed092cb02d tempest-ProjectMemberTests-1855156353 None] Created reservations ['e64c2e2e-cadf-43e2-9013-e5861d0d7fbc', '295eb069-b011-4caa-bf40-1c173f129c9c', 'f949be1d-a45c-4e6c-b355-dc2f7418d822', 'ec80dbf7-c9ef-477a-8d0a-cf3d6037336c'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:40:24 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-4fae6382-050c-4834-8d13-09d506afbbb5 tempest-VolumeDependencyTests-804367213 None] Acquiring lock "cinder-baf39207-4c10-4091-a3fe-19d3afcf5b80-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:40:24 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-4fae6382-050c-4834-8d13-09d506afbbb5 tempest-VolumeDependencyTests-804367213 None] Lock "cinder-baf39207-4c10-4091-a3fe-19d3afcf5b80-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:40:24 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-7ba71534-fe7f-41f7-a489-cbed092cb02d tempest-ProjectMemberTests-1855156353 None] Delete snapshot completed successfully. Sep 15 16:40:24 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-7ba71534-fe7f-41f7-a489-cbed092cb02d tempest-ProjectMemberTests-1855156353 None] Lock "cinder-5ebe6120-4c35-4806-8825-af56be7258d7-delete_snapshot" released by "delete_snapshot" :: held 1.936s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:40:24 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-4fae6382-050c-4834-8d13-09d506afbbb5 tempest-VolumeDependencyTests-804367213 None] Acquiring lock "cinder-quobyte-baf39207-4c10-4091-a3fe-19d3afcf5b80" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:40:24 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-4fae6382-050c-4834-8d13-09d506afbbb5 tempest-VolumeDependencyTests-804367213 None] Lock "cinder-quobyte-baf39207-4c10-4091-a3fe-19d3afcf5b80" acquired by "delete_volume" :: waited 0.026s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:40:24 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[0faffcab-fda6-4524-9e00-8cbfd7c2172e]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:40:24 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4fae6382-050c-4834-8d13-09d506afbbb5 tempest-VolumeDependencyTests-804367213 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-baf39207-4c10-4091-a3fe-19d3afcf5b80 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:25 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-1da4a0be-1235-42a8-87d8-15f22745ad74 tempest-ProjectReaderTests-1964668024 None] Acquiring lock "cinder-f34f101d-287e-4c20-a8e3-f78e3110836c-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:40:25 devstack sudo[107369]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:25 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-1da4a0be-1235-42a8-87d8-15f22745ad74 tempest-ProjectReaderTests-1964668024 None] Lock "cinder-f34f101d-287e-4c20-a8e3-f78e3110836c-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:40:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-1c92e911-9ed0-482b-b2bd-3cad4551970d tempest-VolumeDependencyTests-804367213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.406s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:25 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-1c92e911-9ed0-482b-b2bd-3cad4551970d tempest-VolumeDependencyTests-804367213 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:40:25 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-1c92e911-9ed0-482b-b2bd-3cad4551970d tempest-VolumeDependencyTests-804367213 None] Deleted volume successfully. Sep 15 16:40:25 devstack sudo[107371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-baf39207-4c10-4091-a3fe-19d3afcf5b80 Sep 15 16:40:25 devstack sudo[107371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:25 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-1c92e911-9ed0-482b-b2bd-3cad4551970d tempest-VolumeDependencyTests-804367213 None] Lock "cinder-0f5fa330-3bab-41e6-b208-255c853043fa-delete_volume" released by "delete_volume" :: held 1.605s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:40:25 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-0ab8efea-e4aa-4982-b555-715e213a6a11 tempest-ProjectMemberTests-1855156353 None] Acquiring lock "cinder-e75c4782-0484-4ba2-a1ce-0edda64aab20-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:40:25 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-1da4a0be-1235-42a8-87d8-15f22745ad74 tempest-ProjectReaderTests-1964668024 None] Acquiring lock "cinder-quobyte-f34f101d-287e-4c20-a8e3-f78e3110836c" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:40:25 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-a8930045-9f04-488b-bb91-03a6422df3a8 tempest-ProjectReaderTests-1222292119 None] Acquiring lock "cinder-c72a2188-ad3b-4a6c-8496-d29ef8d0acb1-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:40:25 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-0ab8efea-e4aa-4982-b555-715e213a6a11 tempest-ProjectMemberTests-1855156353 None] Lock "cinder-e75c4782-0484-4ba2-a1ce-0edda64aab20-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:40:25 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-1da4a0be-1235-42a8-87d8-15f22745ad74 tempest-ProjectReaderTests-1964668024 None] Lock "cinder-quobyte-f34f101d-287e-4c20-a8e3-f78e3110836c" acquired by "delete_volume" :: waited 0.047s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:40:25 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-a8930045-9f04-488b-bb91-03a6422df3a8 tempest-ProjectReaderTests-1222292119 None] Lock "cinder-c72a2188-ad3b-4a6c-8496-d29ef8d0acb1-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:40:25 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[802de19b-d447-484d-85d5-0d2e40875065]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:40:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-1da4a0be-1235-42a8-87d8-15f22745ad74 tempest-ProjectReaderTests-1964668024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-f34f101d-287e-4c20-a8e3-f78e3110836c {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:25 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-0ab8efea-e4aa-4982-b555-715e213a6a11 tempest-ProjectMemberTests-1855156353 None] Acquiring lock "cinder-quobyte-e75c4782-0484-4ba2-a1ce-0edda64aab20" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:40:25 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-a8930045-9f04-488b-bb91-03a6422df3a8 tempest-ProjectReaderTests-1222292119 None] Acquiring lock "cinder-quobyte-c72a2188-ad3b-4a6c-8496-d29ef8d0acb1" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:40:25 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-0ab8efea-e4aa-4982-b555-715e213a6a11 tempest-ProjectMemberTests-1855156353 None] Lock "cinder-quobyte-e75c4782-0484-4ba2-a1ce-0edda64aab20" acquired by "delete_volume" :: waited 0.023s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:40:25 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-a8930045-9f04-488b-bb91-03a6422df3a8 tempest-ProjectReaderTests-1222292119 None] Lock "cinder-quobyte-c72a2188-ad3b-4a6c-8496-d29ef8d0acb1" acquired by "delete_volume" :: waited 0.063s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:40:25 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[4536348d-7081-41bd-9b29-acd24c2018b2]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:40:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0ab8efea-e4aa-4982-b555-715e213a6a11 tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-e75c4782-0484-4ba2-a1ce-0edda64aab20 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:25 devstack sudo[107374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-f34f101d-287e-4c20-a8e3-f78e3110836c Sep 15 16:40:25 devstack sudo[107374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:25 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[0985a941-67ae-45f4-8219-f1500a786115]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:40:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a8930045-9f04-488b-bb91-03a6422df3a8 tempest-ProjectReaderTests-1222292119 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c72a2188-ad3b-4a6c-8496-d29ef8d0acb1 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:25 devstack sudo[107371]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4fae6382-050c-4834-8d13-09d506afbbb5 tempest-VolumeDependencyTests-804367213 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-baf39207-4c10-4091-a3fe-19d3afcf5b80" returned: 0 in 0.546s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4fae6382-050c-4834-8d13-09d506afbbb5 tempest-VolumeDependencyTests-804367213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-baf39207-4c10-4091-a3fe-19d3afcf5b80 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:25 devstack sudo[107381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-baf39207-4c10-4091-a3fe-19d3afcf5b80 Sep 15 16:40:25 devstack sudo[107381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:25 devstack sudo[107379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-e75c4782-0484-4ba2-a1ce-0edda64aab20 Sep 15 16:40:25 devstack sudo[107379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:25 devstack sudo[107380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c72a2188-ad3b-4a6c-8496-d29ef8d0acb1 Sep 15 16:40:25 devstack sudo[107380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:25 devstack sudo[107374]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-1da4a0be-1235-42a8-87d8-15f22745ad74 tempest-ProjectReaderTests-1964668024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-f34f101d-287e-4c20-a8e3-f78e3110836c" returned: 0 in 0.401s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-1da4a0be-1235-42a8-87d8-15f22745ad74 tempest-ProjectReaderTests-1964668024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-f34f101d-287e-4c20-a8e3-f78e3110836c {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:25 devstack sudo[107389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-f34f101d-287e-4c20-a8e3-f78e3110836c Sep 15 16:40:25 devstack sudo[107389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:25 devstack sudo[107381]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4fae6382-050c-4834-8d13-09d506afbbb5 tempest-VolumeDependencyTests-804367213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-baf39207-4c10-4091-a3fe-19d3afcf5b80" returned: 0 in 0.294s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:25 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-4fae6382-050c-4834-8d13-09d506afbbb5 tempest-VolumeDependencyTests-804367213 None] Lock "cinder-quobyte-baf39207-4c10-4091-a3fe-19d3afcf5b80" released by "delete_volume" :: held 0.903s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:40:25 devstack sudo[107379]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0ab8efea-e4aa-4982-b555-715e213a6a11 tempest-ProjectMemberTests-1855156353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-e75c4782-0484-4ba2-a1ce-0edda64aab20" returned: 0 in 0.427s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0ab8efea-e4aa-4982-b555-715e213a6a11 tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-e75c4782-0484-4ba2-a1ce-0edda64aab20 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:25 devstack sudo[107380]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a8930045-9f04-488b-bb91-03a6422df3a8 tempest-ProjectReaderTests-1222292119 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c72a2188-ad3b-4a6c-8496-d29ef8d0acb1" returned: 0 in 0.433s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:25 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a8930045-9f04-488b-bb91-03a6422df3a8 tempest-ProjectReaderTests-1222292119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c72a2188-ad3b-4a6c-8496-d29ef8d0acb1 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:25 devstack sudo[107399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-e75c4782-0484-4ba2-a1ce-0edda64aab20 Sep 15 16:40:25 devstack sudo[107399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:25 devstack sudo[107400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c72a2188-ad3b-4a6c-8496-d29ef8d0acb1 Sep 15 16:40:25 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-4fae6382-050c-4834-8d13-09d506afbbb5 tempest-VolumeDependencyTests-804367213 None] Created reservations ['675a82ff-4736-4030-a3b9-f9437accf028', '89e9c97a-7d1c-4318-bf16-19168bfcef5c', '3f2f6500-8b26-474f-83be-e27ec6524577', 'cbd8c5c2-9cae-456e-b168-ca583e52c018'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:40:25 devstack sudo[107400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-4fae6382-050c-4834-8d13-09d506afbbb5 tempest-VolumeDependencyTests-804367213 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:40:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-4fae6382-050c-4834-8d13-09d506afbbb5 tempest-VolumeDependencyTests-804367213 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:40:26 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-4fae6382-050c-4834-8d13-09d506afbbb5 tempest-VolumeDependencyTests-804367213 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:40:26 devstack sudo[107389]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:26 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-4fae6382-050c-4834-8d13-09d506afbbb5 tempest-VolumeDependencyTests-804367213 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:40:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-4fae6382-050c-4834-8d13-09d506afbbb5 tempest-VolumeDependencyTests-804367213 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:40:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4fae6382-050c-4834-8d13-09d506afbbb5 tempest-VolumeDependencyTests-804367213 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-1da4a0be-1235-42a8-87d8-15f22745ad74 tempest-ProjectReaderTests-1964668024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-f34f101d-287e-4c20-a8e3-f78e3110836c" returned: 0 in 0.346s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:26 devstack sudo[107404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:40:26 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-1da4a0be-1235-42a8-87d8-15f22745ad74 tempest-ProjectReaderTests-1964668024 None] Lock "cinder-quobyte-f34f101d-287e-4c20-a8e3-f78e3110836c" released by "delete_volume" :: held 0.818s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:40:26 devstack sudo[107404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:26 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-1da4a0be-1235-42a8-87d8-15f22745ad74 tempest-ProjectReaderTests-1964668024 None] Created reservations ['60c9206b-6b1b-4f5b-b11e-bd70ac7649a0', 'f42af08c-d902-4f7c-be5b-f97edc07cfb1', '163ff25b-c5e6-4d83-856a-6252cccb91ff', 'c632c2eb-b27a-4e31-87c1-181b919f1988'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:40:26 devstack sudo[107399]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0ab8efea-e4aa-4982-b555-715e213a6a11 tempest-ProjectMemberTests-1855156353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-e75c4782-0484-4ba2-a1ce-0edda64aab20" returned: 0 in 0.308s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:26 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-0ab8efea-e4aa-4982-b555-715e213a6a11 tempest-ProjectMemberTests-1855156353 None] Lock "cinder-quobyte-e75c4782-0484-4ba2-a1ce-0edda64aab20" released by "delete_volume" :: held 0.824s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:40:26 devstack sudo[107400]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a8930045-9f04-488b-bb91-03a6422df3a8 tempest-ProjectReaderTests-1222292119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c72a2188-ad3b-4a6c-8496-d29ef8d0acb1" returned: 0 in 0.340s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:26 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-a8930045-9f04-488b-bb91-03a6422df3a8 tempest-ProjectReaderTests-1222292119 None] Lock "cinder-quobyte-c72a2188-ad3b-4a6c-8496-d29ef8d0acb1" released by "delete_volume" :: held 0.831s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:40:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-1da4a0be-1235-42a8-87d8-15f22745ad74 tempest-ProjectReaderTests-1964668024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:40:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-1da4a0be-1235-42a8-87d8-15f22745ad74 tempest-ProjectReaderTests-1964668024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:40:26 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-1da4a0be-1235-42a8-87d8-15f22745ad74 tempest-ProjectReaderTests-1964668024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:40:26 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-1da4a0be-1235-42a8-87d8-15f22745ad74 tempest-ProjectReaderTests-1964668024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:40:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-1da4a0be-1235-42a8-87d8-15f22745ad74 tempest-ProjectReaderTests-1964668024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:40:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-1da4a0be-1235-42a8-87d8-15f22745ad74 tempest-ProjectReaderTests-1964668024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:26 devstack sudo[107404]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:26 devstack sudo[107409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:40:26 devstack sudo[107409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4fae6382-050c-4834-8d13-09d506afbbb5 tempest-VolumeDependencyTests-804367213 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.339s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:26 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-4fae6382-050c-4834-8d13-09d506afbbb5 tempest-VolumeDependencyTests-804367213 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:40:26 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-4fae6382-050c-4834-8d13-09d506afbbb5 tempest-VolumeDependencyTests-804367213 None] Deleted volume successfully. Sep 15 16:40:26 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-0ab8efea-e4aa-4982-b555-715e213a6a11 tempest-ProjectMemberTests-1855156353 None] Created reservations ['17fa5fe0-0bce-4965-9fd7-83973a2b4114', '390ef8ae-8c25-4516-a5fd-2f51bb9e56b7', '4275bb91-ab3e-4424-a483-58f789734d86', 'b75e18db-c33f-46e1-95ad-8f0ed6e8f2e1'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:40:26 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-a8930045-9f04-488b-bb91-03a6422df3a8 tempest-ProjectReaderTests-1222292119 None] Created reservations ['f8d89759-4819-454c-89c9-2338e544c325', '94c21187-12cb-4458-bc66-dba006866fbf', '0435ee41-237d-4c59-a89d-757c9b570e0c', '95ef9726-74bd-478b-9d33-300298a9b131'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:40:26 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-4fae6382-050c-4834-8d13-09d506afbbb5 tempest-VolumeDependencyTests-804367213 None] Lock "cinder-baf39207-4c10-4091-a3fe-19d3afcf5b80-delete_volume" released by "delete_volume" :: held 1.613s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:40:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-0ab8efea-e4aa-4982-b555-715e213a6a11 tempest-ProjectMemberTests-1855156353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:40:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-0ab8efea-e4aa-4982-b555-715e213a6a11 tempest-ProjectMemberTests-1855156353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:40:26 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-0ab8efea-e4aa-4982-b555-715e213a6a11 tempest-ProjectMemberTests-1855156353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:40:26 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-0ab8efea-e4aa-4982-b555-715e213a6a11 tempest-ProjectMemberTests-1855156353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:40:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-0ab8efea-e4aa-4982-b555-715e213a6a11 tempest-ProjectMemberTests-1855156353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:40:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0ab8efea-e4aa-4982-b555-715e213a6a11 tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-a8930045-9f04-488b-bb91-03a6422df3a8 tempest-ProjectReaderTests-1222292119 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:40:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-a8930045-9f04-488b-bb91-03a6422df3a8 tempest-ProjectReaderTests-1222292119 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:40:26 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-a8930045-9f04-488b-bb91-03a6422df3a8 tempest-ProjectReaderTests-1222292119 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:40:26 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-a8930045-9f04-488b-bb91-03a6422df3a8 tempest-ProjectReaderTests-1222292119 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:40:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-a8930045-9f04-488b-bb91-03a6422df3a8 tempest-ProjectReaderTests-1222292119 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:40:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a8930045-9f04-488b-bb91-03a6422df3a8 tempest-ProjectReaderTests-1222292119 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:26 devstack sudo[107411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:40:26 devstack sudo[107411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:26 devstack sudo[107412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:40:26 devstack sudo[107412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:26 devstack sudo[107409]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-1da4a0be-1235-42a8-87d8-15f22745ad74 tempest-ProjectReaderTests-1964668024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.377s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:26 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-1da4a0be-1235-42a8-87d8-15f22745ad74 tempest-ProjectReaderTests-1964668024 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:40:26 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-1da4a0be-1235-42a8-87d8-15f22745ad74 tempest-ProjectReaderTests-1964668024 None] Deleted volume successfully. Sep 15 16:40:26 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-1da4a0be-1235-42a8-87d8-15f22745ad74 tempest-ProjectReaderTests-1964668024 None] Lock "cinder-f34f101d-287e-4c20-a8e3-f78e3110836c-delete_volume" released by "delete_volume" :: held 1.636s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:40:26 devstack sudo[107412]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-a8930045-9f04-488b-bb91-03a6422df3a8 tempest-ProjectReaderTests-1222292119 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.293s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:26 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-a8930045-9f04-488b-bb91-03a6422df3a8 tempest-ProjectReaderTests-1222292119 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:40:26 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-a8930045-9f04-488b-bb91-03a6422df3a8 tempest-ProjectReaderTests-1222292119 None] Deleted volume successfully. Sep 15 16:40:26 devstack sudo[107411]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0ab8efea-e4aa-4982-b555-715e213a6a11 tempest-ProjectMemberTests-1855156353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.340s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:26 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-0ab8efea-e4aa-4982-b555-715e213a6a11 tempest-ProjectMemberTests-1855156353 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:40:26 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-0ab8efea-e4aa-4982-b555-715e213a6a11 tempest-ProjectMemberTests-1855156353 None] Deleted volume successfully. Sep 15 16:40:26 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-a8930045-9f04-488b-bb91-03a6422df3a8 tempest-ProjectReaderTests-1222292119 None] Lock "cinder-c72a2188-ad3b-4a6c-8496-d29ef8d0acb1-delete_volume" released by "delete_volume" :: held 1.602s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:40:26 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-78a8f961-19bd-413c-9e78-6d18c50db73c tempest-ProjectReaderTests-1964668024 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:40:26 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-78a8f961-19bd-413c-9e78-6d18c50db73c tempest-ProjectReaderTests-1964668024 None] Flow 'volume_create_manager' (77b32645-f002-44a1-9e18-26db532a3c83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:40:26 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-78a8f961-19bd-413c-9e78-6d18c50db73c tempest-ProjectReaderTests-1964668024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fb74ce3-443e-45bb-8729-8ca7d48b7d3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:40:26 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-0ab8efea-e4aa-4982-b555-715e213a6a11 tempest-ProjectMemberTests-1855156353 None] Lock "cinder-e75c4782-0484-4ba2-a1ce-0edda64aab20-delete_volume" released by "delete_volume" :: held 1.686s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:40:26 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-78a8f961-19bd-413c-9e78-6d18c50db73c tempest-ProjectReaderTests-1964668024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fb74ce3-443e-45bb-8729-8ca7d48b7d3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:40:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1582628835',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=081b3553-a1f5-4f4d-a554-9da4873a1615,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6de9a8446d25410e819cf25f0625d0b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:40:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:40:27Z,use_quota=True,user_id='52cdd2a10b274baf9b545e0df74ebcc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:40:26 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-78a8f961-19bd-413c-9e78-6d18c50db73c tempest-ProjectReaderTests-1964668024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5729bb64-bf1e-4dd4-a511-cca1f7a0fc71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:40:26 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-78a8f961-19bd-413c-9e78-6d18c50db73c tempest-ProjectReaderTests-1964668024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5729bb64-bf1e-4dd4-a511-cca1f7a0fc71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:40:26 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-78a8f961-19bd-413c-9e78-6d18c50db73c tempest-ProjectReaderTests-1964668024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (063538db-2493-48db-a794-e352a0da212d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:40:26 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-78a8f961-19bd-413c-9e78-6d18c50db73c tempest-ProjectReaderTests-1964668024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (063538db-2493-48db-a794-e352a0da212d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '081b3553-a1f5-4f4d-a554-9da4873a1615', 'volume_name': 'volume-081b3553-a1f5-4f4d-a554-9da4873a1615', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:40:26 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-78a8f961-19bd-413c-9e78-6d18c50db73c tempest-ProjectReaderTests-1964668024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11933f46-e12e-4a88-8d7d-2b4b3e17bf8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:40:26 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-78a8f961-19bd-413c-9e78-6d18c50db73c tempest-ProjectReaderTests-1964668024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (11933f46-e12e-4a88-8d7d-2b4b3e17bf8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:40:26 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-78a8f961-19bd-413c-9e78-6d18c50db73c tempest-ProjectReaderTests-1964668024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4068c88d-fa8e-4f66-aac3-e187135a69d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:40:26 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-78a8f961-19bd-413c-9e78-6d18c50db73c tempest-ProjectReaderTests-1964668024 None] Volume 081b3553-a1f5-4f4d-a554-9da4873a1615: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-081b3553-a1f5-4f4d-a554-9da4873a1615', 'volume_size': 1} Sep 15 16:40:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-78a8f961-19bd-413c-9e78-6d18c50db73c tempest-ProjectReaderTests-1964668024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:40:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-78a8f961-19bd-413c-9e78-6d18c50db73c tempest-ProjectReaderTests-1964668024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:40:26 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-78a8f961-19bd-413c-9e78-6d18c50db73c tempest-ProjectReaderTests-1964668024 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:40:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1582628835',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=081b3553-a1f5-4f4d-a554-9da4873a1615,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6de9a8446d25410e819cf25f0625d0b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:40:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:40:27Z,use_quota=True,user_id='52cdd2a10b274baf9b545e0df74ebcc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:40:26 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-78a8f961-19bd-413c-9e78-6d18c50db73c tempest-ProjectReaderTests-1964668024 None] Creating volume 081b3553-a1f5-4f4d-a554-9da4873a1615 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:40:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-78a8f961-19bd-413c-9e78-6d18c50db73c tempest-ProjectReaderTests-1964668024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:40:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-78a8f961-19bd-413c-9e78-6d18c50db73c tempest-ProjectReaderTests-1964668024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:40:26 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-78a8f961-19bd-413c-9e78-6d18c50db73c tempest-ProjectReaderTests-1964668024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:40:26 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-78a8f961-19bd-413c-9e78-6d18c50db73c tempest-ProjectReaderTests-1964668024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:40:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-78a8f961-19bd-413c-9e78-6d18c50db73c tempest-ProjectReaderTests-1964668024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:40:26 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-78a8f961-19bd-413c-9e78-6d18c50db73c tempest-ProjectReaderTests-1964668024 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:40:26 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-78a8f961-19bd-413c-9e78-6d18c50db73c tempest-ProjectReaderTests-1964668024 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:40:26 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-78a8f961-19bd-413c-9e78-6d18c50db73c tempest-ProjectReaderTests-1964668024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-081b3553-a1f5-4f4d-a554-9da4873a1615 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:26 devstack sudo[107418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-081b3553-a1f5-4f4d-a554-9da4873a1615 1073741824 Sep 15 16:40:26 devstack sudo[107418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:27 devstack sudo[107418]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-78a8f961-19bd-413c-9e78-6d18c50db73c tempest-ProjectReaderTests-1964668024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-081b3553-a1f5-4f4d-a554-9da4873a1615 1073741824" returned: 0 in 0.485s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-78a8f961-19bd-413c-9e78-6d18c50db73c tempest-ProjectReaderTests-1964668024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-081b3553-a1f5-4f4d-a554-9da4873a1615 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:27 devstack sudo[107425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-081b3553-a1f5-4f4d-a554-9da4873a1615 Sep 15 16:40:27 devstack sudo[107425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:27 devstack sudo[107425]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-78a8f961-19bd-413c-9e78-6d18c50db73c tempest-ProjectReaderTests-1964668024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-081b3553-a1f5-4f4d-a554-9da4873a1615" returned: 0 in 0.322s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:27 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-78a8f961-19bd-413c-9e78-6d18c50db73c tempest-ProjectReaderTests-1964668024 None] <== create_volume: return (858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:40:27 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-78a8f961-19bd-413c-9e78-6d18c50db73c tempest-ProjectReaderTests-1964668024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.863s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:40:27 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-78a8f961-19bd-413c-9e78-6d18c50db73c tempest-ProjectReaderTests-1964668024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4068c88d-fa8e-4f66-aac3-e187135a69d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-081b3553-a1f5-4f4d-a554-9da4873a1615', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:40:27 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-78a8f961-19bd-413c-9e78-6d18c50db73c tempest-ProjectReaderTests-1964668024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ea6f2d8-1ac8-4426-bdb6-0ee2e39b52be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:40:27 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-78a8f961-19bd-413c-9e78-6d18c50db73c tempest-ProjectReaderTests-1964668024 None] Volume volume-081b3553-a1f5-4f4d-a554-9da4873a1615 (081b3553-a1f5-4f4d-a554-9da4873a1615): created successfully Sep 15 16:40:27 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-78a8f961-19bd-413c-9e78-6d18c50db73c tempest-ProjectReaderTests-1964668024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ea6f2d8-1ac8-4426-bdb6-0ee2e39b52be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:40:27 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-78a8f961-19bd-413c-9e78-6d18c50db73c tempest-ProjectReaderTests-1964668024 None] Flow 'volume_create_manager' (77b32645-f002-44a1-9e18-26db532a3c83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:40:27 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-78a8f961-19bd-413c-9e78-6d18c50db73c tempest-ProjectReaderTests-1964668024 None] Created volume successfully. Sep 15 16:40:28 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-7784712b-efcb-47de-87c4-2bb0e92716bc tempest-ProjectMemberTests-1855156353 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:40:28 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7784712b-efcb-47de-87c4-2bb0e92716bc tempest-ProjectMemberTests-1855156353 None] Flow 'volume_create_manager' (3117e15f-f920-491e-a779-4a0a405ec051) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:40:28 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7784712b-efcb-47de-87c4-2bb0e92716bc tempest-ProjectMemberTests-1855156353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4ca8ced-ccb6-433b-a53b-b75ad3e63fc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:40:28 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7784712b-efcb-47de-87c4-2bb0e92716bc tempest-ProjectMemberTests-1855156353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4ca8ced-ccb6-433b-a53b-b75ad3e63fc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:40:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1972594491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bd51148-5156-4276-bc1d-b33d10ef13a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a303ec1076004f4db43523c2f7b6a446',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:40:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:40:28Z,use_quota=True,user_id='d9953555b80c481b9eaabbc7d416d0b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:40:28 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7784712b-efcb-47de-87c4-2bb0e92716bc tempest-ProjectMemberTests-1855156353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (115cd290-a71a-41f1-9827-096ed39f80ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:40:28 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7784712b-efcb-47de-87c4-2bb0e92716bc tempest-ProjectMemberTests-1855156353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (115cd290-a71a-41f1-9827-096ed39f80ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:40:28 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7784712b-efcb-47de-87c4-2bb0e92716bc tempest-ProjectMemberTests-1855156353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (187b5380-e06f-4636-9d2e-4277676da90e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:40:28 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7784712b-efcb-47de-87c4-2bb0e92716bc tempest-ProjectMemberTests-1855156353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (187b5380-e06f-4636-9d2e-4277676da90e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6bd51148-5156-4276-bc1d-b33d10ef13a7', 'volume_name': 'volume-6bd51148-5156-4276-bc1d-b33d10ef13a7', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:40:28 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7784712b-efcb-47de-87c4-2bb0e92716bc tempest-ProjectMemberTests-1855156353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8388170-d299-40f3-b432-3315c08362db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:40:28 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7784712b-efcb-47de-87c4-2bb0e92716bc tempest-ProjectMemberTests-1855156353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8388170-d299-40f3-b432-3315c08362db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:40:28 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7784712b-efcb-47de-87c4-2bb0e92716bc tempest-ProjectMemberTests-1855156353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4bb316e-193d-41c1-af64-3bd657c2692b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:40:28 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-7784712b-efcb-47de-87c4-2bb0e92716bc tempest-ProjectMemberTests-1855156353 None] Volume 6bd51148-5156-4276-bc1d-b33d10ef13a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6bd51148-5156-4276-bc1d-b33d10ef13a7', 'volume_size': 1} Sep 15 16:40:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-7784712b-efcb-47de-87c4-2bb0e92716bc tempest-ProjectMemberTests-1855156353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:40:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-7784712b-efcb-47de-87c4-2bb0e92716bc tempest-ProjectMemberTests-1855156353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:40:28 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-7784712b-efcb-47de-87c4-2bb0e92716bc tempest-ProjectMemberTests-1855156353 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:40:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1972594491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bd51148-5156-4276-bc1d-b33d10ef13a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a303ec1076004f4db43523c2f7b6a446',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:40:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:40:28Z,use_quota=True,user_id='d9953555b80c481b9eaabbc7d416d0b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:40:28 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-7784712b-efcb-47de-87c4-2bb0e92716bc tempest-ProjectMemberTests-1855156353 None] Creating volume 6bd51148-5156-4276-bc1d-b33d10ef13a7 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:40:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-7784712b-efcb-47de-87c4-2bb0e92716bc tempest-ProjectMemberTests-1855156353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:40:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-7784712b-efcb-47de-87c4-2bb0e92716bc tempest-ProjectMemberTests-1855156353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:40:28 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-7784712b-efcb-47de-87c4-2bb0e92716bc tempest-ProjectMemberTests-1855156353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:40:28 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-7784712b-efcb-47de-87c4-2bb0e92716bc tempest-ProjectMemberTests-1855156353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:40:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-7784712b-efcb-47de-87c4-2bb0e92716bc tempest-ProjectMemberTests-1855156353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:40:28 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-7784712b-efcb-47de-87c4-2bb0e92716bc tempest-ProjectMemberTests-1855156353 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:40:28 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-7784712b-efcb-47de-87c4-2bb0e92716bc tempest-ProjectMemberTests-1855156353 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:40:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7784712b-efcb-47de-87c4-2bb0e92716bc tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6bd51148-5156-4276-bc1d-b33d10ef13a7 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:28 devstack sudo[107428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6bd51148-5156-4276-bc1d-b33d10ef13a7 1073741824 Sep 15 16:40:28 devstack sudo[107428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:28 devstack sudo[107428]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7784712b-efcb-47de-87c4-2bb0e92716bc tempest-ProjectMemberTests-1855156353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6bd51148-5156-4276-bc1d-b33d10ef13a7 1073741824" returned: 0 in 0.561s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:28 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7784712b-efcb-47de-87c4-2bb0e92716bc tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6bd51148-5156-4276-bc1d-b33d10ef13a7 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:28 devstack sudo[107435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6bd51148-5156-4276-bc1d-b33d10ef13a7 Sep 15 16:40:28 devstack sudo[107435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:29 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-74cdab2b-6f01-40ba-9ef0-d253f6565144 tempest-ProjectReaderTests-1964668024 None] Acquiring lock "cinder-081b3553-a1f5-4f4d-a554-9da4873a1615-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:40:29 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-74cdab2b-6f01-40ba-9ef0-d253f6565144 tempest-ProjectReaderTests-1964668024 None] Lock "cinder-081b3553-a1f5-4f4d-a554-9da4873a1615-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:40:29 devstack sudo[107435]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:29 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-74cdab2b-6f01-40ba-9ef0-d253f6565144 tempest-ProjectReaderTests-1964668024 None] Acquiring lock "cinder-quobyte-081b3553-a1f5-4f4d-a554-9da4873a1615" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:40:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7784712b-efcb-47de-87c4-2bb0e92716bc tempest-ProjectMemberTests-1855156353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6bd51148-5156-4276-bc1d-b33d10ef13a7" returned: 0 in 0.399s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:29 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-7784712b-efcb-47de-87c4-2bb0e92716bc tempest-ProjectMemberTests-1855156353 None] <== create_volume: return (1015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:40:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-7784712b-efcb-47de-87c4-2bb0e92716bc tempest-ProjectMemberTests-1855156353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.018s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:40:29 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7784712b-efcb-47de-87c4-2bb0e92716bc tempest-ProjectMemberTests-1855156353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4bb316e-193d-41c1-af64-3bd657c2692b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6bd51148-5156-4276-bc1d-b33d10ef13a7', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:40:29 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7784712b-efcb-47de-87c4-2bb0e92716bc tempest-ProjectMemberTests-1855156353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af706314-69c0-420f-af1d-fa990333a3b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:40:29 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-74cdab2b-6f01-40ba-9ef0-d253f6565144 tempest-ProjectReaderTests-1964668024 None] Lock "cinder-quobyte-081b3553-a1f5-4f4d-a554-9da4873a1615" acquired by "delete_volume" :: waited 0.036s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:40:29 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-7784712b-efcb-47de-87c4-2bb0e92716bc tempest-ProjectMemberTests-1855156353 None] Volume volume-6bd51148-5156-4276-bc1d-b33d10ef13a7 (6bd51148-5156-4276-bc1d-b33d10ef13a7): created successfully Sep 15 16:40:29 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7784712b-efcb-47de-87c4-2bb0e92716bc tempest-ProjectMemberTests-1855156353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af706314-69c0-420f-af1d-fa990333a3b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:40:29 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7784712b-efcb-47de-87c4-2bb0e92716bc tempest-ProjectMemberTests-1855156353 None] Flow 'volume_create_manager' (3117e15f-f920-491e-a779-4a0a405ec051) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:40:29 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[681b213a-93c6-4c18-a104-79308cb8338a]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:40:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-74cdab2b-6f01-40ba-9ef0-d253f6565144 tempest-ProjectReaderTests-1964668024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-081b3553-a1f5-4f4d-a554-9da4873a1615 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:29 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-7784712b-efcb-47de-87c4-2bb0e92716bc tempest-ProjectMemberTests-1855156353 None] Created volume successfully. Sep 15 16:40:29 devstack sudo[107438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-081b3553-a1f5-4f4d-a554-9da4873a1615 Sep 15 16:40:29 devstack sudo[107438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:29 devstack sudo[107438]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-74cdab2b-6f01-40ba-9ef0-d253f6565144 tempest-ProjectReaderTests-1964668024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-081b3553-a1f5-4f4d-a554-9da4873a1615" returned: 0 in 0.423s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-74cdab2b-6f01-40ba-9ef0-d253f6565144 tempest-ProjectReaderTests-1964668024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-081b3553-a1f5-4f4d-a554-9da4873a1615 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:29 devstack sudo[107443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-081b3553-a1f5-4f4d-a554-9da4873a1615 Sep 15 16:40:29 devstack sudo[107443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:29 devstack sudo[107443]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:29 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-74cdab2b-6f01-40ba-9ef0-d253f6565144 tempest-ProjectReaderTests-1964668024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-081b3553-a1f5-4f4d-a554-9da4873a1615" returned: 0 in 0.270s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:29 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-74cdab2b-6f01-40ba-9ef0-d253f6565144 tempest-ProjectReaderTests-1964668024 None] Lock "cinder-quobyte-081b3553-a1f5-4f4d-a554-9da4873a1615" released by "delete_volume" :: held 0.767s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:40:30 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-74cdab2b-6f01-40ba-9ef0-d253f6565144 tempest-ProjectReaderTests-1964668024 None] Created reservations ['a0a5441e-f2a3-4e05-a34e-92ce1057075b', '075bf869-e090-4638-8a3d-679ca6b5768e', 'e3881fe1-fa00-4949-84cc-8cb366fe83af', '43b49568-3726-44d4-9da4-bde13c115a63'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:40:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-74cdab2b-6f01-40ba-9ef0-d253f6565144 tempest-ProjectReaderTests-1964668024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:40:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-74cdab2b-6f01-40ba-9ef0-d253f6565144 tempest-ProjectReaderTests-1964668024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:40:30 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-74cdab2b-6f01-40ba-9ef0-d253f6565144 tempest-ProjectReaderTests-1964668024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:40:30 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-74cdab2b-6f01-40ba-9ef0-d253f6565144 tempest-ProjectReaderTests-1964668024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:40:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-74cdab2b-6f01-40ba-9ef0-d253f6565144 tempest-ProjectReaderTests-1964668024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:40:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-74cdab2b-6f01-40ba-9ef0-d253f6565144 tempest-ProjectReaderTests-1964668024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:30 devstack sudo[107446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:40:30 devstack sudo[107446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-5c62915c-085d-4585-9345-d612d80b8157 tempest-ProjectMemberTests-1855156353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:40:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-5c62915c-085d-4585-9345-d612d80b8157 tempest-ProjectMemberTests-1855156353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:40:30 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-5c62915c-085d-4585-9345-d612d80b8157 tempest-ProjectMemberTests-1855156353 None] Creating offline snapshot b076f0a7-3077-414f-b290-9821b01cd7b0 of volume 6bd51148-5156-4276-bc1d-b33d10ef13a7 {{(pid=86082) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 15 16:40:30 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[40dca11b-8a1a-415c-8c9f-8ff9dacc6503]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:40:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5c62915c-085d-4585-9345-d612d80b8157 tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6bd51148-5156-4276-bc1d-b33d10ef13a7 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:30 devstack sudo[107446]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-74cdab2b-6f01-40ba-9ef0-d253f6565144 tempest-ProjectReaderTests-1964668024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.366s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:30 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-74cdab2b-6f01-40ba-9ef0-d253f6565144 tempest-ProjectReaderTests-1964668024 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:40:30 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-74cdab2b-6f01-40ba-9ef0-d253f6565144 tempest-ProjectReaderTests-1964668024 None] Deleted volume successfully. Sep 15 16:40:30 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-74cdab2b-6f01-40ba-9ef0-d253f6565144 tempest-ProjectReaderTests-1964668024 None] Lock "cinder-081b3553-a1f5-4f4d-a554-9da4873a1615-delete_volume" released by "delete_volume" :: held 1.417s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:40:30 devstack sudo[107449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6bd51148-5156-4276-bc1d-b33d10ef13a7 Sep 15 16:40:30 devstack sudo[107449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:30 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-4af47d4a-9912-42d1-98a5-7dd22a94d993 tempest-ProjectReaderTests-1964668024 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:40:30 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4af47d4a-9912-42d1-98a5-7dd22a94d993 tempest-ProjectReaderTests-1964668024 None] Flow 'volume_create_manager' (f677af02-a1bb-4162-8e8e-52f2b071e32b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:40:30 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4af47d4a-9912-42d1-98a5-7dd22a94d993 tempest-ProjectReaderTests-1964668024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5278ae1-7ab0-4ba4-8e05-ce22788ab3aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:40:30 devstack sudo[107449]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:30 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4af47d4a-9912-42d1-98a5-7dd22a94d993 tempest-ProjectReaderTests-1964668024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f5278ae1-7ab0-4ba4-8e05-ce22788ab3aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:40:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-964856594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=211df0e6-f8de-4d59-a5a7-8f22c1d8b36f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6de9a8446d25410e819cf25f0625d0b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:40:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:40:31Z,use_quota=True,user_id='52cdd2a10b274baf9b545e0df74ebcc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:40:30 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4af47d4a-9912-42d1-98a5-7dd22a94d993 tempest-ProjectReaderTests-1964668024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52335854-010b-4eaa-a778-e3dcb6481597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:40:30 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4af47d4a-9912-42d1-98a5-7dd22a94d993 tempest-ProjectReaderTests-1964668024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52335854-010b-4eaa-a778-e3dcb6481597) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:40:30 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4af47d4a-9912-42d1-98a5-7dd22a94d993 tempest-ProjectReaderTests-1964668024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcfcce91-e1b4-4cac-b0d1-25d440bd53f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:40:30 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4af47d4a-9912-42d1-98a5-7dd22a94d993 tempest-ProjectReaderTests-1964668024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fcfcce91-e1b4-4cac-b0d1-25d440bd53f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '211df0e6-f8de-4d59-a5a7-8f22c1d8b36f', 'volume_name': 'volume-211df0e6-f8de-4d59-a5a7-8f22c1d8b36f', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:40:30 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4af47d4a-9912-42d1-98a5-7dd22a94d993 tempest-ProjectReaderTests-1964668024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5a07ad4-fbc6-4c61-883a-48bc92d3ce53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:40:30 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4af47d4a-9912-42d1-98a5-7dd22a94d993 tempest-ProjectReaderTests-1964668024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5a07ad4-fbc6-4c61-883a-48bc92d3ce53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:40:30 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4af47d4a-9912-42d1-98a5-7dd22a94d993 tempest-ProjectReaderTests-1964668024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3752ec57-3621-40e0-a831-4c23e92ea804) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:40:30 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-4af47d4a-9912-42d1-98a5-7dd22a94d993 tempest-ProjectReaderTests-1964668024 None] Volume 211df0e6-f8de-4d59-a5a7-8f22c1d8b36f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-211df0e6-f8de-4d59-a5a7-8f22c1d8b36f', 'volume_size': 1} Sep 15 16:40:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-4af47d4a-9912-42d1-98a5-7dd22a94d993 tempest-ProjectReaderTests-1964668024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:40:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5c62915c-085d-4585-9345-d612d80b8157 tempest-ProjectMemberTests-1855156353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6bd51148-5156-4276-bc1d-b33d10ef13a7" returned: 0 in 0.467s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:30 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5c62915c-085d-4585-9345-d612d80b8157 tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6bd51148-5156-4276-bc1d-b33d10ef13a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6bd51148-5156-4276-bc1d-b33d10ef13a7.b076f0a7-3077-414f-b290-9821b01cd7b0 1G {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:30 devstack sudo[107454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6bd51148-5156-4276-bc1d-b33d10ef13a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6bd51148-5156-4276-bc1d-b33d10ef13a7.b076f0a7-3077-414f-b290-9821b01cd7b0 1G Sep 15 16:40:30 devstack sudo[107454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:31 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-2ec9c870-ba17-483f-bf3f-8b342be9c7f7 tempest-ProjectAdminTests-501054145 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.9663772583008, 'free_capacity_gb': 1775.9663772583008, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86082) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 15 16:40:31 devstack sudo[107454]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5c62915c-085d-4585-9345-d612d80b8157 tempest-ProjectMemberTests-1855156353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6bd51148-5156-4276-bc1d-b33d10ef13a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6bd51148-5156-4276-bc1d-b33d10ef13a7.b076f0a7-3077-414f-b290-9821b01cd7b0 1G" returned: 0 in 0.449s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5c62915c-085d-4585-9345-d612d80b8157 tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6bd51148-5156-4276-bc1d-b33d10ef13a7 -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6bd51148-5156-4276-bc1d-b33d10ef13a7.b076f0a7-3077-414f-b290-9821b01cd7b0 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:31 devstack sudo[107460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6bd51148-5156-4276-bc1d-b33d10ef13a7 -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6bd51148-5156-4276-bc1d-b33d10ef13a7.b076f0a7-3077-414f-b290-9821b01cd7b0 Sep 15 16:40:31 devstack sudo[107460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:31 devstack sudo[107460]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5c62915c-085d-4585-9345-d612d80b8157 tempest-ProjectMemberTests-1855156353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6bd51148-5156-4276-bc1d-b33d10ef13a7 -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6bd51148-5156-4276-bc1d-b33d10ef13a7.b076f0a7-3077-414f-b290-9821b01cd7b0" returned: 0 in 0.299s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:31 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-5c62915c-085d-4585-9345-d612d80b8157 tempest-ProjectMemberTests-1855156353 None] /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6bd51148-5156-4276-bc1d-b33d10ef13a7.b076f0a7-3077-414f-b290-9821b01cd7b0 is being set with open permissions: ugo+rw Sep 15 16:40:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5c62915c-085d-4585-9345-d612d80b8157 tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6bd51148-5156-4276-bc1d-b33d10ef13a7.b076f0a7-3077-414f-b290-9821b01cd7b0 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:31 devstack sudo[107465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6bd51148-5156-4276-bc1d-b33d10ef13a7.b076f0a7-3077-414f-b290-9821b01cd7b0 Sep 15 16:40:31 devstack sudo[107465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:31 devstack sudo[107465]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5c62915c-085d-4585-9345-d612d80b8157 tempest-ProjectMemberTests-1855156353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6bd51148-5156-4276-bc1d-b33d10ef13a7.b076f0a7-3077-414f-b290-9821b01cd7b0" returned: 0 in 0.285s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:31 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5c62915c-085d-4585-9345-d612d80b8157 tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6bd51148-5156-4276-bc1d-b33d10ef13a7.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:32 devstack sudo[107474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6bd51148-5156-4276-bc1d-b33d10ef13a7.info Sep 15 16:40:32 devstack sudo[107474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:32 devstack sudo[107474]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5c62915c-085d-4585-9345-d612d80b8157 tempest-ProjectMemberTests-1855156353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6bd51148-5156-4276-bc1d-b33d10ef13a7.info" returned: 0 in 0.262s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:32 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-5c62915c-085d-4585-9345-d612d80b8157 tempest-ProjectMemberTests-1855156353 None] /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6bd51148-5156-4276-bc1d-b33d10ef13a7.info is being set with open permissions: ugo+rw Sep 15 16:40:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5c62915c-085d-4585-9345-d612d80b8157 tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6bd51148-5156-4276-bc1d-b33d10ef13a7.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:32 devstack sudo[107477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6bd51148-5156-4276-bc1d-b33d10ef13a7.info Sep 15 16:40:32 devstack sudo[107477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:32 devstack sudo[107477]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5c62915c-085d-4585-9345-d612d80b8157 tempest-ProjectMemberTests-1855156353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6bd51148-5156-4276-bc1d-b33d10ef13a7.info" returned: 0 in 0.279s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-5c62915c-085d-4585-9345-d612d80b8157 tempest-ProjectMemberTests-1855156353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.146s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:40:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-4af47d4a-9912-42d1-98a5-7dd22a94d993 tempest-ProjectReaderTests-1964668024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.630s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:40:32 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-4af47d4a-9912-42d1-98a5-7dd22a94d993 tempest-ProjectReaderTests-1964668024 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:40:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-964856594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=211df0e6-f8de-4d59-a5a7-8f22c1d8b36f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6de9a8446d25410e819cf25f0625d0b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:40:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:40:31Z,use_quota=True,user_id='52cdd2a10b274baf9b545e0df74ebcc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:40:32 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-4af47d4a-9912-42d1-98a5-7dd22a94d993 tempest-ProjectReaderTests-1964668024 None] Creating volume 211df0e6-f8de-4d59-a5a7-8f22c1d8b36f {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:40:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-4af47d4a-9912-42d1-98a5-7dd22a94d993 tempest-ProjectReaderTests-1964668024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:40:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-4af47d4a-9912-42d1-98a5-7dd22a94d993 tempest-ProjectReaderTests-1964668024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:40:32 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-4af47d4a-9912-42d1-98a5-7dd22a94d993 tempest-ProjectReaderTests-1964668024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:40:32 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-4af47d4a-9912-42d1-98a5-7dd22a94d993 tempest-ProjectReaderTests-1964668024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:40:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-4af47d4a-9912-42d1-98a5-7dd22a94d993 tempest-ProjectReaderTests-1964668024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:40:32 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-4af47d4a-9912-42d1-98a5-7dd22a94d993 tempest-ProjectReaderTests-1964668024 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:40:32 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-4af47d4a-9912-42d1-98a5-7dd22a94d993 tempest-ProjectReaderTests-1964668024 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:40:32 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4af47d4a-9912-42d1-98a5-7dd22a94d993 tempest-ProjectReaderTests-1964668024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-211df0e6-f8de-4d59-a5a7-8f22c1d8b36f 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:32 devstack sudo[107480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-211df0e6-f8de-4d59-a5a7-8f22c1d8b36f 1073741824 Sep 15 16:40:32 devstack sudo[107480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:32 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-5c62915c-085d-4585-9345-d612d80b8157 tempest-ProjectMemberTests-1855156353 None] Create snapshot completed successfully Sep 15 16:40:33 devstack sudo[107480]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4af47d4a-9912-42d1-98a5-7dd22a94d993 tempest-ProjectReaderTests-1964668024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-211df0e6-f8de-4d59-a5a7-8f22c1d8b36f 1073741824" returned: 0 in 0.480s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4af47d4a-9912-42d1-98a5-7dd22a94d993 tempest-ProjectReaderTests-1964668024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-211df0e6-f8de-4d59-a5a7-8f22c1d8b36f {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:33 devstack sudo[107486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-211df0e6-f8de-4d59-a5a7-8f22c1d8b36f Sep 15 16:40:33 devstack sudo[107486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:33 devstack sudo[107486]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4af47d4a-9912-42d1-98a5-7dd22a94d993 tempest-ProjectReaderTests-1964668024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-211df0e6-f8de-4d59-a5a7-8f22c1d8b36f" returned: 0 in 0.259s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:33 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-4af47d4a-9912-42d1-98a5-7dd22a94d993 tempest-ProjectReaderTests-1964668024 None] <== create_volume: return (782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:40:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-4af47d4a-9912-42d1-98a5-7dd22a94d993 tempest-ProjectReaderTests-1964668024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.786s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:40:33 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4af47d4a-9912-42d1-98a5-7dd22a94d993 tempest-ProjectReaderTests-1964668024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3752ec57-3621-40e0-a831-4c23e92ea804) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-211df0e6-f8de-4d59-a5a7-8f22c1d8b36f', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:40:33 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4af47d4a-9912-42d1-98a5-7dd22a94d993 tempest-ProjectReaderTests-1964668024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48fbccab-a043-4806-a82c-e8ca6b62ce2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:40:33 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-4af47d4a-9912-42d1-98a5-7dd22a94d993 tempest-ProjectReaderTests-1964668024 None] Volume volume-211df0e6-f8de-4d59-a5a7-8f22c1d8b36f (211df0e6-f8de-4d59-a5a7-8f22c1d8b36f): created successfully Sep 15 16:40:33 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4af47d4a-9912-42d1-98a5-7dd22a94d993 tempest-ProjectReaderTests-1964668024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48fbccab-a043-4806-a82c-e8ca6b62ce2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:40:33 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-4af47d4a-9912-42d1-98a5-7dd22a94d993 tempest-ProjectReaderTests-1964668024 None] Flow 'volume_create_manager' (f677af02-a1bb-4162-8e8e-52f2b071e32b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:40:33 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-4af47d4a-9912-42d1-98a5-7dd22a94d993 tempest-ProjectReaderTests-1964668024 None] Created volume successfully. Sep 15 16:40:33 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-af17e633-73de-4350-8552-0a4b35eb7f68 tempest-ProjectMemberTests-1855156353 None] Acquiring lock "cinder-b076f0a7-3077-414f-b290-9821b01cd7b0-delete_snapshot" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:40:33 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-af17e633-73de-4350-8552-0a4b35eb7f68 tempest-ProjectMemberTests-1855156353 None] Lock "cinder-b076f0a7-3077-414f-b290-9821b01cd7b0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:40:33 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-af17e633-73de-4350-8552-0a4b35eb7f68 tempest-ProjectMemberTests-1855156353 None] Acquiring lock "cinder-quobyte-6bd51148-5156-4276-bc1d-b33d10ef13a7" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:40:33 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-af17e633-73de-4350-8552-0a4b35eb7f68 tempest-ProjectMemberTests-1855156353 None] Lock "cinder-quobyte-6bd51148-5156-4276-bc1d-b33d10ef13a7" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:40:33 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-af17e633-73de-4350-8552-0a4b35eb7f68 tempest-ProjectMemberTests-1855156353 None] Acquiring lock "cinder-quobyte-b076f0a7-3077-414f-b290-9821b01cd7b0" by "_delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:40:33 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-af17e633-73de-4350-8552-0a4b35eb7f68 tempest-ProjectMemberTests-1855156353 None] Lock "cinder-quobyte-b076f0a7-3077-414f-b290-9821b01cd7b0" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:40:33 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-af17e633-73de-4350-8552-0a4b35eb7f68 tempest-ProjectMemberTests-1855156353 None] Deleting offline snapshot b076f0a7-3077-414f-b290-9821b01cd7b0 of volume 6bd51148-5156-4276-bc1d-b33d10ef13a7 {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 15 16:40:33 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-af17e633-73de-4350-8552-0a4b35eb7f68 tempest-ProjectMemberTests-1855156353 None] snapshot_file for this snap is: volume-6bd51148-5156-4276-bc1d-b33d10ef13a7.b076f0a7-3077-414f-b290-9821b01cd7b0 {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 15 16:40:33 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[abeee438-13a1-4f18-87d9-0bb6d456193a]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:40:33 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-af17e633-73de-4350-8552-0a4b35eb7f68 tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6bd51148-5156-4276-bc1d-b33d10ef13a7.b076f0a7-3077-414f-b290-9821b01cd7b0 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:33 devstack sudo[107490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6bd51148-5156-4276-bc1d-b33d10ef13a7.b076f0a7-3077-414f-b290-9821b01cd7b0 Sep 15 16:40:33 devstack sudo[107490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:34 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-10963708-65d4-41ef-aebb-091777dbf58d tempest-ProjectReaderTests-1964668024 None] Acquiring lock "cinder-211df0e6-f8de-4d59-a5a7-8f22c1d8b36f-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:40:34 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-10963708-65d4-41ef-aebb-091777dbf58d tempest-ProjectReaderTests-1964668024 None] Lock "cinder-211df0e6-f8de-4d59-a5a7-8f22c1d8b36f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:40:34 devstack sudo[107490]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-af17e633-73de-4350-8552-0a4b35eb7f68 tempest-ProjectMemberTests-1855156353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6bd51148-5156-4276-bc1d-b33d10ef13a7.b076f0a7-3077-414f-b290-9821b01cd7b0" returned: 0 in 0.443s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:34 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-af17e633-73de-4350-8552-0a4b35eb7f68 tempest-ProjectMemberTests-1855156353 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6bd51148-5156-4276-bc1d-b33d10ef13a7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 16:40:34 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-10963708-65d4-41ef-aebb-091777dbf58d tempest-ProjectReaderTests-1964668024 None] Acquiring lock "cinder-quobyte-211df0e6-f8de-4d59-a5a7-8f22c1d8b36f" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:40:34 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd7e8fb9-a837-49da-98d0-5ecc9200d65e]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:40:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-af17e633-73de-4350-8552-0a4b35eb7f68 tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6bd51148-5156-4276-bc1d-b33d10ef13a7 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:34 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-10963708-65d4-41ef-aebb-091777dbf58d tempest-ProjectReaderTests-1964668024 None] Lock "cinder-quobyte-211df0e6-f8de-4d59-a5a7-8f22c1d8b36f" acquired by "delete_volume" :: waited 0.034s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:40:34 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7fc4590-8e2f-4a3f-b5d6-58aab382711e]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:40:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-10963708-65d4-41ef-aebb-091777dbf58d tempest-ProjectReaderTests-1964668024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-211df0e6-f8de-4d59-a5a7-8f22c1d8b36f {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:34 devstack sudo[107495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6bd51148-5156-4276-bc1d-b33d10ef13a7 Sep 15 16:40:34 devstack sudo[107495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:34 devstack sudo[107496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-211df0e6-f8de-4d59-a5a7-8f22c1d8b36f Sep 15 16:40:34 devstack sudo[107496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:34 devstack sudo[107495]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-af17e633-73de-4350-8552-0a4b35eb7f68 tempest-ProjectMemberTests-1855156353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6bd51148-5156-4276-bc1d-b33d10ef13a7" returned: 0 in 0.431s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-af17e633-73de-4350-8552-0a4b35eb7f68 tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6bd51148-5156-4276-bc1d-b33d10ef13a7.b076f0a7-3077-414f-b290-9821b01cd7b0 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:34 devstack sudo[107505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6bd51148-5156-4276-bc1d-b33d10ef13a7.b076f0a7-3077-414f-b290-9821b01cd7b0 Sep 15 16:40:34 devstack sudo[107505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:34 devstack sudo[107496]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-10963708-65d4-41ef-aebb-091777dbf58d tempest-ProjectReaderTests-1964668024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-211df0e6-f8de-4d59-a5a7-8f22c1d8b36f" returned: 0 in 0.435s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-10963708-65d4-41ef-aebb-091777dbf58d tempest-ProjectReaderTests-1964668024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-211df0e6-f8de-4d59-a5a7-8f22c1d8b36f {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:34 devstack sudo[107507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-211df0e6-f8de-4d59-a5a7-8f22c1d8b36f Sep 15 16:40:34 devstack sudo[107507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:34 devstack sudo[107507]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-10963708-65d4-41ef-aebb-091777dbf58d tempest-ProjectReaderTests-1964668024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-211df0e6-f8de-4d59-a5a7-8f22c1d8b36f" returned: 0 in 0.283s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:34 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-10963708-65d4-41ef-aebb-091777dbf58d tempest-ProjectReaderTests-1964668024 None] Lock "cinder-quobyte-211df0e6-f8de-4d59-a5a7-8f22c1d8b36f" released by "delete_volume" :: held 0.783s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:40:34 devstack sudo[107505]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-af17e633-73de-4350-8552-0a4b35eb7f68 tempest-ProjectMemberTests-1855156353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6bd51148-5156-4276-bc1d-b33d10ef13a7.b076f0a7-3077-414f-b290-9821b01cd7b0" returned: 0 in 0.407s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:34 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-af17e633-73de-4350-8552-0a4b35eb7f68 tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6bd51148-5156-4276-bc1d-b33d10ef13a7.b076f0a7-3077-414f-b290-9821b01cd7b0 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:35 devstack sudo[107513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6bd51148-5156-4276-bc1d-b33d10ef13a7.b076f0a7-3077-414f-b290-9821b01cd7b0 Sep 15 16:40:35 devstack sudo[107513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:35 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-10963708-65d4-41ef-aebb-091777dbf58d tempest-ProjectReaderTests-1964668024 None] Created reservations ['6e29feef-dbe4-4ff0-b554-d596c65e091d', '18aed02f-8565-45a7-ade7-7a333955c7b0', 'f25fba0c-e24c-467c-93b9-58e32c1c72ea', '536977ce-c310-461e-9f9c-75b516f16f49'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:40:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-10963708-65d4-41ef-aebb-091777dbf58d tempest-ProjectReaderTests-1964668024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:40:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-10963708-65d4-41ef-aebb-091777dbf58d tempest-ProjectReaderTests-1964668024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:40:35 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-10963708-65d4-41ef-aebb-091777dbf58d tempest-ProjectReaderTests-1964668024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:40:35 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-10963708-65d4-41ef-aebb-091777dbf58d tempest-ProjectReaderTests-1964668024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:40:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-10963708-65d4-41ef-aebb-091777dbf58d tempest-ProjectReaderTests-1964668024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:40:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-10963708-65d4-41ef-aebb-091777dbf58d tempest-ProjectReaderTests-1964668024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:35 devstack sudo[107515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:40:35 devstack sudo[107515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:35 devstack sudo[107513]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-af17e633-73de-4350-8552-0a4b35eb7f68 tempest-ProjectMemberTests-1855156353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6bd51148-5156-4276-bc1d-b33d10ef13a7.b076f0a7-3077-414f-b290-9821b01cd7b0" returned: 0 in 0.328s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:35 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-af17e633-73de-4350-8552-0a4b35eb7f68 tempest-ProjectMemberTests-1855156353 None] Lock "cinder-quobyte-b076f0a7-3077-414f-b290-9821b01cd7b0" released by "_delete_snapshot" :: held 1.747s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:40:35 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-af17e633-73de-4350-8552-0a4b35eb7f68 tempest-ProjectMemberTests-1855156353 None] Lock "cinder-quobyte-6bd51148-5156-4276-bc1d-b33d10ef13a7" released by "delete_snapshot" :: held 1.773s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:40:35 devstack sudo[107515]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-10963708-65d4-41ef-aebb-091777dbf58d tempest-ProjectReaderTests-1964668024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.368s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:35 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-10963708-65d4-41ef-aebb-091777dbf58d tempest-ProjectReaderTests-1964668024 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:40:35 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-af17e633-73de-4350-8552-0a4b35eb7f68 tempest-ProjectMemberTests-1855156353 None] Created reservations ['bd002cdf-7be2-491c-8a15-37e82fd68d0e', 'ae52c49c-66b7-4105-808f-fc7103ba9f67', '7caccc89-c374-4763-b036-11deb55e407a', '70786a23-bf5f-424f-92b2-7f6eac37c66a'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:40:35 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-10963708-65d4-41ef-aebb-091777dbf58d tempest-ProjectReaderTests-1964668024 None] Deleted volume successfully. Sep 15 16:40:35 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e79f84f-016b-4019-8085-05901700eb77 tempest-ProjectReaderTests-714592672 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:40:35 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-3e79f84f-016b-4019-8085-05901700eb77 tempest-ProjectReaderTests-714592672 None] Flow 'volume_create_manager' (1dcd1c18-0ab2-4937-9911-8c4b53ff1c26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:40:35 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-3e79f84f-016b-4019-8085-05901700eb77 tempest-ProjectReaderTests-714592672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5466400c-a721-4153-b089-a128743b255b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:40:35 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-10963708-65d4-41ef-aebb-091777dbf58d tempest-ProjectReaderTests-1964668024 None] Lock "cinder-211df0e6-f8de-4d59-a5a7-8f22c1d8b36f-delete_volume" released by "delete_volume" :: held 1.503s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:40:35 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-3e79f84f-016b-4019-8085-05901700eb77 tempest-ProjectReaderTests-714592672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5466400c-a721-4153-b089-a128743b255b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:40:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1999326342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dae54c8e-0af0-4889-b28a-acb9a0a51ade,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68cde7c8450e4480a0855eacf56861b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:40:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:40:35Z,use_quota=True,user_id='8d100ae259564a538c7bf3f0e0d830cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:40:35 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-3e79f84f-016b-4019-8085-05901700eb77 tempest-ProjectReaderTests-714592672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a610119-6857-434a-8f0a-4cd23f9c639c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:40:35 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-3e79f84f-016b-4019-8085-05901700eb77 tempest-ProjectReaderTests-714592672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a610119-6857-434a-8f0a-4cd23f9c639c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:40:35 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-3e79f84f-016b-4019-8085-05901700eb77 tempest-ProjectReaderTests-714592672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (294dc0e1-74ad-4306-ad1c-4c8b5aecfe9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:40:35 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-3e79f84f-016b-4019-8085-05901700eb77 tempest-ProjectReaderTests-714592672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (294dc0e1-74ad-4306-ad1c-4c8b5aecfe9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dae54c8e-0af0-4889-b28a-acb9a0a51ade', 'volume_name': 'volume-dae54c8e-0af0-4889-b28a-acb9a0a51ade', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:40:35 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-3e79f84f-016b-4019-8085-05901700eb77 tempest-ProjectReaderTests-714592672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32093f38-4bed-4589-b940-c5424b0b8abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:40:35 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-3e79f84f-016b-4019-8085-05901700eb77 tempest-ProjectReaderTests-714592672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32093f38-4bed-4589-b940-c5424b0b8abf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:40:35 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-3e79f84f-016b-4019-8085-05901700eb77 tempest-ProjectReaderTests-714592672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c50de93d-1b82-42c1-a636-573b6fd4c9da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:40:35 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-3e79f84f-016b-4019-8085-05901700eb77 tempest-ProjectReaderTests-714592672 None] Volume dae54c8e-0af0-4889-b28a-acb9a0a51ade: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dae54c8e-0af0-4889-b28a-acb9a0a51ade', 'volume_size': 1} Sep 15 16:40:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-3e79f84f-016b-4019-8085-05901700eb77 tempest-ProjectReaderTests-714592672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:40:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-3e79f84f-016b-4019-8085-05901700eb77 tempest-ProjectReaderTests-714592672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:40:35 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-3e79f84f-016b-4019-8085-05901700eb77 tempest-ProjectReaderTests-714592672 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:40:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1999326342',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dae54c8e-0af0-4889-b28a-acb9a0a51ade,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68cde7c8450e4480a0855eacf56861b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:40:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:40:35Z,use_quota=True,user_id='8d100ae259564a538c7bf3f0e0d830cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:40:35 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-3e79f84f-016b-4019-8085-05901700eb77 tempest-ProjectReaderTests-714592672 None] Creating volume dae54c8e-0af0-4889-b28a-acb9a0a51ade {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:40:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-3e79f84f-016b-4019-8085-05901700eb77 tempest-ProjectReaderTests-714592672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:40:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-3e79f84f-016b-4019-8085-05901700eb77 tempest-ProjectReaderTests-714592672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:40:35 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-3e79f84f-016b-4019-8085-05901700eb77 tempest-ProjectReaderTests-714592672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:40:35 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-3e79f84f-016b-4019-8085-05901700eb77 tempest-ProjectReaderTests-714592672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:40:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-3e79f84f-016b-4019-8085-05901700eb77 tempest-ProjectReaderTests-714592672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:40:35 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-3e79f84f-016b-4019-8085-05901700eb77 tempest-ProjectReaderTests-714592672 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:40:35 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-3e79f84f-016b-4019-8085-05901700eb77 tempest-ProjectReaderTests-714592672 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:40:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3e79f84f-016b-4019-8085-05901700eb77 tempest-ProjectReaderTests-714592672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-dae54c8e-0af0-4889-b28a-acb9a0a51ade 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:35 devstack sudo[107519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-dae54c8e-0af0-4889-b28a-acb9a0a51ade 1073741824 Sep 15 16:40:35 devstack sudo[107519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:35 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-af17e633-73de-4350-8552-0a4b35eb7f68 tempest-ProjectMemberTests-1855156353 None] Delete snapshot completed successfully. Sep 15 16:40:35 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-af17e633-73de-4350-8552-0a4b35eb7f68 tempest-ProjectMemberTests-1855156353 None] Lock "cinder-b076f0a7-3077-414f-b290-9821b01cd7b0-delete_snapshot" released by "delete_snapshot" :: held 2.105s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:40:35 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-973ed483-b279-44d2-a2fb-fd2b858e1986 tempest-ProjectMemberTests-1855156353 None] Acquiring lock "cinder-6bd51148-5156-4276-bc1d-b33d10ef13a7-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:40:35 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-973ed483-b279-44d2-a2fb-fd2b858e1986 tempest-ProjectMemberTests-1855156353 None] Lock "cinder-6bd51148-5156-4276-bc1d-b33d10ef13a7-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:40:35 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-43b107ef-26ed-4673-9b54-b45c6721305d tempest-ProjectReaderTests-1964668024 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:40:35 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-43b107ef-26ed-4673-9b54-b45c6721305d tempest-ProjectReaderTests-1964668024 None] Flow 'volume_create_manager' (270070c8-e32f-4d07-baf9-24c2f1829e99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:40:35 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-43b107ef-26ed-4673-9b54-b45c6721305d tempest-ProjectReaderTests-1964668024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8b530b8-9a97-421d-8328-b2e00ac0f23d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:40:35 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-43b107ef-26ed-4673-9b54-b45c6721305d tempest-ProjectReaderTests-1964668024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8b530b8-9a97-421d-8328-b2e00ac0f23d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:40:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-498575512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71c9afe6-6f9b-4b59-8315-ddd6308631ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6de9a8446d25410e819cf25f0625d0b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:40:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:40:36Z,use_quota=True,user_id='52cdd2a10b274baf9b545e0df74ebcc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:40:35 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-43b107ef-26ed-4673-9b54-b45c6721305d tempest-ProjectReaderTests-1964668024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00935a25-02a1-420d-86fc-604d86eb27fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:40:35 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-43b107ef-26ed-4673-9b54-b45c6721305d tempest-ProjectReaderTests-1964668024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00935a25-02a1-420d-86fc-604d86eb27fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:40:35 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-43b107ef-26ed-4673-9b54-b45c6721305d tempest-ProjectReaderTests-1964668024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bfc20fb-f7d7-433d-9b31-f328395ddf8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:40:35 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-43b107ef-26ed-4673-9b54-b45c6721305d tempest-ProjectReaderTests-1964668024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bfc20fb-f7d7-433d-9b31-f328395ddf8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71c9afe6-6f9b-4b59-8315-ddd6308631ba', 'volume_name': 'volume-71c9afe6-6f9b-4b59-8315-ddd6308631ba', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:40:35 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-43b107ef-26ed-4673-9b54-b45c6721305d tempest-ProjectReaderTests-1964668024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a6e1ff1-ca2b-4965-b977-c32c9d5aa018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:40:35 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-43b107ef-26ed-4673-9b54-b45c6721305d tempest-ProjectReaderTests-1964668024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a6e1ff1-ca2b-4965-b977-c32c9d5aa018) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:40:35 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-43b107ef-26ed-4673-9b54-b45c6721305d tempest-ProjectReaderTests-1964668024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56200226-9cff-40e8-b7c4-22d2722e5ac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:40:35 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-43b107ef-26ed-4673-9b54-b45c6721305d tempest-ProjectReaderTests-1964668024 None] Volume 71c9afe6-6f9b-4b59-8315-ddd6308631ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71c9afe6-6f9b-4b59-8315-ddd6308631ba', 'volume_size': 1} Sep 15 16:40:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-43b107ef-26ed-4673-9b54-b45c6721305d tempest-ProjectReaderTests-1964668024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:40:35 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-973ed483-b279-44d2-a2fb-fd2b858e1986 tempest-ProjectMemberTests-1855156353 None] Acquiring lock "cinder-quobyte-6bd51148-5156-4276-bc1d-b33d10ef13a7" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:40:35 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-973ed483-b279-44d2-a2fb-fd2b858e1986 tempest-ProjectMemberTests-1855156353 None] Lock "cinder-quobyte-6bd51148-5156-4276-bc1d-b33d10ef13a7" acquired by "delete_volume" :: waited 0.019s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:40:35 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a7c099d-c683-4838-9d8d-a5a2418bf5c0]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:40:35 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-973ed483-b279-44d2-a2fb-fd2b858e1986 tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6bd51148-5156-4276-bc1d-b33d10ef13a7 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:36 devstack sudo[107519]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3e79f84f-016b-4019-8085-05901700eb77 tempest-ProjectReaderTests-714592672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-dae54c8e-0af0-4889-b28a-acb9a0a51ade 1073741824" returned: 0 in 0.488s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:36 devstack sudo[107525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6bd51148-5156-4276-bc1d-b33d10ef13a7 Sep 15 16:40:36 devstack sudo[107525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3e79f84f-016b-4019-8085-05901700eb77 tempest-ProjectReaderTests-714592672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-dae54c8e-0af0-4889-b28a-acb9a0a51ade {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:36 devstack sudo[107527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-dae54c8e-0af0-4889-b28a-acb9a0a51ade Sep 15 16:40:36 devstack sudo[107527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:36 devstack sudo[107525]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-973ed483-b279-44d2-a2fb-fd2b858e1986 tempest-ProjectMemberTests-1855156353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6bd51148-5156-4276-bc1d-b33d10ef13a7" returned: 0 in 0.367s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-973ed483-b279-44d2-a2fb-fd2b858e1986 tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6bd51148-5156-4276-bc1d-b33d10ef13a7 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:36 devstack sudo[107533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6bd51148-5156-4276-bc1d-b33d10ef13a7 Sep 15 16:40:36 devstack sudo[107533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:36 devstack sudo[107527]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3e79f84f-016b-4019-8085-05901700eb77 tempest-ProjectReaderTests-714592672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-dae54c8e-0af0-4889-b28a-acb9a0a51ade" returned: 0 in 0.271s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:36 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-3e79f84f-016b-4019-8085-05901700eb77 tempest-ProjectReaderTests-714592672 None] <== create_volume: return (799ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:40:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-3e79f84f-016b-4019-8085-05901700eb77 tempest-ProjectReaderTests-714592672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.801s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:40:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-43b107ef-26ed-4673-9b54-b45c6721305d tempest-ProjectReaderTests-1964668024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.510s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:40:36 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-43b107ef-26ed-4673-9b54-b45c6721305d tempest-ProjectReaderTests-1964668024 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:40:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-498575512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71c9afe6-6f9b-4b59-8315-ddd6308631ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6de9a8446d25410e819cf25f0625d0b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:40:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:40:36Z,use_quota=True,user_id='52cdd2a10b274baf9b545e0df74ebcc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:40:36 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-43b107ef-26ed-4673-9b54-b45c6721305d tempest-ProjectReaderTests-1964668024 None] Creating volume 71c9afe6-6f9b-4b59-8315-ddd6308631ba {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:40:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-43b107ef-26ed-4673-9b54-b45c6721305d tempest-ProjectReaderTests-1964668024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:40:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-43b107ef-26ed-4673-9b54-b45c6721305d tempest-ProjectReaderTests-1964668024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:40:36 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-43b107ef-26ed-4673-9b54-b45c6721305d tempest-ProjectReaderTests-1964668024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:40:36 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-43b107ef-26ed-4673-9b54-b45c6721305d tempest-ProjectReaderTests-1964668024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:40:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-43b107ef-26ed-4673-9b54-b45c6721305d tempest-ProjectReaderTests-1964668024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:40:36 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-43b107ef-26ed-4673-9b54-b45c6721305d tempest-ProjectReaderTests-1964668024 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:40:36 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-43b107ef-26ed-4673-9b54-b45c6721305d tempest-ProjectReaderTests-1964668024 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:40:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-43b107ef-26ed-4673-9b54-b45c6721305d tempest-ProjectReaderTests-1964668024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-71c9afe6-6f9b-4b59-8315-ddd6308631ba 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:36 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-3e79f84f-016b-4019-8085-05901700eb77 tempest-ProjectReaderTests-714592672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c50de93d-1b82-42c1-a636-573b6fd4c9da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dae54c8e-0af0-4889-b28a-acb9a0a51ade', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:40:36 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-3e79f84f-016b-4019-8085-05901700eb77 tempest-ProjectReaderTests-714592672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77adff6b-2a89-49b0-940d-d0354e314e2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:40:36 devstack sudo[107535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-71c9afe6-6f9b-4b59-8315-ddd6308631ba 1073741824 Sep 15 16:40:36 devstack sudo[107535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:36 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-3e79f84f-016b-4019-8085-05901700eb77 tempest-ProjectReaderTests-714592672 None] Volume volume-dae54c8e-0af0-4889-b28a-acb9a0a51ade (dae54c8e-0af0-4889-b28a-acb9a0a51ade): created successfully Sep 15 16:40:36 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-3e79f84f-016b-4019-8085-05901700eb77 tempest-ProjectReaderTests-714592672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77adff6b-2a89-49b0-940d-d0354e314e2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:40:36 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-3e79f84f-016b-4019-8085-05901700eb77 tempest-ProjectReaderTests-714592672 None] Flow 'volume_create_manager' (1dcd1c18-0ab2-4937-9911-8c4b53ff1c26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:40:36 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-3e79f84f-016b-4019-8085-05901700eb77 tempest-ProjectReaderTests-714592672 None] Created volume successfully. Sep 15 16:40:36 devstack sudo[107533]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-973ed483-b279-44d2-a2fb-fd2b858e1986 tempest-ProjectMemberTests-1855156353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-6bd51148-5156-4276-bc1d-b33d10ef13a7" returned: 0 in 0.255s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:36 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-973ed483-b279-44d2-a2fb-fd2b858e1986 tempest-ProjectMemberTests-1855156353 None] Lock "cinder-quobyte-6bd51148-5156-4276-bc1d-b33d10ef13a7" released by "delete_volume" :: held 0.694s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:40:36 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-973ed483-b279-44d2-a2fb-fd2b858e1986 tempest-ProjectMemberTests-1855156353 None] Created reservations ['446a6b33-bc39-466d-a1a7-22e9a8faa4f5', '9ee77e48-84e9-4c29-a04b-2a04bad0b3a2', 'b4db2ab5-68f0-4303-8a0f-7f17545ac19e', '28967788-0361-40ac-8d98-8c0a1d7854ea'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:40:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-973ed483-b279-44d2-a2fb-fd2b858e1986 tempest-ProjectMemberTests-1855156353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:40:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-973ed483-b279-44d2-a2fb-fd2b858e1986 tempest-ProjectMemberTests-1855156353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:40:36 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-973ed483-b279-44d2-a2fb-fd2b858e1986 tempest-ProjectMemberTests-1855156353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:40:36 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-973ed483-b279-44d2-a2fb-fd2b858e1986 tempest-ProjectMemberTests-1855156353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:40:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-973ed483-b279-44d2-a2fb-fd2b858e1986 tempest-ProjectMemberTests-1855156353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:40:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-973ed483-b279-44d2-a2fb-fd2b858e1986 tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:36 devstack sudo[107544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:40:36 devstack sudo[107544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:36 devstack sudo[107535]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-43b107ef-26ed-4673-9b54-b45c6721305d tempest-ProjectReaderTests-1964668024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-71c9afe6-6f9b-4b59-8315-ddd6308631ba 1073741824" returned: 0 in 0.504s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:36 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-43b107ef-26ed-4673-9b54-b45c6721305d tempest-ProjectReaderTests-1964668024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-71c9afe6-6f9b-4b59-8315-ddd6308631ba {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:37 devstack sudo[107546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-71c9afe6-6f9b-4b59-8315-ddd6308631ba Sep 15 16:40:37 devstack sudo[107546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:37 devstack sudo[107544]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-973ed483-b279-44d2-a2fb-fd2b858e1986 tempest-ProjectMemberTests-1855156353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.302s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:37 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-973ed483-b279-44d2-a2fb-fd2b858e1986 tempest-ProjectMemberTests-1855156353 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:40:37 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-973ed483-b279-44d2-a2fb-fd2b858e1986 tempest-ProjectMemberTests-1855156353 None] Deleted volume successfully. Sep 15 16:40:37 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-973ed483-b279-44d2-a2fb-fd2b858e1986 tempest-ProjectMemberTests-1855156353 None] Lock "cinder-6bd51148-5156-4276-bc1d-b33d10ef13a7-delete_volume" released by "delete_volume" :: held 1.309s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:40:37 devstack sudo[107546]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-43b107ef-26ed-4673-9b54-b45c6721305d tempest-ProjectReaderTests-1964668024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-71c9afe6-6f9b-4b59-8315-ddd6308631ba" returned: 0 in 0.264s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:37 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-43b107ef-26ed-4673-9b54-b45c6721305d tempest-ProjectReaderTests-1964668024 None] <== create_volume: return (817ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:40:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-43b107ef-26ed-4673-9b54-b45c6721305d tempest-ProjectReaderTests-1964668024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.819s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:40:37 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-43b107ef-26ed-4673-9b54-b45c6721305d tempest-ProjectReaderTests-1964668024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56200226-9cff-40e8-b7c4-22d2722e5ac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71c9afe6-6f9b-4b59-8315-ddd6308631ba', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:40:37 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-43b107ef-26ed-4673-9b54-b45c6721305d tempest-ProjectReaderTests-1964668024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (934b4eb5-039c-4857-8ac0-bc6dee0a687d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:40:37 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-43b107ef-26ed-4673-9b54-b45c6721305d tempest-ProjectReaderTests-1964668024 None] Volume volume-71c9afe6-6f9b-4b59-8315-ddd6308631ba (71c9afe6-6f9b-4b59-8315-ddd6308631ba): created successfully Sep 15 16:40:37 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-43b107ef-26ed-4673-9b54-b45c6721305d tempest-ProjectReaderTests-1964668024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (934b4eb5-039c-4857-8ac0-bc6dee0a687d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:40:37 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-43b107ef-26ed-4673-9b54-b45c6721305d tempest-ProjectReaderTests-1964668024 None] Flow 'volume_create_manager' (270070c8-e32f-4d07-baf9-24c2f1829e99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:40:37 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-43b107ef-26ed-4673-9b54-b45c6721305d tempest-ProjectReaderTests-1964668024 None] Created volume successfully. Sep 15 16:40:37 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-f57f1b76-1abb-4cf7-bfa5-6b3813990466 tempest-ProjectMemberTests-1855156353 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:40:37 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f57f1b76-1abb-4cf7-bfa5-6b3813990466 tempest-ProjectMemberTests-1855156353 None] Flow 'volume_create_manager' (a04a293e-ce96-484a-b1e1-c31f635826e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:40:37 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f57f1b76-1abb-4cf7-bfa5-6b3813990466 tempest-ProjectMemberTests-1855156353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c97012cb-bb60-41c0-91fd-3a7625895077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:40:37 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f57f1b76-1abb-4cf7-bfa5-6b3813990466 tempest-ProjectMemberTests-1855156353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c97012cb-bb60-41c0-91fd-3a7625895077) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:40:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1681618169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6b6996a-e690-4c1d-8b8f-bab20cc56dff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a303ec1076004f4db43523c2f7b6a446',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:40:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:40:37Z,use_quota=True,user_id='d9953555b80c481b9eaabbc7d416d0b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:40:37 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f57f1b76-1abb-4cf7-bfa5-6b3813990466 tempest-ProjectMemberTests-1855156353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2cb0879-4383-4afa-b0cb-4d7c4636d4ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:40:37 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f57f1b76-1abb-4cf7-bfa5-6b3813990466 tempest-ProjectMemberTests-1855156353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2cb0879-4383-4afa-b0cb-4d7c4636d4ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:40:37 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f57f1b76-1abb-4cf7-bfa5-6b3813990466 tempest-ProjectMemberTests-1855156353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a5e59e9-b6f9-4600-a75e-4b45c43b119a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:40:37 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f57f1b76-1abb-4cf7-bfa5-6b3813990466 tempest-ProjectMemberTests-1855156353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a5e59e9-b6f9-4600-a75e-4b45c43b119a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6b6996a-e690-4c1d-8b8f-bab20cc56dff', 'volume_name': 'volume-b6b6996a-e690-4c1d-8b8f-bab20cc56dff', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:40:37 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f57f1b76-1abb-4cf7-bfa5-6b3813990466 tempest-ProjectMemberTests-1855156353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab189d82-806d-4cf7-8205-16cff5866829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:40:37 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f57f1b76-1abb-4cf7-bfa5-6b3813990466 tempest-ProjectMemberTests-1855156353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab189d82-806d-4cf7-8205-16cff5866829) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:40:37 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f57f1b76-1abb-4cf7-bfa5-6b3813990466 tempest-ProjectMemberTests-1855156353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12d38165-6ffc-43f4-af0e-1f635ac1aded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:40:37 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-f57f1b76-1abb-4cf7-bfa5-6b3813990466 tempest-ProjectMemberTests-1855156353 None] Volume b6b6996a-e690-4c1d-8b8f-bab20cc56dff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6b6996a-e690-4c1d-8b8f-bab20cc56dff', 'volume_size': 1} Sep 15 16:40:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f57f1b76-1abb-4cf7-bfa5-6b3813990466 tempest-ProjectMemberTests-1855156353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:40:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f57f1b76-1abb-4cf7-bfa5-6b3813990466 tempest-ProjectMemberTests-1855156353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:40:37 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-f57f1b76-1abb-4cf7-bfa5-6b3813990466 tempest-ProjectMemberTests-1855156353 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:40:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1681618169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6b6996a-e690-4c1d-8b8f-bab20cc56dff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a303ec1076004f4db43523c2f7b6a446',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:40:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:40:37Z,use_quota=True,user_id='d9953555b80c481b9eaabbc7d416d0b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:40:37 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-f57f1b76-1abb-4cf7-bfa5-6b3813990466 tempest-ProjectMemberTests-1855156353 None] Creating volume b6b6996a-e690-4c1d-8b8f-bab20cc56dff {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:40:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f57f1b76-1abb-4cf7-bfa5-6b3813990466 tempest-ProjectMemberTests-1855156353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:40:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f57f1b76-1abb-4cf7-bfa5-6b3813990466 tempest-ProjectMemberTests-1855156353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:40:37 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-f57f1b76-1abb-4cf7-bfa5-6b3813990466 tempest-ProjectMemberTests-1855156353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:40:37 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-f57f1b76-1abb-4cf7-bfa5-6b3813990466 tempest-ProjectMemberTests-1855156353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:40:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f57f1b76-1abb-4cf7-bfa5-6b3813990466 tempest-ProjectMemberTests-1855156353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:40:37 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-f57f1b76-1abb-4cf7-bfa5-6b3813990466 tempest-ProjectMemberTests-1855156353 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:40:37 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-f57f1b76-1abb-4cf7-bfa5-6b3813990466 tempest-ProjectMemberTests-1855156353 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:40:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f57f1b76-1abb-4cf7-bfa5-6b3813990466 tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b6b6996a-e690-4c1d-8b8f-bab20cc56dff 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:37 devstack sudo[107551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b6b6996a-e690-4c1d-8b8f-bab20cc56dff 1073741824 Sep 15 16:40:37 devstack sudo[107551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-0d49d3e0-1280-4606-b735-1a9734cc08b9 tempest-ProjectReaderTests-714592672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:40:37 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-d0ce4f86-399d-472d-bd1f-da1fc86d9372 tempest-ProjectReaderTests-1964668024 None] Acquiring lock "cinder-71c9afe6-6f9b-4b59-8315-ddd6308631ba-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:40:37 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-d0ce4f86-399d-472d-bd1f-da1fc86d9372 tempest-ProjectReaderTests-1964668024 None] Lock "cinder-71c9afe6-6f9b-4b59-8315-ddd6308631ba-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:40:37 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-d0ce4f86-399d-472d-bd1f-da1fc86d9372 tempest-ProjectReaderTests-1964668024 None] Acquiring lock "cinder-quobyte-71c9afe6-6f9b-4b59-8315-ddd6308631ba" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:40:37 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-d0ce4f86-399d-472d-bd1f-da1fc86d9372 tempest-ProjectReaderTests-1964668024 None] Lock "cinder-quobyte-71c9afe6-6f9b-4b59-8315-ddd6308631ba" acquired by "delete_volume" :: waited 0.018s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:40:37 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7dc5654-fb37-4dcb-9de8-3c290a55ec69]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:40:37 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d0ce4f86-399d-472d-bd1f-da1fc86d9372 tempest-ProjectReaderTests-1964668024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-71c9afe6-6f9b-4b59-8315-ddd6308631ba {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:38 devstack sudo[107551]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f57f1b76-1abb-4cf7-bfa5-6b3813990466 tempest-ProjectMemberTests-1855156353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b6b6996a-e690-4c1d-8b8f-bab20cc56dff 1073741824" returned: 0 in 0.495s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f57f1b76-1abb-4cf7-bfa5-6b3813990466 tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b6b6996a-e690-4c1d-8b8f-bab20cc56dff {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:38 devstack sudo[107558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b6b6996a-e690-4c1d-8b8f-bab20cc56dff Sep 15 16:40:38 devstack sudo[107558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:38 devstack sudo[107557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-71c9afe6-6f9b-4b59-8315-ddd6308631ba Sep 15 16:40:38 devstack sudo[107557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:38 devstack sudo[107558]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f57f1b76-1abb-4cf7-bfa5-6b3813990466 tempest-ProjectMemberTests-1855156353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b6b6996a-e690-4c1d-8b8f-bab20cc56dff" returned: 0 in 0.265s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:38 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-f57f1b76-1abb-4cf7-bfa5-6b3813990466 tempest-ProjectMemberTests-1855156353 None] <== create_volume: return (804ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:40:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f57f1b76-1abb-4cf7-bfa5-6b3813990466 tempest-ProjectMemberTests-1855156353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.807s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:40:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-0d49d3e0-1280-4606-b735-1a9734cc08b9 tempest-ProjectReaderTests-714592672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.589s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:40:38 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f57f1b76-1abb-4cf7-bfa5-6b3813990466 tempest-ProjectMemberTests-1855156353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12d38165-6ffc-43f4-af0e-1f635ac1aded) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6b6996a-e690-4c1d-8b8f-bab20cc56dff', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:40:38 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f57f1b76-1abb-4cf7-bfa5-6b3813990466 tempest-ProjectMemberTests-1855156353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b6cea6d-e19a-483a-819f-240a2350d27a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:40:38 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-0d49d3e0-1280-4606-b735-1a9734cc08b9 tempest-ProjectReaderTests-714592672 None] Creating offline snapshot 0bbc25f0-88a5-40f4-a845-f05409bb7f75 of volume dae54c8e-0af0-4889-b28a-acb9a0a51ade {{(pid=86082) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 15 16:40:38 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-f57f1b76-1abb-4cf7-bfa5-6b3813990466 tempest-ProjectMemberTests-1855156353 None] Volume volume-b6b6996a-e690-4c1d-8b8f-bab20cc56dff (b6b6996a-e690-4c1d-8b8f-bab20cc56dff): created successfully Sep 15 16:40:38 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f57f1b76-1abb-4cf7-bfa5-6b3813990466 tempest-ProjectMemberTests-1855156353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b6cea6d-e19a-483a-819f-240a2350d27a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:40:38 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-f57f1b76-1abb-4cf7-bfa5-6b3813990466 tempest-ProjectMemberTests-1855156353 None] Flow 'volume_create_manager' (a04a293e-ce96-484a-b1e1-c31f635826e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:40:38 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[0331ef35-70d0-4f17-a84e-68fa67a9bfd1]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:40:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0d49d3e0-1280-4606-b735-1a9734cc08b9 tempest-ProjectReaderTests-714592672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-dae54c8e-0af0-4889-b28a-acb9a0a51ade {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:38 devstack sudo[107557]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d0ce4f86-399d-472d-bd1f-da1fc86d9372 tempest-ProjectReaderTests-1964668024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-71c9afe6-6f9b-4b59-8315-ddd6308631ba" returned: 0 in 0.407s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d0ce4f86-399d-472d-bd1f-da1fc86d9372 tempest-ProjectReaderTests-1964668024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-71c9afe6-6f9b-4b59-8315-ddd6308631ba {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:38 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-f57f1b76-1abb-4cf7-bfa5-6b3813990466 tempest-ProjectMemberTests-1855156353 None] Created volume successfully. Sep 15 16:40:38 devstack sudo[107566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-71c9afe6-6f9b-4b59-8315-ddd6308631ba Sep 15 16:40:38 devstack sudo[107566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:38 devstack sudo[107565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-dae54c8e-0af0-4889-b28a-acb9a0a51ade Sep 15 16:40:38 devstack sudo[107565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:38 devstack sudo[107566]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d0ce4f86-399d-472d-bd1f-da1fc86d9372 tempest-ProjectReaderTests-1964668024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-71c9afe6-6f9b-4b59-8315-ddd6308631ba" returned: 0 in 0.255s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:38 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-d0ce4f86-399d-472d-bd1f-da1fc86d9372 tempest-ProjectReaderTests-1964668024 None] Lock "cinder-quobyte-71c9afe6-6f9b-4b59-8315-ddd6308631ba" released by "delete_volume" :: held 0.704s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:40:38 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-d0ce4f86-399d-472d-bd1f-da1fc86d9372 tempest-ProjectReaderTests-1964668024 None] Created reservations ['363bd649-2a7b-4993-beb1-78b1afd43e36', '6fc70f83-853f-429d-8ce1-10ec32b4533f', '454588cd-d0e3-42ec-bd35-0f1523fbc7bc', '1ab93b76-0f2d-4cb0-a987-ec8118f27a54'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:40:38 devstack sudo[107565]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0d49d3e0-1280-4606-b735-1a9734cc08b9 tempest-ProjectReaderTests-714592672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-dae54c8e-0af0-4889-b28a-acb9a0a51ade" returned: 0 in 0.401s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0d49d3e0-1280-4606-b735-1a9734cc08b9 tempest-ProjectReaderTests-714592672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-dae54c8e-0af0-4889-b28a-acb9a0a51ade,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-dae54c8e-0af0-4889-b28a-acb9a0a51ade.0bbc25f0-88a5-40f4-a845-f05409bb7f75 1G {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-d0ce4f86-399d-472d-bd1f-da1fc86d9372 tempest-ProjectReaderTests-1964668024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:40:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-d0ce4f86-399d-472d-bd1f-da1fc86d9372 tempest-ProjectReaderTests-1964668024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:40:38 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-d0ce4f86-399d-472d-bd1f-da1fc86d9372 tempest-ProjectReaderTests-1964668024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:40:38 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-d0ce4f86-399d-472d-bd1f-da1fc86d9372 tempest-ProjectReaderTests-1964668024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:40:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-d0ce4f86-399d-472d-bd1f-da1fc86d9372 tempest-ProjectReaderTests-1964668024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:40:38 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d0ce4f86-399d-472d-bd1f-da1fc86d9372 tempest-ProjectReaderTests-1964668024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:38 devstack sudo[107573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-dae54c8e-0af0-4889-b28a-acb9a0a51ade,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-dae54c8e-0af0-4889-b28a-acb9a0a51ade.0bbc25f0-88a5-40f4-a845-f05409bb7f75 1G Sep 15 16:40:38 devstack sudo[107573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:38 devstack sudo[107575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:40:38 devstack sudo[107575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:39 devstack sudo[107575]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d0ce4f86-399d-472d-bd1f-da1fc86d9372 tempest-ProjectReaderTests-1964668024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.248s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:39 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-d0ce4f86-399d-472d-bd1f-da1fc86d9372 tempest-ProjectReaderTests-1964668024 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:40:39 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-d0ce4f86-399d-472d-bd1f-da1fc86d9372 tempest-ProjectReaderTests-1964668024 None] Deleted volume successfully. Sep 15 16:40:39 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-d0ce4f86-399d-472d-bd1f-da1fc86d9372 tempest-ProjectReaderTests-1964668024 None] Lock "cinder-71c9afe6-6f9b-4b59-8315-ddd6308631ba-delete_volume" released by "delete_volume" :: held 1.180s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:40:39 devstack sudo[107573]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0d49d3e0-1280-4606-b735-1a9734cc08b9 tempest-ProjectReaderTests-714592672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-dae54c8e-0af0-4889-b28a-acb9a0a51ade,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-dae54c8e-0af0-4889-b28a-acb9a0a51ade.0bbc25f0-88a5-40f4-a845-f05409bb7f75 1G" returned: 0 in 0.461s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0d49d3e0-1280-4606-b735-1a9734cc08b9 tempest-ProjectReaderTests-714592672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dae54c8e-0af0-4889-b28a-acb9a0a51ade -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-dae54c8e-0af0-4889-b28a-acb9a0a51ade.0bbc25f0-88a5-40f4-a845-f05409bb7f75 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:39 devstack sudo[107582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dae54c8e-0af0-4889-b28a-acb9a0a51ade -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-dae54c8e-0af0-4889-b28a-acb9a0a51ade.0bbc25f0-88a5-40f4-a845-f05409bb7f75 Sep 15 16:40:39 devstack sudo[107582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:39 devstack sudo[107582]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0d49d3e0-1280-4606-b735-1a9734cc08b9 tempest-ProjectReaderTests-714592672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dae54c8e-0af0-4889-b28a-acb9a0a51ade -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-dae54c8e-0af0-4889-b28a-acb9a0a51ade.0bbc25f0-88a5-40f4-a845-f05409bb7f75" returned: 0 in 0.337s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:39 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-0d49d3e0-1280-4606-b735-1a9734cc08b9 tempest-ProjectReaderTests-714592672 None] /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-dae54c8e-0af0-4889-b28a-acb9a0a51ade.0bbc25f0-88a5-40f4-a845-f05409bb7f75 is being set with open permissions: ugo+rw Sep 15 16:40:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0d49d3e0-1280-4606-b735-1a9734cc08b9 tempest-ProjectReaderTests-714592672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-dae54c8e-0af0-4889-b28a-acb9a0a51ade.0bbc25f0-88a5-40f4-a845-f05409bb7f75 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:39 devstack sudo[107588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-dae54c8e-0af0-4889-b28a-acb9a0a51ade.0bbc25f0-88a5-40f4-a845-f05409bb7f75 Sep 15 16:40:39 devstack sudo[107588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-ff371845-d6b9-41a2-bee1-dbfd6f8592fb tempest-ProjectMemberTests-1855156353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:40:39 devstack sudo[107588]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0d49d3e0-1280-4606-b735-1a9734cc08b9 tempest-ProjectReaderTests-714592672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-dae54c8e-0af0-4889-b28a-acb9a0a51ade.0bbc25f0-88a5-40f4-a845-f05409bb7f75" returned: 0 in 0.327s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:39 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0d49d3e0-1280-4606-b735-1a9734cc08b9 tempest-ProjectReaderTests-714592672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-dae54c8e-0af0-4889-b28a-acb9a0a51ade.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:39 devstack sudo[107591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-dae54c8e-0af0-4889-b28a-acb9a0a51ade.info Sep 15 16:40:39 devstack sudo[107591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:40 devstack sudo[107591]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0d49d3e0-1280-4606-b735-1a9734cc08b9 tempest-ProjectReaderTests-714592672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-dae54c8e-0af0-4889-b28a-acb9a0a51ade.info" returned: 0 in 0.279s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:40 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-0d49d3e0-1280-4606-b735-1a9734cc08b9 tempest-ProjectReaderTests-714592672 None] /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-dae54c8e-0af0-4889-b28a-acb9a0a51ade.info is being set with open permissions: ugo+rw Sep 15 16:40:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0d49d3e0-1280-4606-b735-1a9734cc08b9 tempest-ProjectReaderTests-714592672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-dae54c8e-0af0-4889-b28a-acb9a0a51ade.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:40 devstack sudo[107594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-dae54c8e-0af0-4889-b28a-acb9a0a51ade.info Sep 15 16:40:40 devstack sudo[107594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:40 devstack sudo[107594]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0d49d3e0-1280-4606-b735-1a9734cc08b9 tempest-ProjectReaderTests-714592672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-dae54c8e-0af0-4889-b28a-acb9a0a51ade.info" returned: 0 in 0.260s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-0d49d3e0-1280-4606-b735-1a9734cc08b9 tempest-ProjectReaderTests-714592672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.200s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:40:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-ff371845-d6b9-41a2-bee1-dbfd6f8592fb tempest-ProjectMemberTests-1855156353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.775s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:40:40 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-ff371845-d6b9-41a2-bee1-dbfd6f8592fb tempest-ProjectMemberTests-1855156353 None] Creating offline snapshot 162d675d-62ab-40a6-ac04-2442a92934c2 of volume b6b6996a-e690-4c1d-8b8f-bab20cc56dff {{(pid=86082) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 15 16:40:40 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-0d49d3e0-1280-4606-b735-1a9734cc08b9 tempest-ProjectReaderTests-714592672 None] Create snapshot completed successfully Sep 15 16:40:40 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9b075c1-f51a-4795-95aa-ec7cf95be6ad]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:40:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ff371845-d6b9-41a2-bee1-dbfd6f8592fb tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b6b6996a-e690-4c1d-8b8f-bab20cc56dff {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:40 devstack sudo[107597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b6b6996a-e690-4c1d-8b8f-bab20cc56dff Sep 15 16:40:40 devstack sudo[107597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:40 devstack sudo[107597]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ff371845-d6b9-41a2-bee1-dbfd6f8592fb tempest-ProjectMemberTests-1855156353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b6b6996a-e690-4c1d-8b8f-bab20cc56dff" returned: 0 in 0.431s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:40 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ff371845-d6b9-41a2-bee1-dbfd6f8592fb tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b6b6996a-e690-4c1d-8b8f-bab20cc56dff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b6b6996a-e690-4c1d-8b8f-bab20cc56dff.162d675d-62ab-40a6-ac04-2442a92934c2 1G {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:41 devstack sudo[107602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b6b6996a-e690-4c1d-8b8f-bab20cc56dff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b6b6996a-e690-4c1d-8b8f-bab20cc56dff.162d675d-62ab-40a6-ac04-2442a92934c2 1G Sep 15 16:40:41 devstack sudo[107602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:41 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-326f9621-4b56-44c6-89d4-20a8f562399f tempest-ProjectReaderTests-714592672 None] Acquiring lock "cinder-0bbc25f0-88a5-40f4-a845-f05409bb7f75-delete_snapshot" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:40:41 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-326f9621-4b56-44c6-89d4-20a8f562399f tempest-ProjectReaderTests-714592672 None] Lock "cinder-0bbc25f0-88a5-40f4-a845-f05409bb7f75-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:40:41 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-326f9621-4b56-44c6-89d4-20a8f562399f tempest-ProjectReaderTests-714592672 None] Acquiring lock "cinder-quobyte-dae54c8e-0af0-4889-b28a-acb9a0a51ade" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:40:41 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-326f9621-4b56-44c6-89d4-20a8f562399f tempest-ProjectReaderTests-714592672 None] Lock "cinder-quobyte-dae54c8e-0af0-4889-b28a-acb9a0a51ade" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:40:41 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-326f9621-4b56-44c6-89d4-20a8f562399f tempest-ProjectReaderTests-714592672 None] Acquiring lock "cinder-quobyte-0bbc25f0-88a5-40f4-a845-f05409bb7f75" by "_delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:40:41 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-326f9621-4b56-44c6-89d4-20a8f562399f tempest-ProjectReaderTests-714592672 None] Lock "cinder-quobyte-0bbc25f0-88a5-40f4-a845-f05409bb7f75" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:40:41 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-326f9621-4b56-44c6-89d4-20a8f562399f tempest-ProjectReaderTests-714592672 None] Deleting offline snapshot 0bbc25f0-88a5-40f4-a845-f05409bb7f75 of volume dae54c8e-0af0-4889-b28a-acb9a0a51ade {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 15 16:40:41 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-326f9621-4b56-44c6-89d4-20a8f562399f tempest-ProjectReaderTests-714592672 None] snapshot_file for this snap is: volume-dae54c8e-0af0-4889-b28a-acb9a0a51ade.0bbc25f0-88a5-40f4-a845-f05409bb7f75 {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 15 16:40:41 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d197656-f0a6-40f6-bd9e-18362914c27c]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:40:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-326f9621-4b56-44c6-89d4-20a8f562399f tempest-ProjectReaderTests-714592672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-dae54c8e-0af0-4889-b28a-acb9a0a51ade.0bbc25f0-88a5-40f4-a845-f05409bb7f75 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:41 devstack sudo[107607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-dae54c8e-0af0-4889-b28a-acb9a0a51ade.0bbc25f0-88a5-40f4-a845-f05409bb7f75 Sep 15 16:40:41 devstack sudo[107607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:41 devstack sudo[107602]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ff371845-d6b9-41a2-bee1-dbfd6f8592fb tempest-ProjectMemberTests-1855156353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b6b6996a-e690-4c1d-8b8f-bab20cc56dff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b6b6996a-e690-4c1d-8b8f-bab20cc56dff.162d675d-62ab-40a6-ac04-2442a92934c2 1G" returned: 0 in 0.444s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ff371845-d6b9-41a2-bee1-dbfd6f8592fb tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6b6996a-e690-4c1d-8b8f-bab20cc56dff -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b6b6996a-e690-4c1d-8b8f-bab20cc56dff.162d675d-62ab-40a6-ac04-2442a92934c2 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:41 devstack sudo[107609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6b6996a-e690-4c1d-8b8f-bab20cc56dff -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b6b6996a-e690-4c1d-8b8f-bab20cc56dff.162d675d-62ab-40a6-ac04-2442a92934c2 Sep 15 16:40:41 devstack sudo[107609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:41 devstack sudo[107607]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-326f9621-4b56-44c6-89d4-20a8f562399f tempest-ProjectReaderTests-714592672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-dae54c8e-0af0-4889-b28a-acb9a0a51ade.0bbc25f0-88a5-40f4-a845-f05409bb7f75" returned: 0 in 0.373s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:41 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-326f9621-4b56-44c6-89d4-20a8f562399f tempest-ProjectReaderTests-714592672 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dae54c8e-0af0-4889-b28a-acb9a0a51ade(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 16:40:41 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbd2c540-8f6c-4e67-9395-b221b89a2738]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:40:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-326f9621-4b56-44c6-89d4-20a8f562399f tempest-ProjectReaderTests-714592672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-dae54c8e-0af0-4889-b28a-acb9a0a51ade {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:41 devstack sudo[107609]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ff371845-d6b9-41a2-bee1-dbfd6f8592fb tempest-ProjectMemberTests-1855156353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b6b6996a-e690-4c1d-8b8f-bab20cc56dff -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b6b6996a-e690-4c1d-8b8f-bab20cc56dff.162d675d-62ab-40a6-ac04-2442a92934c2" returned: 0 in 0.293s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:41 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-ff371845-d6b9-41a2-bee1-dbfd6f8592fb tempest-ProjectMemberTests-1855156353 None] /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b6b6996a-e690-4c1d-8b8f-bab20cc56dff.162d675d-62ab-40a6-ac04-2442a92934c2 is being set with open permissions: ugo+rw Sep 15 16:40:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ff371845-d6b9-41a2-bee1-dbfd6f8592fb tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b6b6996a-e690-4c1d-8b8f-bab20cc56dff.162d675d-62ab-40a6-ac04-2442a92934c2 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:41 devstack sudo[107618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b6b6996a-e690-4c1d-8b8f-bab20cc56dff.162d675d-62ab-40a6-ac04-2442a92934c2 Sep 15 16:40:41 devstack sudo[107618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:41 devstack sudo[107617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-dae54c8e-0af0-4889-b28a-acb9a0a51ade Sep 15 16:40:41 devstack sudo[107617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:41 devstack sudo[107618]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:41 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ff371845-d6b9-41a2-bee1-dbfd6f8592fb tempest-ProjectMemberTests-1855156353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b6b6996a-e690-4c1d-8b8f-bab20cc56dff.162d675d-62ab-40a6-ac04-2442a92934c2" returned: 0 in 0.261s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ff371845-d6b9-41a2-bee1-dbfd6f8592fb tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b6b6996a-e690-4c1d-8b8f-bab20cc56dff.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:42 devstack sudo[107623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b6b6996a-e690-4c1d-8b8f-bab20cc56dff.info Sep 15 16:40:42 devstack sudo[107623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:42 devstack sudo[107617]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-326f9621-4b56-44c6-89d4-20a8f562399f tempest-ProjectReaderTests-714592672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-dae54c8e-0af0-4889-b28a-acb9a0a51ade" returned: 0 in 0.380s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-326f9621-4b56-44c6-89d4-20a8f562399f tempest-ProjectReaderTests-714592672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-dae54c8e-0af0-4889-b28a-acb9a0a51ade.0bbc25f0-88a5-40f4-a845-f05409bb7f75 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:42 devstack sudo[107628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-dae54c8e-0af0-4889-b28a-acb9a0a51ade.0bbc25f0-88a5-40f4-a845-f05409bb7f75 Sep 15 16:40:42 devstack sudo[107628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:42 devstack sudo[107623]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ff371845-d6b9-41a2-bee1-dbfd6f8592fb tempest-ProjectMemberTests-1855156353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b6b6996a-e690-4c1d-8b8f-bab20cc56dff.info" returned: 0 in 0.281s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:42 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-ff371845-d6b9-41a2-bee1-dbfd6f8592fb tempest-ProjectMemberTests-1855156353 None] /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b6b6996a-e690-4c1d-8b8f-bab20cc56dff.info is being set with open permissions: ugo+rw Sep 15 16:40:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ff371845-d6b9-41a2-bee1-dbfd6f8592fb tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b6b6996a-e690-4c1d-8b8f-bab20cc56dff.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:42 devstack sudo[107631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b6b6996a-e690-4c1d-8b8f-bab20cc56dff.info Sep 15 16:40:42 devstack sudo[107631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:42 devstack sudo[107628]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-326f9621-4b56-44c6-89d4-20a8f562399f tempest-ProjectReaderTests-714592672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-dae54c8e-0af0-4889-b28a-acb9a0a51ade.0bbc25f0-88a5-40f4-a845-f05409bb7f75" returned: 0 in 0.353s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-326f9621-4b56-44c6-89d4-20a8f562399f tempest-ProjectReaderTests-714592672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-dae54c8e-0af0-4889-b28a-acb9a0a51ade.0bbc25f0-88a5-40f4-a845-f05409bb7f75 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:42 devstack sudo[107636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-dae54c8e-0af0-4889-b28a-acb9a0a51ade.0bbc25f0-88a5-40f4-a845-f05409bb7f75 Sep 15 16:40:42 devstack sudo[107636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:42 devstack sudo[107631]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ff371845-d6b9-41a2-bee1-dbfd6f8592fb tempest-ProjectMemberTests-1855156353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b6b6996a-e690-4c1d-8b8f-bab20cc56dff.info" returned: 0 in 0.260s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-ff371845-d6b9-41a2-bee1-dbfd6f8592fb tempest-ProjectMemberTests-1855156353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.071s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:40:42 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-ff371845-d6b9-41a2-bee1-dbfd6f8592fb tempest-ProjectMemberTests-1855156353 None] Create snapshot completed successfully Sep 15 16:40:42 devstack sudo[107636]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:42 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-326f9621-4b56-44c6-89d4-20a8f562399f tempest-ProjectReaderTests-714592672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-dae54c8e-0af0-4889-b28a-acb9a0a51ade.0bbc25f0-88a5-40f4-a845-f05409bb7f75" returned: 0 in 0.266s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:42 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-326f9621-4b56-44c6-89d4-20a8f562399f tempest-ProjectReaderTests-714592672 None] Lock "cinder-quobyte-0bbc25f0-88a5-40f4-a845-f05409bb7f75" released by "_delete_snapshot" :: held 1.479s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:40:42 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-326f9621-4b56-44c6-89d4-20a8f562399f tempest-ProjectReaderTests-714592672 None] Lock "cinder-quobyte-dae54c8e-0af0-4889-b28a-acb9a0a51ade" released by "delete_snapshot" :: held 1.507s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:40:42 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-326f9621-4b56-44c6-89d4-20a8f562399f tempest-ProjectReaderTests-714592672 None] Created reservations ['6e79c531-00a3-4b3a-bb6a-05610c9ef158', 'af7f17ab-2aca-4757-8d86-ac11192051e6', '73f4d15d-2508-4e2c-bb35-b78985a858c3', '10dee6d8-987f-4d94-b08f-d77e29b993d8'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:40:42 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-2d80004e-d1ca-441d-be75-30f89f3e56d6 tempest-ProjectMemberTests-1855156353 None] Acquiring lock "cinder-162d675d-62ab-40a6-ac04-2442a92934c2-delete_snapshot" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:40:42 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-326f9621-4b56-44c6-89d4-20a8f562399f tempest-ProjectReaderTests-714592672 None] Delete snapshot completed successfully. Sep 15 16:40:42 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-2d80004e-d1ca-441d-be75-30f89f3e56d6 tempest-ProjectMemberTests-1855156353 None] Lock "cinder-162d675d-62ab-40a6-ac04-2442a92934c2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:40:42 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-2d80004e-d1ca-441d-be75-30f89f3e56d6 tempest-ProjectMemberTests-1855156353 None] Acquiring lock "cinder-quobyte-b6b6996a-e690-4c1d-8b8f-bab20cc56dff" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:40:42 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-326f9621-4b56-44c6-89d4-20a8f562399f tempest-ProjectReaderTests-714592672 None] Lock "cinder-0bbc25f0-88a5-40f4-a845-f05409bb7f75-delete_snapshot" released by "delete_snapshot" :: held 1.746s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:40:42 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-2d80004e-d1ca-441d-be75-30f89f3e56d6 tempest-ProjectMemberTests-1855156353 None] Lock "cinder-quobyte-b6b6996a-e690-4c1d-8b8f-bab20cc56dff" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:40:42 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-2d80004e-d1ca-441d-be75-30f89f3e56d6 tempest-ProjectMemberTests-1855156353 None] Acquiring lock "cinder-quobyte-162d675d-62ab-40a6-ac04-2442a92934c2" by "_delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:40:43 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-2d80004e-d1ca-441d-be75-30f89f3e56d6 tempest-ProjectMemberTests-1855156353 None] Lock "cinder-quobyte-162d675d-62ab-40a6-ac04-2442a92934c2" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:40:43 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-2d80004e-d1ca-441d-be75-30f89f3e56d6 tempest-ProjectMemberTests-1855156353 None] Deleting offline snapshot 162d675d-62ab-40a6-ac04-2442a92934c2 of volume b6b6996a-e690-4c1d-8b8f-bab20cc56dff {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 15 16:40:43 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-2d80004e-d1ca-441d-be75-30f89f3e56d6 tempest-ProjectMemberTests-1855156353 None] snapshot_file for this snap is: volume-b6b6996a-e690-4c1d-8b8f-bab20cc56dff.162d675d-62ab-40a6-ac04-2442a92934c2 {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 15 16:40:43 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[509d0c88-b628-45e8-bac5-99bbb87dd45a]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:40:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2d80004e-d1ca-441d-be75-30f89f3e56d6 tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b6b6996a-e690-4c1d-8b8f-bab20cc56dff.162d675d-62ab-40a6-ac04-2442a92934c2 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:43 devstack sudo[107640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b6b6996a-e690-4c1d-8b8f-bab20cc56dff.162d675d-62ab-40a6-ac04-2442a92934c2 Sep 15 16:40:43 devstack sudo[107640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:43 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-25147a54-5d8e-473a-ac1e-102694d81cc5 tempest-ProjectReaderTests-714592672 None] Acquiring lock "cinder-dae54c8e-0af0-4889-b28a-acb9a0a51ade-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:40:43 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-25147a54-5d8e-473a-ac1e-102694d81cc5 tempest-ProjectReaderTests-714592672 None] Lock "cinder-dae54c8e-0af0-4889-b28a-acb9a0a51ade-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:40:43 devstack sudo[107640]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2d80004e-d1ca-441d-be75-30f89f3e56d6 tempest-ProjectMemberTests-1855156353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b6b6996a-e690-4c1d-8b8f-bab20cc56dff.162d675d-62ab-40a6-ac04-2442a92934c2" returned: 0 in 0.390s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:43 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-2d80004e-d1ca-441d-be75-30f89f3e56d6 tempest-ProjectMemberTests-1855156353 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b6b6996a-e690-4c1d-8b8f-bab20cc56dff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 16:40:43 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e4b504c-4fdb-4064-a7b0-b110c71d7549]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:40:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2d80004e-d1ca-441d-be75-30f89f3e56d6 tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b6b6996a-e690-4c1d-8b8f-bab20cc56dff {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:43 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-25147a54-5d8e-473a-ac1e-102694d81cc5 tempest-ProjectReaderTests-714592672 None] Acquiring lock "cinder-quobyte-dae54c8e-0af0-4889-b28a-acb9a0a51ade" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:40:43 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-25147a54-5d8e-473a-ac1e-102694d81cc5 tempest-ProjectReaderTests-714592672 None] Lock "cinder-quobyte-dae54c8e-0af0-4889-b28a-acb9a0a51ade" acquired by "delete_volume" :: waited 0.025s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:40:43 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d3b82e3-aba5-4629-b168-1d13d27b1d52]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:40:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-25147a54-5d8e-473a-ac1e-102694d81cc5 tempest-ProjectReaderTests-714592672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-dae54c8e-0af0-4889-b28a-acb9a0a51ade {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:43 devstack sudo[107645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b6b6996a-e690-4c1d-8b8f-bab20cc56dff Sep 15 16:40:43 devstack sudo[107645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:43 devstack sudo[107646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-dae54c8e-0af0-4889-b28a-acb9a0a51ade Sep 15 16:40:43 devstack sudo[107646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:43 devstack sudo[107645]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2d80004e-d1ca-441d-be75-30f89f3e56d6 tempest-ProjectMemberTests-1855156353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b6b6996a-e690-4c1d-8b8f-bab20cc56dff" returned: 0 in 0.394s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2d80004e-d1ca-441d-be75-30f89f3e56d6 tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b6b6996a-e690-4c1d-8b8f-bab20cc56dff.162d675d-62ab-40a6-ac04-2442a92934c2 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:43 devstack sudo[107654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b6b6996a-e690-4c1d-8b8f-bab20cc56dff.162d675d-62ab-40a6-ac04-2442a92934c2 Sep 15 16:40:43 devstack sudo[107654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:43 devstack sudo[107646]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-25147a54-5d8e-473a-ac1e-102694d81cc5 tempest-ProjectReaderTests-714592672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-dae54c8e-0af0-4889-b28a-acb9a0a51ade" returned: 0 in 0.378s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:43 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-25147a54-5d8e-473a-ac1e-102694d81cc5 tempest-ProjectReaderTests-714592672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-dae54c8e-0af0-4889-b28a-acb9a0a51ade {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:43 devstack sudo[107657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-dae54c8e-0af0-4889-b28a-acb9a0a51ade Sep 15 16:40:43 devstack sudo[107657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:44 devstack sudo[107654]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2d80004e-d1ca-441d-be75-30f89f3e56d6 tempest-ProjectMemberTests-1855156353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b6b6996a-e690-4c1d-8b8f-bab20cc56dff.162d675d-62ab-40a6-ac04-2442a92934c2" returned: 0 in 0.341s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2d80004e-d1ca-441d-be75-30f89f3e56d6 tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b6b6996a-e690-4c1d-8b8f-bab20cc56dff.162d675d-62ab-40a6-ac04-2442a92934c2 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:44 devstack sudo[107657]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-25147a54-5d8e-473a-ac1e-102694d81cc5 tempest-ProjectReaderTests-714592672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-dae54c8e-0af0-4889-b28a-acb9a0a51ade" returned: 0 in 0.278s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:44 devstack sudo[107663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b6b6996a-e690-4c1d-8b8f-bab20cc56dff.162d675d-62ab-40a6-ac04-2442a92934c2 Sep 15 16:40:44 devstack sudo[107663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:44 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-25147a54-5d8e-473a-ac1e-102694d81cc5 tempest-ProjectReaderTests-714592672 None] Lock "cinder-quobyte-dae54c8e-0af0-4889-b28a-acb9a0a51ade" released by "delete_volume" :: held 0.728s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:40:44 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-25147a54-5d8e-473a-ac1e-102694d81cc5 tempest-ProjectReaderTests-714592672 None] Created reservations ['c3f59d20-cf48-4b80-8dba-b11ba8d951d6', '46aadb3d-1318-479c-b88e-6575dcfed17e', '89c439aa-c841-4130-ba84-9c1c82f8ff0a', '4a6e053a-c0eb-4b86-894b-1c74c1477bbc'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:40:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-25147a54-5d8e-473a-ac1e-102694d81cc5 tempest-ProjectReaderTests-714592672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:40:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-25147a54-5d8e-473a-ac1e-102694d81cc5 tempest-ProjectReaderTests-714592672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:40:44 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-25147a54-5d8e-473a-ac1e-102694d81cc5 tempest-ProjectReaderTests-714592672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:40:44 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-25147a54-5d8e-473a-ac1e-102694d81cc5 tempest-ProjectReaderTests-714592672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:40:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-25147a54-5d8e-473a-ac1e-102694d81cc5 tempest-ProjectReaderTests-714592672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:40:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-25147a54-5d8e-473a-ac1e-102694d81cc5 tempest-ProjectReaderTests-714592672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:44 devstack sudo[107665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:40:44 devstack sudo[107665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:44 devstack sudo[107663]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-2d80004e-d1ca-441d-be75-30f89f3e56d6 tempest-ProjectMemberTests-1855156353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b6b6996a-e690-4c1d-8b8f-bab20cc56dff.162d675d-62ab-40a6-ac04-2442a92934c2" returned: 0 in 0.261s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:44 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-2d80004e-d1ca-441d-be75-30f89f3e56d6 tempest-ProjectMemberTests-1855156353 None] Lock "cinder-quobyte-162d675d-62ab-40a6-ac04-2442a92934c2" released by "_delete_snapshot" :: held 1.515s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:40:44 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-2d80004e-d1ca-441d-be75-30f89f3e56d6 tempest-ProjectMemberTests-1855156353 None] Lock "cinder-quobyte-b6b6996a-e690-4c1d-8b8f-bab20cc56dff" released by "delete_snapshot" :: held 1.539s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:40:44 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-2d80004e-d1ca-441d-be75-30f89f3e56d6 tempest-ProjectMemberTests-1855156353 None] Created reservations ['bd3a04d3-ccae-4401-8995-9a5854735b9a', '65803073-ae6e-4258-a42e-3c226a9a0cf2', '959a2f34-0504-49d1-a48d-f6da0ee2ef37', 'f79d60e4-0901-4666-bf31-a54352415097'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:40:44 devstack sudo[107665]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:44 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-25147a54-5d8e-473a-ac1e-102694d81cc5 tempest-ProjectReaderTests-714592672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.262s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:44 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-25147a54-5d8e-473a-ac1e-102694d81cc5 tempest-ProjectReaderTests-714592672 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:40:44 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-25147a54-5d8e-473a-ac1e-102694d81cc5 tempest-ProjectReaderTests-714592672 None] Deleted volume successfully. Sep 15 16:40:44 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-25147a54-5d8e-473a-ac1e-102694d81cc5 tempest-ProjectReaderTests-714592672 None] Lock "cinder-dae54c8e-0af0-4889-b28a-acb9a0a51ade-delete_volume" released by "delete_volume" :: held 1.243s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:40:44 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-2d80004e-d1ca-441d-be75-30f89f3e56d6 tempest-ProjectMemberTests-1855156353 None] Delete snapshot completed successfully. Sep 15 16:40:44 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-2d80004e-d1ca-441d-be75-30f89f3e56d6 tempest-ProjectMemberTests-1855156353 None] Lock "cinder-162d675d-62ab-40a6-ac04-2442a92934c2-delete_snapshot" released by "delete_snapshot" :: held 1.700s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:40:44 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-c42fca2d-fb6b-48db-8679-59e173a19e99 tempest-ProjectReaderTests-714592672 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:40:45 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c42fca2d-fb6b-48db-8679-59e173a19e99 tempest-ProjectReaderTests-714592672 None] Flow 'volume_create_manager' (70630c72-a370-4850-890f-f17cc5d96635) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:40:45 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c42fca2d-fb6b-48db-8679-59e173a19e99 tempest-ProjectReaderTests-714592672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b689a91c-1d79-45b7-a1db-d747887fa974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:40:45 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c42fca2d-fb6b-48db-8679-59e173a19e99 tempest-ProjectReaderTests-714592672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b689a91c-1d79-45b7-a1db-d747887fa974) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:40:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1232688263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da49e180-bdd5-4e11-ab2f-8e4e780a531b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68cde7c8450e4480a0855eacf56861b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:40:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:40:45Z,use_quota=True,user_id='8d100ae259564a538c7bf3f0e0d830cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:40:45 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c42fca2d-fb6b-48db-8679-59e173a19e99 tempest-ProjectReaderTests-714592672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d4c2f43-a2b1-4539-853c-425b2f6e81ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:40:45 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c42fca2d-fb6b-48db-8679-59e173a19e99 tempest-ProjectReaderTests-714592672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5d4c2f43-a2b1-4539-853c-425b2f6e81ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:40:45 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c42fca2d-fb6b-48db-8679-59e173a19e99 tempest-ProjectReaderTests-714592672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (919c80f3-cb9d-4a3d-90fb-fc4072be5349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:40:45 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c42fca2d-fb6b-48db-8679-59e173a19e99 tempest-ProjectReaderTests-714592672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (919c80f3-cb9d-4a3d-90fb-fc4072be5349) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da49e180-bdd5-4e11-ab2f-8e4e780a531b', 'volume_name': 'volume-da49e180-bdd5-4e11-ab2f-8e4e780a531b', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:40:45 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c42fca2d-fb6b-48db-8679-59e173a19e99 tempest-ProjectReaderTests-714592672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca82c13b-db1c-4143-99d9-0125000bac3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:40:45 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c42fca2d-fb6b-48db-8679-59e173a19e99 tempest-ProjectReaderTests-714592672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ca82c13b-db1c-4143-99d9-0125000bac3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:40:45 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c42fca2d-fb6b-48db-8679-59e173a19e99 tempest-ProjectReaderTests-714592672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ecb9442-3e08-480a-adf2-8b2e3d91c6dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:40:45 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-c42fca2d-fb6b-48db-8679-59e173a19e99 tempest-ProjectReaderTests-714592672 None] Volume da49e180-bdd5-4e11-ab2f-8e4e780a531b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da49e180-bdd5-4e11-ab2f-8e4e780a531b', 'volume_size': 1} Sep 15 16:40:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c42fca2d-fb6b-48db-8679-59e173a19e99 tempest-ProjectReaderTests-714592672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:40:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c42fca2d-fb6b-48db-8679-59e173a19e99 tempest-ProjectReaderTests-714592672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:40:45 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c42fca2d-fb6b-48db-8679-59e173a19e99 tempest-ProjectReaderTests-714592672 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:40:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1232688263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da49e180-bdd5-4e11-ab2f-8e4e780a531b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68cde7c8450e4480a0855eacf56861b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:40:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:40:45Z,use_quota=True,user_id='8d100ae259564a538c7bf3f0e0d830cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:40:45 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-c42fca2d-fb6b-48db-8679-59e173a19e99 tempest-ProjectReaderTests-714592672 None] Creating volume da49e180-bdd5-4e11-ab2f-8e4e780a531b {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:40:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c42fca2d-fb6b-48db-8679-59e173a19e99 tempest-ProjectReaderTests-714592672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:40:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c42fca2d-fb6b-48db-8679-59e173a19e99 tempest-ProjectReaderTests-714592672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:40:45 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c42fca2d-fb6b-48db-8679-59e173a19e99 tempest-ProjectReaderTests-714592672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:40:45 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c42fca2d-fb6b-48db-8679-59e173a19e99 tempest-ProjectReaderTests-714592672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:40:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c42fca2d-fb6b-48db-8679-59e173a19e99 tempest-ProjectReaderTests-714592672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:40:45 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c42fca2d-fb6b-48db-8679-59e173a19e99 tempest-ProjectReaderTests-714592672 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:40:45 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-c42fca2d-fb6b-48db-8679-59e173a19e99 tempest-ProjectReaderTests-714592672 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:40:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c42fca2d-fb6b-48db-8679-59e173a19e99 tempest-ProjectReaderTests-714592672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-da49e180-bdd5-4e11-ab2f-8e4e780a531b 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:45 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-dd71a85c-c508-4635-8ba4-8876cd8e1581 tempest-ProjectMemberTests-1855156353 None] Acquiring lock "cinder-b6b6996a-e690-4c1d-8b8f-bab20cc56dff-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:40:45 devstack sudo[107669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-da49e180-bdd5-4e11-ab2f-8e4e780a531b 1073741824 Sep 15 16:40:45 devstack sudo[107669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:45 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-dd71a85c-c508-4635-8ba4-8876cd8e1581 tempest-ProjectMemberTests-1855156353 None] Lock "cinder-b6b6996a-e690-4c1d-8b8f-bab20cc56dff-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:40:45 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-dd71a85c-c508-4635-8ba4-8876cd8e1581 tempest-ProjectMemberTests-1855156353 None] Acquiring lock "cinder-quobyte-b6b6996a-e690-4c1d-8b8f-bab20cc56dff" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:40:45 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-dd71a85c-c508-4635-8ba4-8876cd8e1581 tempest-ProjectMemberTests-1855156353 None] Lock "cinder-quobyte-b6b6996a-e690-4c1d-8b8f-bab20cc56dff" acquired by "delete_volume" :: waited 0.013s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:40:45 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7bd7491-ce38-44e7-98dd-e93d6fd140e3]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:40:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-dd71a85c-c508-4635-8ba4-8876cd8e1581 tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b6b6996a-e690-4c1d-8b8f-bab20cc56dff {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:45 devstack sudo[107671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b6b6996a-e690-4c1d-8b8f-bab20cc56dff Sep 15 16:40:45 devstack sudo[107671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:45 devstack sudo[107669]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c42fca2d-fb6b-48db-8679-59e173a19e99 tempest-ProjectReaderTests-714592672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-da49e180-bdd5-4e11-ab2f-8e4e780a531b 1073741824" returned: 0 in 0.464s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c42fca2d-fb6b-48db-8679-59e173a19e99 tempest-ProjectReaderTests-714592672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-da49e180-bdd5-4e11-ab2f-8e4e780a531b {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:45 devstack sudo[107671]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-dd71a85c-c508-4635-8ba4-8876cd8e1581 tempest-ProjectMemberTests-1855156353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b6b6996a-e690-4c1d-8b8f-bab20cc56dff" returned: 0 in 0.384s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-dd71a85c-c508-4635-8ba4-8876cd8e1581 tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b6b6996a-e690-4c1d-8b8f-bab20cc56dff {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:45 devstack sudo[107679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-da49e180-bdd5-4e11-ab2f-8e4e780a531b Sep 15 16:40:45 devstack sudo[107679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:45 devstack sudo[107680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b6b6996a-e690-4c1d-8b8f-bab20cc56dff Sep 15 16:40:45 devstack sudo[107680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:45 devstack sudo[107679]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c42fca2d-fb6b-48db-8679-59e173a19e99 tempest-ProjectReaderTests-714592672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-da49e180-bdd5-4e11-ab2f-8e4e780a531b" returned: 0 in 0.263s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:45 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c42fca2d-fb6b-48db-8679-59e173a19e99 tempest-ProjectReaderTests-714592672 None] <== create_volume: return (775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:40:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c42fca2d-fb6b-48db-8679-59e173a19e99 tempest-ProjectReaderTests-714592672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.778s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:40:45 devstack sudo[107680]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:45 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c42fca2d-fb6b-48db-8679-59e173a19e99 tempest-ProjectReaderTests-714592672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ecb9442-3e08-480a-adf2-8b2e3d91c6dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da49e180-bdd5-4e11-ab2f-8e4e780a531b', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:40:45 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c42fca2d-fb6b-48db-8679-59e173a19e99 tempest-ProjectReaderTests-714592672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbd632a5-4147-4434-85a8-5e8cf4e8ba66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:40:45 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-dd71a85c-c508-4635-8ba4-8876cd8e1581 tempest-ProjectMemberTests-1855156353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-b6b6996a-e690-4c1d-8b8f-bab20cc56dff" returned: 0 in 0.273s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:45 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-c42fca2d-fb6b-48db-8679-59e173a19e99 tempest-ProjectReaderTests-714592672 None] Volume volume-da49e180-bdd5-4e11-ab2f-8e4e780a531b (da49e180-bdd5-4e11-ab2f-8e4e780a531b): created successfully Sep 15 16:40:45 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c42fca2d-fb6b-48db-8679-59e173a19e99 tempest-ProjectReaderTests-714592672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbd632a5-4147-4434-85a8-5e8cf4e8ba66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:40:45 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c42fca2d-fb6b-48db-8679-59e173a19e99 tempest-ProjectReaderTests-714592672 None] Flow 'volume_create_manager' (70630c72-a370-4850-890f-f17cc5d96635) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:40:45 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-dd71a85c-c508-4635-8ba4-8876cd8e1581 tempest-ProjectMemberTests-1855156353 None] Lock "cinder-quobyte-b6b6996a-e690-4c1d-8b8f-bab20cc56dff" released by "delete_volume" :: held 0.747s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:40:45 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-c42fca2d-fb6b-48db-8679-59e173a19e99 tempest-ProjectReaderTests-714592672 None] Created volume successfully. Sep 15 16:40:45 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-dd71a85c-c508-4635-8ba4-8876cd8e1581 tempest-ProjectMemberTests-1855156353 None] Created reservations ['794ade08-e4b9-4dd4-bde1-851cd37f2c26', 'f486cff3-576e-4ca2-a32c-db874cc14ccf', '89ad91b8-aa91-4bd0-861d-dfa16cc991af', '4c957991-0075-4532-944b-0f55229ffb23'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:40:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-dd71a85c-c508-4635-8ba4-8876cd8e1581 tempest-ProjectMemberTests-1855156353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:40:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-dd71a85c-c508-4635-8ba4-8876cd8e1581 tempest-ProjectMemberTests-1855156353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:40:46 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-dd71a85c-c508-4635-8ba4-8876cd8e1581 tempest-ProjectMemberTests-1855156353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:40:46 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-dd71a85c-c508-4635-8ba4-8876cd8e1581 tempest-ProjectMemberTests-1855156353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:40:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-dd71a85c-c508-4635-8ba4-8876cd8e1581 tempest-ProjectMemberTests-1855156353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:40:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-dd71a85c-c508-4635-8ba4-8876cd8e1581 tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:46 devstack sudo[107685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:40:46 devstack sudo[107685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:46 devstack sudo[107685]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-dd71a85c-c508-4635-8ba4-8876cd8e1581 tempest-ProjectMemberTests-1855156353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.257s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:46 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-dd71a85c-c508-4635-8ba4-8876cd8e1581 tempest-ProjectMemberTests-1855156353 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:40:46 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-dd71a85c-c508-4635-8ba4-8876cd8e1581 tempest-ProjectMemberTests-1855156353 None] Deleted volume successfully. Sep 15 16:40:46 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-dd71a85c-c508-4635-8ba4-8876cd8e1581 tempest-ProjectMemberTests-1855156353 None] Lock "cinder-b6b6996a-e690-4c1d-8b8f-bab20cc56dff-delete_volume" released by "delete_volume" :: held 1.200s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:40:46 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7219e79-d319-45d0-84de-e3b46978ab14 tempest-ProjectMemberTests-1855156353 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:40:46 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c7219e79-d319-45d0-84de-e3b46978ab14 tempest-ProjectMemberTests-1855156353 None] Flow 'volume_create_manager' (960b17c4-e93b-40cc-a755-113384d9edc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:40:46 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c7219e79-d319-45d0-84de-e3b46978ab14 tempest-ProjectMemberTests-1855156353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ddf883f-26ea-4a4b-9221-92a9a17d965c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:40:46 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c7219e79-d319-45d0-84de-e3b46978ab14 tempest-ProjectMemberTests-1855156353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ddf883f-26ea-4a4b-9221-92a9a17d965c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:40:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1015103518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d4d3613-3cd0-427f-ba22-bc24c17edbd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a303ec1076004f4db43523c2f7b6a446',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:40:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:40:47Z,use_quota=True,user_id='d9953555b80c481b9eaabbc7d416d0b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:40:46 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c7219e79-d319-45d0-84de-e3b46978ab14 tempest-ProjectMemberTests-1855156353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03552820-96f3-4f4e-b87c-d135b91c3980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:40:46 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c7219e79-d319-45d0-84de-e3b46978ab14 tempest-ProjectMemberTests-1855156353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03552820-96f3-4f4e-b87c-d135b91c3980) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:40:46 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c7219e79-d319-45d0-84de-e3b46978ab14 tempest-ProjectMemberTests-1855156353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbac9ddf-5a40-4a6f-ad98-fd83d27920f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:40:46 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c7219e79-d319-45d0-84de-e3b46978ab14 tempest-ProjectMemberTests-1855156353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbac9ddf-5a40-4a6f-ad98-fd83d27920f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d4d3613-3cd0-427f-ba22-bc24c17edbd5', 'volume_name': 'volume-3d4d3613-3cd0-427f-ba22-bc24c17edbd5', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:40:46 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c7219e79-d319-45d0-84de-e3b46978ab14 tempest-ProjectMemberTests-1855156353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8eb238b-339d-4b02-b575-ab45694cd2ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:40:46 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c7219e79-d319-45d0-84de-e3b46978ab14 tempest-ProjectMemberTests-1855156353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d8eb238b-339d-4b02-b575-ab45694cd2ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:40:46 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c7219e79-d319-45d0-84de-e3b46978ab14 tempest-ProjectMemberTests-1855156353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (092ff581-8078-46ce-b5ae-df3072ba2da3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:40:46 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-c7219e79-d319-45d0-84de-e3b46978ab14 tempest-ProjectMemberTests-1855156353 None] Volume 3d4d3613-3cd0-427f-ba22-bc24c17edbd5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d4d3613-3cd0-427f-ba22-bc24c17edbd5', 'volume_size': 1} Sep 15 16:40:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c7219e79-d319-45d0-84de-e3b46978ab14 tempest-ProjectMemberTests-1855156353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:40:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c7219e79-d319-45d0-84de-e3b46978ab14 tempest-ProjectMemberTests-1855156353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:40:46 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c7219e79-d319-45d0-84de-e3b46978ab14 tempest-ProjectMemberTests-1855156353 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:40:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1015103518',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d4d3613-3cd0-427f-ba22-bc24c17edbd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a303ec1076004f4db43523c2f7b6a446',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:40:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:40:47Z,use_quota=True,user_id='d9953555b80c481b9eaabbc7d416d0b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:40:46 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-c7219e79-d319-45d0-84de-e3b46978ab14 tempest-ProjectMemberTests-1855156353 None] Creating volume 3d4d3613-3cd0-427f-ba22-bc24c17edbd5 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:40:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c7219e79-d319-45d0-84de-e3b46978ab14 tempest-ProjectMemberTests-1855156353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:40:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c7219e79-d319-45d0-84de-e3b46978ab14 tempest-ProjectMemberTests-1855156353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:40:46 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c7219e79-d319-45d0-84de-e3b46978ab14 tempest-ProjectMemberTests-1855156353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:40:46 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c7219e79-d319-45d0-84de-e3b46978ab14 tempest-ProjectMemberTests-1855156353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:40:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c7219e79-d319-45d0-84de-e3b46978ab14 tempest-ProjectMemberTests-1855156353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:40:46 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c7219e79-d319-45d0-84de-e3b46978ab14 tempest-ProjectMemberTests-1855156353 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:40:46 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-c7219e79-d319-45d0-84de-e3b46978ab14 tempest-ProjectMemberTests-1855156353 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:40:46 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c7219e79-d319-45d0-84de-e3b46978ab14 tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-3d4d3613-3cd0-427f-ba22-bc24c17edbd5 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:46 devstack sudo[107688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-3d4d3613-3cd0-427f-ba22-bc24c17edbd5 1073741824 Sep 15 16:40:46 devstack sudo[107688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-eeca21a0-c992-4482-a1d3-a75e940dfc87 tempest-ProjectReaderTests-714592672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:40:47 devstack sudo[107688]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c7219e79-d319-45d0-84de-e3b46978ab14 tempest-ProjectMemberTests-1855156353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-3d4d3613-3cd0-427f-ba22-bc24c17edbd5 1073741824" returned: 0 in 0.461s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c7219e79-d319-45d0-84de-e3b46978ab14 tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-3d4d3613-3cd0-427f-ba22-bc24c17edbd5 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:47 devstack sudo[107695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-3d4d3613-3cd0-427f-ba22-bc24c17edbd5 Sep 15 16:40:47 devstack sudo[107695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:47 devstack sudo[107695]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c7219e79-d319-45d0-84de-e3b46978ab14 tempest-ProjectMemberTests-1855156353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-3d4d3613-3cd0-427f-ba22-bc24c17edbd5" returned: 0 in 0.246s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:47 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c7219e79-d319-45d0-84de-e3b46978ab14 tempest-ProjectMemberTests-1855156353 None] <== create_volume: return (750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:40:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c7219e79-d319-45d0-84de-e3b46978ab14 tempest-ProjectMemberTests-1855156353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.752s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:40:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-eeca21a0-c992-4482-a1d3-a75e940dfc87 tempest-ProjectReaderTests-714592672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.286s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:40:47 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c7219e79-d319-45d0-84de-e3b46978ab14 tempest-ProjectMemberTests-1855156353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (092ff581-8078-46ce-b5ae-df3072ba2da3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d4d3613-3cd0-427f-ba22-bc24c17edbd5', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:40:47 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c7219e79-d319-45d0-84de-e3b46978ab14 tempest-ProjectMemberTests-1855156353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e06980e1-2571-438c-80f9-f725142d5326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:40:47 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-eeca21a0-c992-4482-a1d3-a75e940dfc87 tempest-ProjectReaderTests-714592672 None] Creating offline snapshot 4d12612e-d85b-4d5a-b894-1530c965ef00 of volume da49e180-bdd5-4e11-ab2f-8e4e780a531b {{(pid=86082) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 15 16:40:47 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-c7219e79-d319-45d0-84de-e3b46978ab14 tempest-ProjectMemberTests-1855156353 None] Volume volume-3d4d3613-3cd0-427f-ba22-bc24c17edbd5 (3d4d3613-3cd0-427f-ba22-bc24c17edbd5): created successfully Sep 15 16:40:47 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c7219e79-d319-45d0-84de-e3b46978ab14 tempest-ProjectMemberTests-1855156353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e06980e1-2571-438c-80f9-f725142d5326) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:40:47 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c7219e79-d319-45d0-84de-e3b46978ab14 tempest-ProjectMemberTests-1855156353 None] Flow 'volume_create_manager' (960b17c4-e93b-40cc-a755-113384d9edc5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:40:47 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[66456767-5cf6-48e8-9a35-d318d42c5d8e]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:40:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-eeca21a0-c992-4482-a1d3-a75e940dfc87 tempest-ProjectReaderTests-714592672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-da49e180-bdd5-4e11-ab2f-8e4e780a531b {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:47 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-c7219e79-d319-45d0-84de-e3b46978ab14 tempest-ProjectMemberTests-1855156353 None] Created volume successfully. Sep 15 16:40:47 devstack sudo[107698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-da49e180-bdd5-4e11-ab2f-8e4e780a531b Sep 15 16:40:47 devstack sudo[107698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-5ec8ba71-402e-47f3-9b34-0fe45a0fb456 tempest-ProjectMemberTests-1855156353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:40:47 devstack sudo[107698]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-eeca21a0-c992-4482-a1d3-a75e940dfc87 tempest-ProjectReaderTests-714592672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-da49e180-bdd5-4e11-ab2f-8e4e780a531b" returned: 0 in 0.385s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:47 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-eeca21a0-c992-4482-a1d3-a75e940dfc87 tempest-ProjectReaderTests-714592672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-da49e180-bdd5-4e11-ab2f-8e4e780a531b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-da49e180-bdd5-4e11-ab2f-8e4e780a531b.4d12612e-d85b-4d5a-b894-1530c965ef00 1G {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:48 devstack sudo[107703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-da49e180-bdd5-4e11-ab2f-8e4e780a531b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-da49e180-bdd5-4e11-ab2f-8e4e780a531b.4d12612e-d85b-4d5a-b894-1530c965ef00 1G Sep 15 16:40:48 devstack sudo[107703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:48 devstack sudo[107703]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-eeca21a0-c992-4482-a1d3-a75e940dfc87 tempest-ProjectReaderTests-714592672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-da49e180-bdd5-4e11-ab2f-8e4e780a531b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-da49e180-bdd5-4e11-ab2f-8e4e780a531b.4d12612e-d85b-4d5a-b894-1530c965ef00 1G" returned: 0 in 0.397s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-eeca21a0-c992-4482-a1d3-a75e940dfc87 tempest-ProjectReaderTests-714592672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da49e180-bdd5-4e11-ab2f-8e4e780a531b -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-da49e180-bdd5-4e11-ab2f-8e4e780a531b.4d12612e-d85b-4d5a-b894-1530c965ef00 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:48 devstack sudo[107709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da49e180-bdd5-4e11-ab2f-8e4e780a531b -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-da49e180-bdd5-4e11-ab2f-8e4e780a531b.4d12612e-d85b-4d5a-b894-1530c965ef00 Sep 15 16:40:48 devstack sudo[107709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:48 devstack sudo[107709]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-eeca21a0-c992-4482-a1d3-a75e940dfc87 tempest-ProjectReaderTests-714592672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da49e180-bdd5-4e11-ab2f-8e4e780a531b -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-da49e180-bdd5-4e11-ab2f-8e4e780a531b.4d12612e-d85b-4d5a-b894-1530c965ef00" returned: 0 in 0.281s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:48 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-eeca21a0-c992-4482-a1d3-a75e940dfc87 tempest-ProjectReaderTests-714592672 None] /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-da49e180-bdd5-4e11-ab2f-8e4e780a531b.4d12612e-d85b-4d5a-b894-1530c965ef00 is being set with open permissions: ugo+rw Sep 15 16:40:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-eeca21a0-c992-4482-a1d3-a75e940dfc87 tempest-ProjectReaderTests-714592672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-da49e180-bdd5-4e11-ab2f-8e4e780a531b.4d12612e-d85b-4d5a-b894-1530c965ef00 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:48 devstack sudo[107714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-da49e180-bdd5-4e11-ab2f-8e4e780a531b.4d12612e-d85b-4d5a-b894-1530c965ef00 Sep 15 16:40:48 devstack sudo[107714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:48 devstack sudo[107714]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-eeca21a0-c992-4482-a1d3-a75e940dfc87 tempest-ProjectReaderTests-714592672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-da49e180-bdd5-4e11-ab2f-8e4e780a531b.4d12612e-d85b-4d5a-b894-1530c965ef00" returned: 0 in 0.253s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:48 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-eeca21a0-c992-4482-a1d3-a75e940dfc87 tempest-ProjectReaderTests-714592672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-da49e180-bdd5-4e11-ab2f-8e4e780a531b.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:48 devstack sudo[107717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-da49e180-bdd5-4e11-ab2f-8e4e780a531b.info Sep 15 16:40:48 devstack sudo[107717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:49 devstack sudo[107717]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-eeca21a0-c992-4482-a1d3-a75e940dfc87 tempest-ProjectReaderTests-714592672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-da49e180-bdd5-4e11-ab2f-8e4e780a531b.info" returned: 0 in 0.247s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:49 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-eeca21a0-c992-4482-a1d3-a75e940dfc87 tempest-ProjectReaderTests-714592672 None] /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-da49e180-bdd5-4e11-ab2f-8e4e780a531b.info is being set with open permissions: ugo+rw Sep 15 16:40:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-eeca21a0-c992-4482-a1d3-a75e940dfc87 tempest-ProjectReaderTests-714592672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-da49e180-bdd5-4e11-ab2f-8e4e780a531b.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:49 devstack sudo[107720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-da49e180-bdd5-4e11-ab2f-8e4e780a531b.info Sep 15 16:40:49 devstack sudo[107720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:49 devstack sudo[107720]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-eeca21a0-c992-4482-a1d3-a75e940dfc87 tempest-ProjectReaderTests-714592672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-da49e180-bdd5-4e11-ab2f-8e4e780a531b.info" returned: 0 in 0.247s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-eeca21a0-c992-4482-a1d3-a75e940dfc87 tempest-ProjectReaderTests-714592672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.921s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:40:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-5ec8ba71-402e-47f3-9b34-0fe45a0fb456 tempest-ProjectMemberTests-1855156353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.584s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:40:49 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-5ec8ba71-402e-47f3-9b34-0fe45a0fb456 tempest-ProjectMemberTests-1855156353 None] Creating offline snapshot 8fee097c-2c9b-4655-b5de-63cd800ab8f4 of volume 3d4d3613-3cd0-427f-ba22-bc24c17edbd5 {{(pid=86082) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 15 16:40:49 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-eeca21a0-c992-4482-a1d3-a75e940dfc87 tempest-ProjectReaderTests-714592672 None] Create snapshot completed successfully Sep 15 16:40:49 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e8cfd07-6f7a-4fe3-b50c-c91dbf4875c1]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:40:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5ec8ba71-402e-47f3-9b34-0fe45a0fb456 tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-3d4d3613-3cd0-427f-ba22-bc24c17edbd5 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:49 devstack sudo[107723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-3d4d3613-3cd0-427f-ba22-bc24c17edbd5 Sep 15 16:40:49 devstack sudo[107723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:49 devstack sudo[107723]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5ec8ba71-402e-47f3-9b34-0fe45a0fb456 tempest-ProjectMemberTests-1855156353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-3d4d3613-3cd0-427f-ba22-bc24c17edbd5" returned: 0 in 0.365s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:49 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5ec8ba71-402e-47f3-9b34-0fe45a0fb456 tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-3d4d3613-3cd0-427f-ba22-bc24c17edbd5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-3d4d3613-3cd0-427f-ba22-bc24c17edbd5.8fee097c-2c9b-4655-b5de-63cd800ab8f4 1G {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:49 devstack sudo[107728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-3d4d3613-3cd0-427f-ba22-bc24c17edbd5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-3d4d3613-3cd0-427f-ba22-bc24c17edbd5.8fee097c-2c9b-4655-b5de-63cd800ab8f4 1G Sep 15 16:40:49 devstack sudo[107728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:50 devstack sudo[107728]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5ec8ba71-402e-47f3-9b34-0fe45a0fb456 tempest-ProjectMemberTests-1855156353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-3d4d3613-3cd0-427f-ba22-bc24c17edbd5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-3d4d3613-3cd0-427f-ba22-bc24c17edbd5.8fee097c-2c9b-4655-b5de-63cd800ab8f4 1G" returned: 0 in 0.387s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5ec8ba71-402e-47f3-9b34-0fe45a0fb456 tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d4d3613-3cd0-427f-ba22-bc24c17edbd5 -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-3d4d3613-3cd0-427f-ba22-bc24c17edbd5.8fee097c-2c9b-4655-b5de-63cd800ab8f4 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:50 devstack sudo[107733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d4d3613-3cd0-427f-ba22-bc24c17edbd5 -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-3d4d3613-3cd0-427f-ba22-bc24c17edbd5.8fee097c-2c9b-4655-b5de-63cd800ab8f4 Sep 15 16:40:50 devstack sudo[107733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:50 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-5013d111-807a-4cb3-bb48-04a753d6ffd6 tempest-ProjectReaderTests-714592672 None] Acquiring lock "cinder-4d12612e-d85b-4d5a-b894-1530c965ef00-delete_snapshot" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:40:50 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-5013d111-807a-4cb3-bb48-04a753d6ffd6 tempest-ProjectReaderTests-714592672 None] Lock "cinder-4d12612e-d85b-4d5a-b894-1530c965ef00-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:40:50 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-5013d111-807a-4cb3-bb48-04a753d6ffd6 tempest-ProjectReaderTests-714592672 None] Acquiring lock "cinder-quobyte-da49e180-bdd5-4e11-ab2f-8e4e780a531b" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:40:50 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-5013d111-807a-4cb3-bb48-04a753d6ffd6 tempest-ProjectReaderTests-714592672 None] Lock "cinder-quobyte-da49e180-bdd5-4e11-ab2f-8e4e780a531b" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:40:50 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-5013d111-807a-4cb3-bb48-04a753d6ffd6 tempest-ProjectReaderTests-714592672 None] Acquiring lock "cinder-quobyte-4d12612e-d85b-4d5a-b894-1530c965ef00" by "_delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:40:50 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-5013d111-807a-4cb3-bb48-04a753d6ffd6 tempest-ProjectReaderTests-714592672 None] Lock "cinder-quobyte-4d12612e-d85b-4d5a-b894-1530c965ef00" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:40:50 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-5013d111-807a-4cb3-bb48-04a753d6ffd6 tempest-ProjectReaderTests-714592672 None] Deleting offline snapshot 4d12612e-d85b-4d5a-b894-1530c965ef00 of volume da49e180-bdd5-4e11-ab2f-8e4e780a531b {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 15 16:40:50 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-5013d111-807a-4cb3-bb48-04a753d6ffd6 tempest-ProjectReaderTests-714592672 None] snapshot_file for this snap is: volume-da49e180-bdd5-4e11-ab2f-8e4e780a531b.4d12612e-d85b-4d5a-b894-1530c965ef00 {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 15 16:40:50 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[1273ef81-fcc5-4c6f-957c-a02248b9db74]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:40:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5013d111-807a-4cb3-bb48-04a753d6ffd6 tempest-ProjectReaderTests-714592672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-da49e180-bdd5-4e11-ab2f-8e4e780a531b.4d12612e-d85b-4d5a-b894-1530c965ef00 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:50 devstack sudo[107733]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5ec8ba71-402e-47f3-9b34-0fe45a0fb456 tempest-ProjectMemberTests-1855156353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3d4d3613-3cd0-427f-ba22-bc24c17edbd5 -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-3d4d3613-3cd0-427f-ba22-bc24c17edbd5.8fee097c-2c9b-4655-b5de-63cd800ab8f4" returned: 0 in 0.311s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:50 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-5ec8ba71-402e-47f3-9b34-0fe45a0fb456 tempest-ProjectMemberTests-1855156353 None] /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-3d4d3613-3cd0-427f-ba22-bc24c17edbd5.8fee097c-2c9b-4655-b5de-63cd800ab8f4 is being set with open permissions: ugo+rw Sep 15 16:40:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5ec8ba71-402e-47f3-9b34-0fe45a0fb456 tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-3d4d3613-3cd0-427f-ba22-bc24c17edbd5.8fee097c-2c9b-4655-b5de-63cd800ab8f4 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:50 devstack sudo[107737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-da49e180-bdd5-4e11-ab2f-8e4e780a531b.4d12612e-d85b-4d5a-b894-1530c965ef00 Sep 15 16:40:50 devstack sudo[107737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:50 devstack sudo[107739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-3d4d3613-3cd0-427f-ba22-bc24c17edbd5.8fee097c-2c9b-4655-b5de-63cd800ab8f4 Sep 15 16:40:50 devstack sudo[107739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:50 devstack sudo[107739]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5ec8ba71-402e-47f3-9b34-0fe45a0fb456 tempest-ProjectMemberTests-1855156353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-3d4d3613-3cd0-427f-ba22-bc24c17edbd5.8fee097c-2c9b-4655-b5de-63cd800ab8f4" returned: 0 in 0.253s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5ec8ba71-402e-47f3-9b34-0fe45a0fb456 tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-3d4d3613-3cd0-427f-ba22-bc24c17edbd5.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:50 devstack sudo[107737]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5013d111-807a-4cb3-bb48-04a753d6ffd6 tempest-ProjectReaderTests-714592672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-da49e180-bdd5-4e11-ab2f-8e4e780a531b.4d12612e-d85b-4d5a-b894-1530c965ef00" returned: 0 in 0.394s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:50 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-5013d111-807a-4cb3-bb48-04a753d6ffd6 tempest-ProjectReaderTests-714592672 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-da49e180-bdd5-4e11-ab2f-8e4e780a531b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 16:40:50 devstack sudo[107746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-3d4d3613-3cd0-427f-ba22-bc24c17edbd5.info Sep 15 16:40:50 devstack sudo[107746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:50 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bd7ef08-fcf3-4db2-a7c0-5fa148b2f90c]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:40:50 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5013d111-807a-4cb3-bb48-04a753d6ffd6 tempest-ProjectReaderTests-714592672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-da49e180-bdd5-4e11-ab2f-8e4e780a531b {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:51 devstack sudo[107748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-da49e180-bdd5-4e11-ab2f-8e4e780a531b Sep 15 16:40:51 devstack sudo[107748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:51 devstack sudo[107746]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5ec8ba71-402e-47f3-9b34-0fe45a0fb456 tempest-ProjectMemberTests-1855156353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-3d4d3613-3cd0-427f-ba22-bc24c17edbd5.info" returned: 0 in 0.261s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:51 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-5ec8ba71-402e-47f3-9b34-0fe45a0fb456 tempest-ProjectMemberTests-1855156353 None] /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-3d4d3613-3cd0-427f-ba22-bc24c17edbd5.info is being set with open permissions: ugo+rw Sep 15 16:40:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5ec8ba71-402e-47f3-9b34-0fe45a0fb456 tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-3d4d3613-3cd0-427f-ba22-bc24c17edbd5.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:51 devstack sudo[107751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-3d4d3613-3cd0-427f-ba22-bc24c17edbd5.info Sep 15 16:40:51 devstack sudo[107751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:51 devstack sudo[107748]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5013d111-807a-4cb3-bb48-04a753d6ffd6 tempest-ProjectReaderTests-714592672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-da49e180-bdd5-4e11-ab2f-8e4e780a531b" returned: 0 in 0.393s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5013d111-807a-4cb3-bb48-04a753d6ffd6 tempest-ProjectReaderTests-714592672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-da49e180-bdd5-4e11-ab2f-8e4e780a531b.4d12612e-d85b-4d5a-b894-1530c965ef00 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:51 devstack sudo[107756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-da49e180-bdd5-4e11-ab2f-8e4e780a531b.4d12612e-d85b-4d5a-b894-1530c965ef00 Sep 15 16:40:51 devstack sudo[107756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:51 devstack sudo[107751]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5ec8ba71-402e-47f3-9b34-0fe45a0fb456 tempest-ProjectMemberTests-1855156353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-3d4d3613-3cd0-427f-ba22-bc24c17edbd5.info" returned: 0 in 0.252s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-5ec8ba71-402e-47f3-9b34-0fe45a0fb456 tempest-ProjectMemberTests-1855156353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.968s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:40:51 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-5ec8ba71-402e-47f3-9b34-0fe45a0fb456 tempest-ProjectMemberTests-1855156353 None] Create snapshot completed successfully Sep 15 16:40:51 devstack sudo[107756]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5013d111-807a-4cb3-bb48-04a753d6ffd6 tempest-ProjectReaderTests-714592672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-da49e180-bdd5-4e11-ab2f-8e4e780a531b.4d12612e-d85b-4d5a-b894-1530c965ef00" returned: 0 in 0.334s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5013d111-807a-4cb3-bb48-04a753d6ffd6 tempest-ProjectReaderTests-714592672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-da49e180-bdd5-4e11-ab2f-8e4e780a531b.4d12612e-d85b-4d5a-b894-1530c965ef00 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:51 devstack sudo[107762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-da49e180-bdd5-4e11-ab2f-8e4e780a531b.4d12612e-d85b-4d5a-b894-1530c965ef00 Sep 15 16:40:51 devstack sudo[107762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:51 devstack sudo[107762]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:51 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5013d111-807a-4cb3-bb48-04a753d6ffd6 tempest-ProjectReaderTests-714592672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-da49e180-bdd5-4e11-ab2f-8e4e780a531b.4d12612e-d85b-4d5a-b894-1530c965ef00" returned: 0 in 0.268s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:51 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-5013d111-807a-4cb3-bb48-04a753d6ffd6 tempest-ProjectReaderTests-714592672 None] Lock "cinder-quobyte-4d12612e-d85b-4d5a-b894-1530c965ef00" released by "_delete_snapshot" :: held 1.528s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:40:52 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-5013d111-807a-4cb3-bb48-04a753d6ffd6 tempest-ProjectReaderTests-714592672 None] Lock "cinder-quobyte-da49e180-bdd5-4e11-ab2f-8e4e780a531b" released by "delete_snapshot" :: held 1.554s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:40:52 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-5013d111-807a-4cb3-bb48-04a753d6ffd6 tempest-ProjectReaderTests-714592672 None] Created reservations ['7d0f4e55-393d-459a-b1d4-daa6b396253e', '87b66b69-ed25-4482-b234-3241926d41dd', 'c3074a97-2aee-4c7c-9e56-eafbf0b43c91', '3d35040b-2db5-4ac7-b995-dbf370eb66d0'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:40:52 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-47d161df-7a83-4cb6-b055-9530eb73c005 tempest-ProjectMemberTests-1855156353 None] Acquiring lock "cinder-8fee097c-2c9b-4655-b5de-63cd800ab8f4-delete_snapshot" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:40:52 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-47d161df-7a83-4cb6-b055-9530eb73c005 tempest-ProjectMemberTests-1855156353 None] Lock "cinder-8fee097c-2c9b-4655-b5de-63cd800ab8f4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:40:52 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-47d161df-7a83-4cb6-b055-9530eb73c005 tempest-ProjectMemberTests-1855156353 None] Acquiring lock "cinder-quobyte-3d4d3613-3cd0-427f-ba22-bc24c17edbd5" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:40:52 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-47d161df-7a83-4cb6-b055-9530eb73c005 tempest-ProjectMemberTests-1855156353 None] Lock "cinder-quobyte-3d4d3613-3cd0-427f-ba22-bc24c17edbd5" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:40:52 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-47d161df-7a83-4cb6-b055-9530eb73c005 tempest-ProjectMemberTests-1855156353 None] Acquiring lock "cinder-quobyte-8fee097c-2c9b-4655-b5de-63cd800ab8f4" by "_delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:40:52 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-47d161df-7a83-4cb6-b055-9530eb73c005 tempest-ProjectMemberTests-1855156353 None] Lock "cinder-quobyte-8fee097c-2c9b-4655-b5de-63cd800ab8f4" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:40:52 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-47d161df-7a83-4cb6-b055-9530eb73c005 tempest-ProjectMemberTests-1855156353 None] Deleting offline snapshot 8fee097c-2c9b-4655-b5de-63cd800ab8f4 of volume 3d4d3613-3cd0-427f-ba22-bc24c17edbd5 {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 15 16:40:52 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-47d161df-7a83-4cb6-b055-9530eb73c005 tempest-ProjectMemberTests-1855156353 None] snapshot_file for this snap is: volume-3d4d3613-3cd0-427f-ba22-bc24c17edbd5.8fee097c-2c9b-4655-b5de-63cd800ab8f4 {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 15 16:40:52 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-5013d111-807a-4cb3-bb48-04a753d6ffd6 tempest-ProjectReaderTests-714592672 None] Delete snapshot completed successfully. Sep 15 16:40:52 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-5013d111-807a-4cb3-bb48-04a753d6ffd6 tempest-ProjectReaderTests-714592672 None] Lock "cinder-4d12612e-d85b-4d5a-b894-1530c965ef00-delete_snapshot" released by "delete_snapshot" :: held 1.794s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:40:52 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[0099d1e2-02bc-4490-99c3-2f8124920f54]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:40:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-47d161df-7a83-4cb6-b055-9530eb73c005 tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-3d4d3613-3cd0-427f-ba22-bc24c17edbd5.8fee097c-2c9b-4655-b5de-63cd800ab8f4 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:52 devstack sudo[107766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-3d4d3613-3cd0-427f-ba22-bc24c17edbd5.8fee097c-2c9b-4655-b5de-63cd800ab8f4 Sep 15 16:40:52 devstack sudo[107766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:52 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c7bafc9a-5f80-48e9-8f68-095c3b56e4c4 tempest-ProjectReaderTests-714592672 None] Acquiring lock "cinder-da49e180-bdd5-4e11-ab2f-8e4e780a531b-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:40:52 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c7bafc9a-5f80-48e9-8f68-095c3b56e4c4 tempest-ProjectReaderTests-714592672 None] Lock "cinder-da49e180-bdd5-4e11-ab2f-8e4e780a531b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:40:52 devstack sudo[107766]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-47d161df-7a83-4cb6-b055-9530eb73c005 tempest-ProjectMemberTests-1855156353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-3d4d3613-3cd0-427f-ba22-bc24c17edbd5.8fee097c-2c9b-4655-b5de-63cd800ab8f4" returned: 0 in 0.381s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:52 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-47d161df-7a83-4cb6-b055-9530eb73c005 tempest-ProjectMemberTests-1855156353 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3d4d3613-3cd0-427f-ba22-bc24c17edbd5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 16:40:52 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c7bafc9a-5f80-48e9-8f68-095c3b56e4c4 tempest-ProjectReaderTests-714592672 None] Acquiring lock "cinder-quobyte-da49e180-bdd5-4e11-ab2f-8e4e780a531b" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:40:52 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f7694c9-8c7d-48f7-a507-75f1468f2102]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:40:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-47d161df-7a83-4cb6-b055-9530eb73c005 tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-3d4d3613-3cd0-427f-ba22-bc24c17edbd5 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:52 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c7bafc9a-5f80-48e9-8f68-095c3b56e4c4 tempest-ProjectReaderTests-714592672 None] Lock "cinder-quobyte-da49e180-bdd5-4e11-ab2f-8e4e780a531b" acquired by "delete_volume" :: waited 0.030s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:40:52 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad7587df-08a3-41e9-bed7-e1d52f088df3]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:40:52 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c7bafc9a-5f80-48e9-8f68-095c3b56e4c4 tempest-ProjectReaderTests-714592672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-da49e180-bdd5-4e11-ab2f-8e4e780a531b {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:52 devstack sudo[107771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-3d4d3613-3cd0-427f-ba22-bc24c17edbd5 Sep 15 16:40:52 devstack sudo[107771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:52 devstack sudo[107772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-da49e180-bdd5-4e11-ab2f-8e4e780a531b Sep 15 16:40:52 devstack sudo[107772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:53 devstack sudo[107771]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-47d161df-7a83-4cb6-b055-9530eb73c005 tempest-ProjectMemberTests-1855156353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-3d4d3613-3cd0-427f-ba22-bc24c17edbd5" returned: 0 in 0.370s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-47d161df-7a83-4cb6-b055-9530eb73c005 tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-3d4d3613-3cd0-427f-ba22-bc24c17edbd5.8fee097c-2c9b-4655-b5de-63cd800ab8f4 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:53 devstack sudo[107780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-3d4d3613-3cd0-427f-ba22-bc24c17edbd5.8fee097c-2c9b-4655-b5de-63cd800ab8f4 Sep 15 16:40:53 devstack sudo[107780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:53 devstack sudo[107772]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c7bafc9a-5f80-48e9-8f68-095c3b56e4c4 tempest-ProjectReaderTests-714592672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-da49e180-bdd5-4e11-ab2f-8e4e780a531b" returned: 0 in 0.361s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c7bafc9a-5f80-48e9-8f68-095c3b56e4c4 tempest-ProjectReaderTests-714592672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-da49e180-bdd5-4e11-ab2f-8e4e780a531b {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:53 devstack sudo[107784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-da49e180-bdd5-4e11-ab2f-8e4e780a531b Sep 15 16:40:53 devstack sudo[107784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:53 devstack sudo[107784]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c7bafc9a-5f80-48e9-8f68-095c3b56e4c4 tempest-ProjectReaderTests-714592672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-da49e180-bdd5-4e11-ab2f-8e4e780a531b" returned: 0 in 0.277s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:53 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c7bafc9a-5f80-48e9-8f68-095c3b56e4c4 tempest-ProjectReaderTests-714592672 None] Lock "cinder-quobyte-da49e180-bdd5-4e11-ab2f-8e4e780a531b" released by "delete_volume" :: held 0.700s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:40:53 devstack sudo[107780]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-47d161df-7a83-4cb6-b055-9530eb73c005 tempest-ProjectMemberTests-1855156353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-3d4d3613-3cd0-427f-ba22-bc24c17edbd5.8fee097c-2c9b-4655-b5de-63cd800ab8f4" returned: 0 in 0.363s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-47d161df-7a83-4cb6-b055-9530eb73c005 tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-3d4d3613-3cd0-427f-ba22-bc24c17edbd5.8fee097c-2c9b-4655-b5de-63cd800ab8f4 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:53 devstack sudo[107790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-3d4d3613-3cd0-427f-ba22-bc24c17edbd5.8fee097c-2c9b-4655-b5de-63cd800ab8f4 Sep 15 16:40:53 devstack sudo[107790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:53 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-c7bafc9a-5f80-48e9-8f68-095c3b56e4c4 tempest-ProjectReaderTests-714592672 None] Created reservations ['77899cb5-83d6-462b-8e0e-82e0d371649e', '8e73df82-c56b-48b0-89da-d1ace6ccaf5c', '120ce50e-5928-4e1b-b954-85293bd09ebd', '88804da7-a6d1-49b4-9b4f-8c0d68e6d829'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:40:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c7bafc9a-5f80-48e9-8f68-095c3b56e4c4 tempest-ProjectReaderTests-714592672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:40:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c7bafc9a-5f80-48e9-8f68-095c3b56e4c4 tempest-ProjectReaderTests-714592672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:40:53 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c7bafc9a-5f80-48e9-8f68-095c3b56e4c4 tempest-ProjectReaderTests-714592672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:40:53 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c7bafc9a-5f80-48e9-8f68-095c3b56e4c4 tempest-ProjectReaderTests-714592672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:40:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c7bafc9a-5f80-48e9-8f68-095c3b56e4c4 tempest-ProjectReaderTests-714592672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:40:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c7bafc9a-5f80-48e9-8f68-095c3b56e4c4 tempest-ProjectReaderTests-714592672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:53 devstack sudo[107792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:40:53 devstack sudo[107792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:53 devstack sudo[107790]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-47d161df-7a83-4cb6-b055-9530eb73c005 tempest-ProjectMemberTests-1855156353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-3d4d3613-3cd0-427f-ba22-bc24c17edbd5.8fee097c-2c9b-4655-b5de-63cd800ab8f4" returned: 0 in 0.252s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:53 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-47d161df-7a83-4cb6-b055-9530eb73c005 tempest-ProjectMemberTests-1855156353 None] Lock "cinder-quobyte-8fee097c-2c9b-4655-b5de-63cd800ab8f4" released by "_delete_snapshot" :: held 1.498s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:40:53 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-47d161df-7a83-4cb6-b055-9530eb73c005 tempest-ProjectMemberTests-1855156353 None] Lock "cinder-quobyte-3d4d3613-3cd0-427f-ba22-bc24c17edbd5" released by "delete_snapshot" :: held 1.545s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:40:53 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-47d161df-7a83-4cb6-b055-9530eb73c005 tempest-ProjectMemberTests-1855156353 None] Created reservations ['e9290055-9e99-4fca-b1c2-2ecc8f67b101', '1161a33f-5420-4c16-b198-988777bce134', '74191036-c17d-45fc-a6d4-921720cb1f70', '3f60e0f1-fcc4-4d81-8f23-e6a87ced235a'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:40:53 devstack sudo[107792]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:53 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c7bafc9a-5f80-48e9-8f68-095c3b56e4c4 tempest-ProjectReaderTests-714592672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.331s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:53 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-c7bafc9a-5f80-48e9-8f68-095c3b56e4c4 tempest-ProjectReaderTests-714592672 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:40:53 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-c7bafc9a-5f80-48e9-8f68-095c3b56e4c4 tempest-ProjectReaderTests-714592672 None] Deleted volume successfully. Sep 15 16:40:53 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c7bafc9a-5f80-48e9-8f68-095c3b56e4c4 tempest-ProjectReaderTests-714592672 None] Lock "cinder-da49e180-bdd5-4e11-ab2f-8e4e780a531b-delete_volume" released by "delete_volume" :: held 1.290s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:40:53 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-47d161df-7a83-4cb6-b055-9530eb73c005 tempest-ProjectMemberTests-1855156353 None] Delete snapshot completed successfully. Sep 15 16:40:53 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-47d161df-7a83-4cb6-b055-9530eb73c005 tempest-ProjectMemberTests-1855156353 None] Lock "cinder-8fee097c-2c9b-4655-b5de-63cd800ab8f4-delete_snapshot" released by "delete_snapshot" :: held 1.755s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:40:54 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d18861c-3675-45c6-80de-0ee40a211c59 tempest-ProjectReaderTests-714592672 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:40:54 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0d18861c-3675-45c6-80de-0ee40a211c59 tempest-ProjectReaderTests-714592672 None] Flow 'volume_create_manager' (7e66f02a-3637-400a-96d2-6776bccbae31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:40:54 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0d18861c-3675-45c6-80de-0ee40a211c59 tempest-ProjectReaderTests-714592672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0a0f3c8-578d-480c-8431-8c06902e6cca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:40:54 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0d18861c-3675-45c6-80de-0ee40a211c59 tempest-ProjectReaderTests-714592672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0a0f3c8-578d-480c-8431-8c06902e6cca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:40:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1845225339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=188d8b18-2b5d-4ebc-b894-304bb26f06b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68cde7c8450e4480a0855eacf56861b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:40:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:40:54Z,use_quota=True,user_id='8d100ae259564a538c7bf3f0e0d830cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:40:54 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0d18861c-3675-45c6-80de-0ee40a211c59 tempest-ProjectReaderTests-714592672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40b71058-a98c-4987-bdc5-8e80771fc480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:40:54 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0d18861c-3675-45c6-80de-0ee40a211c59 tempest-ProjectReaderTests-714592672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40b71058-a98c-4987-bdc5-8e80771fc480) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:40:54 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0d18861c-3675-45c6-80de-0ee40a211c59 tempest-ProjectReaderTests-714592672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98d1e27e-bf6b-42e1-9d03-697204b4811d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:40:54 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0d18861c-3675-45c6-80de-0ee40a211c59 tempest-ProjectReaderTests-714592672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98d1e27e-bf6b-42e1-9d03-697204b4811d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '188d8b18-2b5d-4ebc-b894-304bb26f06b0', 'volume_name': 'volume-188d8b18-2b5d-4ebc-b894-304bb26f06b0', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:40:54 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0d18861c-3675-45c6-80de-0ee40a211c59 tempest-ProjectReaderTests-714592672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22bd9162-86b6-42b7-9155-8a46d94ed5ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:40:54 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0d18861c-3675-45c6-80de-0ee40a211c59 tempest-ProjectReaderTests-714592672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22bd9162-86b6-42b7-9155-8a46d94ed5ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:40:54 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0d18861c-3675-45c6-80de-0ee40a211c59 tempest-ProjectReaderTests-714592672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bc6f9f3-9320-457d-a988-db3ae79f2d21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:40:54 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-0d18861c-3675-45c6-80de-0ee40a211c59 tempest-ProjectReaderTests-714592672 None] Volume 188d8b18-2b5d-4ebc-b894-304bb26f06b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-188d8b18-2b5d-4ebc-b894-304bb26f06b0', 'volume_size': 1} Sep 15 16:40:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-0d18861c-3675-45c6-80de-0ee40a211c59 tempest-ProjectReaderTests-714592672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:40:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-0d18861c-3675-45c6-80de-0ee40a211c59 tempest-ProjectReaderTests-714592672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:40:54 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-0d18861c-3675-45c6-80de-0ee40a211c59 tempest-ProjectReaderTests-714592672 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:40:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1845225339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=188d8b18-2b5d-4ebc-b894-304bb26f06b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68cde7c8450e4480a0855eacf56861b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:40:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:40:54Z,use_quota=True,user_id='8d100ae259564a538c7bf3f0e0d830cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:40:54 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-0d18861c-3675-45c6-80de-0ee40a211c59 tempest-ProjectReaderTests-714592672 None] Creating volume 188d8b18-2b5d-4ebc-b894-304bb26f06b0 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:40:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-0d18861c-3675-45c6-80de-0ee40a211c59 tempest-ProjectReaderTests-714592672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:40:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-0d18861c-3675-45c6-80de-0ee40a211c59 tempest-ProjectReaderTests-714592672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:40:54 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-0d18861c-3675-45c6-80de-0ee40a211c59 tempest-ProjectReaderTests-714592672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:40:54 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-0d18861c-3675-45c6-80de-0ee40a211c59 tempest-ProjectReaderTests-714592672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:40:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-0d18861c-3675-45c6-80de-0ee40a211c59 tempest-ProjectReaderTests-714592672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:40:54 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-0d18861c-3675-45c6-80de-0ee40a211c59 tempest-ProjectReaderTests-714592672 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:40:54 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-0d18861c-3675-45c6-80de-0ee40a211c59 tempest-ProjectReaderTests-714592672 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:40:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0d18861c-3675-45c6-80de-0ee40a211c59 tempest-ProjectReaderTests-714592672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-188d8b18-2b5d-4ebc-b894-304bb26f06b0 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:54 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-4f8ece29-e0f8-4545-856d-c117ca1cac29 tempest-ProjectMemberTests-1855156353 None] Acquiring lock "cinder-3d4d3613-3cd0-427f-ba22-bc24c17edbd5-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:40:54 devstack sudo[107796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-188d8b18-2b5d-4ebc-b894-304bb26f06b0 1073741824 Sep 15 16:40:54 devstack sudo[107796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:54 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-4f8ece29-e0f8-4545-856d-c117ca1cac29 tempest-ProjectMemberTests-1855156353 None] Lock "cinder-3d4d3613-3cd0-427f-ba22-bc24c17edbd5-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:40:54 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-4f8ece29-e0f8-4545-856d-c117ca1cac29 tempest-ProjectMemberTests-1855156353 None] Acquiring lock "cinder-quobyte-3d4d3613-3cd0-427f-ba22-bc24c17edbd5" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:40:54 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-4f8ece29-e0f8-4545-856d-c117ca1cac29 tempest-ProjectMemberTests-1855156353 None] Lock "cinder-quobyte-3d4d3613-3cd0-427f-ba22-bc24c17edbd5" acquired by "delete_volume" :: waited 0.013s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:40:54 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[b07d7bbf-17f7-4ac8-b770-eeea6d6338bb]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:40:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4f8ece29-e0f8-4545-856d-c117ca1cac29 tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-3d4d3613-3cd0-427f-ba22-bc24c17edbd5 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:54 devstack sudo[107798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-3d4d3613-3cd0-427f-ba22-bc24c17edbd5 Sep 15 16:40:54 devstack sudo[107798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:54 devstack sudo[107796]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0d18861c-3675-45c6-80de-0ee40a211c59 tempest-ProjectReaderTests-714592672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-188d8b18-2b5d-4ebc-b894-304bb26f06b0 1073741824" returned: 0 in 0.442s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0d18861c-3675-45c6-80de-0ee40a211c59 tempest-ProjectReaderTests-714592672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-188d8b18-2b5d-4ebc-b894-304bb26f06b0 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:54 devstack sudo[107807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-188d8b18-2b5d-4ebc-b894-304bb26f06b0 Sep 15 16:40:54 devstack sudo[107807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:54 devstack sudo[107798]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4f8ece29-e0f8-4545-856d-c117ca1cac29 tempest-ProjectMemberTests-1855156353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-3d4d3613-3cd0-427f-ba22-bc24c17edbd5" returned: 0 in 0.402s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:54 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4f8ece29-e0f8-4545-856d-c117ca1cac29 tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-3d4d3613-3cd0-427f-ba22-bc24c17edbd5 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:54 devstack sudo[107809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-3d4d3613-3cd0-427f-ba22-bc24c17edbd5 Sep 15 16:40:54 devstack sudo[107809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:55 devstack sudo[107807]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0d18861c-3675-45c6-80de-0ee40a211c59 tempest-ProjectReaderTests-714592672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-188d8b18-2b5d-4ebc-b894-304bb26f06b0" returned: 0 in 0.275s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:55 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-0d18861c-3675-45c6-80de-0ee40a211c59 tempest-ProjectReaderTests-714592672 None] <== create_volume: return (763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:40:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-0d18861c-3675-45c6-80de-0ee40a211c59 tempest-ProjectReaderTests-714592672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.765s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:40:55 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0d18861c-3675-45c6-80de-0ee40a211c59 tempest-ProjectReaderTests-714592672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bc6f9f3-9320-457d-a988-db3ae79f2d21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-188d8b18-2b5d-4ebc-b894-304bb26f06b0', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:40:55 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0d18861c-3675-45c6-80de-0ee40a211c59 tempest-ProjectReaderTests-714592672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06993c85-0236-4a80-a2cf-d5f8a0878e67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:40:55 devstack sudo[107809]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4f8ece29-e0f8-4545-856d-c117ca1cac29 tempest-ProjectMemberTests-1855156353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-3d4d3613-3cd0-427f-ba22-bc24c17edbd5" returned: 0 in 0.257s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:55 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-0d18861c-3675-45c6-80de-0ee40a211c59 tempest-ProjectReaderTests-714592672 None] Volume volume-188d8b18-2b5d-4ebc-b894-304bb26f06b0 (188d8b18-2b5d-4ebc-b894-304bb26f06b0): created successfully Sep 15 16:40:55 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0d18861c-3675-45c6-80de-0ee40a211c59 tempest-ProjectReaderTests-714592672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06993c85-0236-4a80-a2cf-d5f8a0878e67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:40:55 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-0d18861c-3675-45c6-80de-0ee40a211c59 tempest-ProjectReaderTests-714592672 None] Flow 'volume_create_manager' (7e66f02a-3637-400a-96d2-6776bccbae31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:40:55 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-4f8ece29-e0f8-4545-856d-c117ca1cac29 tempest-ProjectMemberTests-1855156353 None] Lock "cinder-quobyte-3d4d3613-3cd0-427f-ba22-bc24c17edbd5" released by "delete_volume" :: held 0.741s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:40:55 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-0d18861c-3675-45c6-80de-0ee40a211c59 tempest-ProjectReaderTests-714592672 None] Created volume successfully. Sep 15 16:40:55 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-4f8ece29-e0f8-4545-856d-c117ca1cac29 tempest-ProjectMemberTests-1855156353 None] Created reservations ['7ee988db-d38f-4085-ae12-c6a634e345df', '432ae72b-b558-4e43-8ba6-0103a948dd4a', '9b581892-3c1d-4d5b-a10c-823beb9a90c9', 'd55df5d9-04fa-4bda-a230-89cfd42a5540'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:40:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-4f8ece29-e0f8-4545-856d-c117ca1cac29 tempest-ProjectMemberTests-1855156353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:40:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-4f8ece29-e0f8-4545-856d-c117ca1cac29 tempest-ProjectMemberTests-1855156353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:40:55 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-4f8ece29-e0f8-4545-856d-c117ca1cac29 tempest-ProjectMemberTests-1855156353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:40:55 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-4f8ece29-e0f8-4545-856d-c117ca1cac29 tempest-ProjectMemberTests-1855156353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:40:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-4f8ece29-e0f8-4545-856d-c117ca1cac29 tempest-ProjectMemberTests-1855156353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:40:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4f8ece29-e0f8-4545-856d-c117ca1cac29 tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:55 devstack sudo[107813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:40:55 devstack sudo[107813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f04abe01-20bf-4e46-8401-0d05b41c42ce tempest-ProjectReaderTests-714592672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:40:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f04abe01-20bf-4e46-8401-0d05b41c42ce tempest-ProjectReaderTests-714592672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:40:55 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-f04abe01-20bf-4e46-8401-0d05b41c42ce tempest-ProjectReaderTests-714592672 None] Creating offline snapshot 0ac6f8c4-c837-461d-8e2a-41bf17bbf941 of volume 188d8b18-2b5d-4ebc-b894-304bb26f06b0 {{(pid=86082) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 15 16:40:55 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[31bd0a03-864b-41d2-930f-7eada4d01fa2]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:40:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f04abe01-20bf-4e46-8401-0d05b41c42ce tempest-ProjectReaderTests-714592672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-188d8b18-2b5d-4ebc-b894-304bb26f06b0 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:55 devstack sudo[107813]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-4f8ece29-e0f8-4545-856d-c117ca1cac29 tempest-ProjectMemberTests-1855156353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.285s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:55 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-4f8ece29-e0f8-4545-856d-c117ca1cac29 tempest-ProjectMemberTests-1855156353 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:40:55 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-4f8ece29-e0f8-4545-856d-c117ca1cac29 tempest-ProjectMemberTests-1855156353 None] Deleted volume successfully. Sep 15 16:40:55 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-4f8ece29-e0f8-4545-856d-c117ca1cac29 tempest-ProjectMemberTests-1855156353 None] Lock "cinder-3d4d3613-3cd0-427f-ba22-bc24c17edbd5-delete_volume" released by "delete_volume" :: held 1.246s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:40:55 devstack sudo[107815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-188d8b18-2b5d-4ebc-b894-304bb26f06b0 Sep 15 16:40:55 devstack sudo[107815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:55 devstack sudo[107815]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f04abe01-20bf-4e46-8401-0d05b41c42ce tempest-ProjectReaderTests-714592672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-188d8b18-2b5d-4ebc-b894-304bb26f06b0" returned: 0 in 0.402s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:55 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f04abe01-20bf-4e46-8401-0d05b41c42ce tempest-ProjectReaderTests-714592672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-188d8b18-2b5d-4ebc-b894-304bb26f06b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-188d8b18-2b5d-4ebc-b894-304bb26f06b0.0ac6f8c4-c837-461d-8e2a-41bf17bbf941 1G {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:55 devstack sudo[107821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-188d8b18-2b5d-4ebc-b894-304bb26f06b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-188d8b18-2b5d-4ebc-b894-304bb26f06b0.0ac6f8c4-c837-461d-8e2a-41bf17bbf941 1G Sep 15 16:40:55 devstack sudo[107821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:55 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-21ec49b3-872b-4b7f-86dc-a383d8b5aa7b tempest-ProjectMemberTests-1855156353 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:40:55 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-21ec49b3-872b-4b7f-86dc-a383d8b5aa7b tempest-ProjectMemberTests-1855156353 None] Flow 'volume_create_manager' (1f573d83-faf6-495c-b9f0-c50dd405dd55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:40:55 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-21ec49b3-872b-4b7f-86dc-a383d8b5aa7b tempest-ProjectMemberTests-1855156353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3340c721-5ca8-4548-9435-612ad8acd99b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:40:55 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-21ec49b3-872b-4b7f-86dc-a383d8b5aa7b tempest-ProjectMemberTests-1855156353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3340c721-5ca8-4548-9435-612ad8acd99b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:40:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-935546937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ffabbbd-43d0-452b-8350-7761b1a101ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a303ec1076004f4db43523c2f7b6a446',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:40:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:40:56Z,use_quota=True,user_id='d9953555b80c481b9eaabbc7d416d0b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:40:55 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-21ec49b3-872b-4b7f-86dc-a383d8b5aa7b tempest-ProjectMemberTests-1855156353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dae1954e-25a2-42b6-9cef-f770d3ee45d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:40:55 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-21ec49b3-872b-4b7f-86dc-a383d8b5aa7b tempest-ProjectMemberTests-1855156353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dae1954e-25a2-42b6-9cef-f770d3ee45d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:40:55 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-21ec49b3-872b-4b7f-86dc-a383d8b5aa7b tempest-ProjectMemberTests-1855156353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e4d9bc9-5fd4-4cc5-8cf2-aff6f0ae6298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:40:56 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-21ec49b3-872b-4b7f-86dc-a383d8b5aa7b tempest-ProjectMemberTests-1855156353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e4d9bc9-5fd4-4cc5-8cf2-aff6f0ae6298) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ffabbbd-43d0-452b-8350-7761b1a101ae', 'volume_name': 'volume-2ffabbbd-43d0-452b-8350-7761b1a101ae', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:40:56 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-21ec49b3-872b-4b7f-86dc-a383d8b5aa7b tempest-ProjectMemberTests-1855156353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87516778-3033-4107-84d1-afa68aaaeee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:40:56 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-21ec49b3-872b-4b7f-86dc-a383d8b5aa7b tempest-ProjectMemberTests-1855156353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (87516778-3033-4107-84d1-afa68aaaeee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:40:56 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-21ec49b3-872b-4b7f-86dc-a383d8b5aa7b tempest-ProjectMemberTests-1855156353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33b3e052-8cef-4998-85cc-f1b4c8043147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:40:56 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-21ec49b3-872b-4b7f-86dc-a383d8b5aa7b tempest-ProjectMemberTests-1855156353 None] Volume 2ffabbbd-43d0-452b-8350-7761b1a101ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ffabbbd-43d0-452b-8350-7761b1a101ae', 'volume_size': 1} Sep 15 16:40:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-21ec49b3-872b-4b7f-86dc-a383d8b5aa7b tempest-ProjectMemberTests-1855156353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:40:56 devstack sudo[107821]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f04abe01-20bf-4e46-8401-0d05b41c42ce tempest-ProjectReaderTests-714592672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-188d8b18-2b5d-4ebc-b894-304bb26f06b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-188d8b18-2b5d-4ebc-b894-304bb26f06b0.0ac6f8c4-c837-461d-8e2a-41bf17bbf941 1G" returned: 0 in 0.393s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f04abe01-20bf-4e46-8401-0d05b41c42ce tempest-ProjectReaderTests-714592672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-188d8b18-2b5d-4ebc-b894-304bb26f06b0 -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-188d8b18-2b5d-4ebc-b894-304bb26f06b0.0ac6f8c4-c837-461d-8e2a-41bf17bbf941 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:56 devstack sudo[107826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-188d8b18-2b5d-4ebc-b894-304bb26f06b0 -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-188d8b18-2b5d-4ebc-b894-304bb26f06b0.0ac6f8c4-c837-461d-8e2a-41bf17bbf941 Sep 15 16:40:56 devstack sudo[107826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:56 devstack sudo[107826]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f04abe01-20bf-4e46-8401-0d05b41c42ce tempest-ProjectReaderTests-714592672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-188d8b18-2b5d-4ebc-b894-304bb26f06b0 -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-188d8b18-2b5d-4ebc-b894-304bb26f06b0.0ac6f8c4-c837-461d-8e2a-41bf17bbf941" returned: 0 in 0.290s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:56 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-f04abe01-20bf-4e46-8401-0d05b41c42ce tempest-ProjectReaderTests-714592672 None] /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-188d8b18-2b5d-4ebc-b894-304bb26f06b0.0ac6f8c4-c837-461d-8e2a-41bf17bbf941 is being set with open permissions: ugo+rw Sep 15 16:40:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f04abe01-20bf-4e46-8401-0d05b41c42ce tempest-ProjectReaderTests-714592672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-188d8b18-2b5d-4ebc-b894-304bb26f06b0.0ac6f8c4-c837-461d-8e2a-41bf17bbf941 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:56 devstack sudo[107831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-188d8b18-2b5d-4ebc-b894-304bb26f06b0.0ac6f8c4-c837-461d-8e2a-41bf17bbf941 Sep 15 16:40:56 devstack sudo[107831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:56 devstack sudo[107831]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f04abe01-20bf-4e46-8401-0d05b41c42ce tempest-ProjectReaderTests-714592672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-188d8b18-2b5d-4ebc-b894-304bb26f06b0.0ac6f8c4-c837-461d-8e2a-41bf17bbf941" returned: 0 in 0.246s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f04abe01-20bf-4e46-8401-0d05b41c42ce tempest-ProjectReaderTests-714592672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-188d8b18-2b5d-4ebc-b894-304bb26f06b0.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:56 devstack sudo[107834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-188d8b18-2b5d-4ebc-b894-304bb26f06b0.info Sep 15 16:40:56 devstack sudo[107834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:57 devstack sudo[107834]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f04abe01-20bf-4e46-8401-0d05b41c42ce tempest-ProjectReaderTests-714592672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-188d8b18-2b5d-4ebc-b894-304bb26f06b0.info" returned: 0 in 0.253s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:57 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-f04abe01-20bf-4e46-8401-0d05b41c42ce tempest-ProjectReaderTests-714592672 None] /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-188d8b18-2b5d-4ebc-b894-304bb26f06b0.info is being set with open permissions: ugo+rw Sep 15 16:40:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f04abe01-20bf-4e46-8401-0d05b41c42ce tempest-ProjectReaderTests-714592672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-188d8b18-2b5d-4ebc-b894-304bb26f06b0.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:57 devstack sudo[107837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-188d8b18-2b5d-4ebc-b894-304bb26f06b0.info Sep 15 16:40:57 devstack sudo[107837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:57 devstack sudo[107837]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f04abe01-20bf-4e46-8401-0d05b41c42ce tempest-ProjectReaderTests-714592672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-188d8b18-2b5d-4ebc-b894-304bb26f06b0.info" returned: 0 in 0.246s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f04abe01-20bf-4e46-8401-0d05b41c42ce tempest-ProjectReaderTests-714592672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.927s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:40:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-21ec49b3-872b-4b7f-86dc-a383d8b5aa7b tempest-ProjectMemberTests-1855156353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.357s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:40:57 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-21ec49b3-872b-4b7f-86dc-a383d8b5aa7b tempest-ProjectMemberTests-1855156353 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:40:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-935546937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ffabbbd-43d0-452b-8350-7761b1a101ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a303ec1076004f4db43523c2f7b6a446',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:40:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:40:56Z,use_quota=True,user_id='d9953555b80c481b9eaabbc7d416d0b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:40:57 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-21ec49b3-872b-4b7f-86dc-a383d8b5aa7b tempest-ProjectMemberTests-1855156353 None] Creating volume 2ffabbbd-43d0-452b-8350-7761b1a101ae {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:40:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-21ec49b3-872b-4b7f-86dc-a383d8b5aa7b tempest-ProjectMemberTests-1855156353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:40:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-21ec49b3-872b-4b7f-86dc-a383d8b5aa7b tempest-ProjectMemberTests-1855156353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:40:57 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-21ec49b3-872b-4b7f-86dc-a383d8b5aa7b tempest-ProjectMemberTests-1855156353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:40:57 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-21ec49b3-872b-4b7f-86dc-a383d8b5aa7b tempest-ProjectMemberTests-1855156353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:40:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-21ec49b3-872b-4b7f-86dc-a383d8b5aa7b tempest-ProjectMemberTests-1855156353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:40:57 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-21ec49b3-872b-4b7f-86dc-a383d8b5aa7b tempest-ProjectMemberTests-1855156353 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:40:57 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-21ec49b3-872b-4b7f-86dc-a383d8b5aa7b tempest-ProjectMemberTests-1855156353 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:40:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-21ec49b3-872b-4b7f-86dc-a383d8b5aa7b tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2ffabbbd-43d0-452b-8350-7761b1a101ae 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:57 devstack sudo[107841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2ffabbbd-43d0-452b-8350-7761b1a101ae 1073741824 Sep 15 16:40:57 devstack sudo[107841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:57 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-f04abe01-20bf-4e46-8401-0d05b41c42ce tempest-ProjectReaderTests-714592672 None] Create snapshot completed successfully Sep 15 16:40:57 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-8a21d92c-8ba2-4dd5-828a-88993c890e61 tempest-ProjectReaderTests-714592672 None] Acquiring lock "cinder-0ac6f8c4-c837-461d-8e2a-41bf17bbf941-delete_snapshot" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:40:57 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-8a21d92c-8ba2-4dd5-828a-88993c890e61 tempest-ProjectReaderTests-714592672 None] Lock "cinder-0ac6f8c4-c837-461d-8e2a-41bf17bbf941-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:40:57 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-8a21d92c-8ba2-4dd5-828a-88993c890e61 tempest-ProjectReaderTests-714592672 None] Acquiring lock "cinder-quobyte-188d8b18-2b5d-4ebc-b894-304bb26f06b0" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:40:57 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-8a21d92c-8ba2-4dd5-828a-88993c890e61 tempest-ProjectReaderTests-714592672 None] Lock "cinder-quobyte-188d8b18-2b5d-4ebc-b894-304bb26f06b0" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:40:57 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-8a21d92c-8ba2-4dd5-828a-88993c890e61 tempest-ProjectReaderTests-714592672 None] Acquiring lock "cinder-quobyte-0ac6f8c4-c837-461d-8e2a-41bf17bbf941" by "_delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:40:57 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-8a21d92c-8ba2-4dd5-828a-88993c890e61 tempest-ProjectReaderTests-714592672 None] Lock "cinder-quobyte-0ac6f8c4-c837-461d-8e2a-41bf17bbf941" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:40:57 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-8a21d92c-8ba2-4dd5-828a-88993c890e61 tempest-ProjectReaderTests-714592672 None] Deleting offline snapshot 0ac6f8c4-c837-461d-8e2a-41bf17bbf941 of volume 188d8b18-2b5d-4ebc-b894-304bb26f06b0 {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 15 16:40:57 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-8a21d92c-8ba2-4dd5-828a-88993c890e61 tempest-ProjectReaderTests-714592672 None] snapshot_file for this snap is: volume-188d8b18-2b5d-4ebc-b894-304bb26f06b0.0ac6f8c4-c837-461d-8e2a-41bf17bbf941 {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 15 16:40:57 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[551ad4ed-98af-4acb-af48-c24cc7cdfa0a]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:40:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8a21d92c-8ba2-4dd5-828a-88993c890e61 tempest-ProjectReaderTests-714592672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-188d8b18-2b5d-4ebc-b894-304bb26f06b0.0ac6f8c4-c837-461d-8e2a-41bf17bbf941 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:57 devstack sudo[107846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-188d8b18-2b5d-4ebc-b894-304bb26f06b0.0ac6f8c4-c837-461d-8e2a-41bf17bbf941 Sep 15 16:40:57 devstack sudo[107846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:57 devstack sudo[107841]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-21ec49b3-872b-4b7f-86dc-a383d8b5aa7b tempest-ProjectMemberTests-1855156353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2ffabbbd-43d0-452b-8350-7761b1a101ae 1073741824" returned: 0 in 0.482s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-21ec49b3-872b-4b7f-86dc-a383d8b5aa7b tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2ffabbbd-43d0-452b-8350-7761b1a101ae {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:57 devstack sudo[107848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2ffabbbd-43d0-452b-8350-7761b1a101ae Sep 15 16:40:57 devstack sudo[107848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:58 devstack sudo[107846]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8a21d92c-8ba2-4dd5-828a-88993c890e61 tempest-ProjectReaderTests-714592672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-188d8b18-2b5d-4ebc-b894-304bb26f06b0.0ac6f8c4-c837-461d-8e2a-41bf17bbf941" returned: 0 in 0.378s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:58 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-8a21d92c-8ba2-4dd5-828a-88993c890e61 tempest-ProjectReaderTests-714592672 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-188d8b18-2b5d-4ebc-b894-304bb26f06b0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 16:40:58 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba9bdf4d-5426-4ae9-b829-520c5c14f15a]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:40:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8a21d92c-8ba2-4dd5-828a-88993c890e61 tempest-ProjectReaderTests-714592672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-188d8b18-2b5d-4ebc-b894-304bb26f06b0 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:58 devstack sudo[107848]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-21ec49b3-872b-4b7f-86dc-a383d8b5aa7b tempest-ProjectMemberTests-1855156353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2ffabbbd-43d0-452b-8350-7761b1a101ae" returned: 0 in 0.266s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:58 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-21ec49b3-872b-4b7f-86dc-a383d8b5aa7b tempest-ProjectMemberTests-1855156353 None] <== create_volume: return (795ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:40:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-21ec49b3-872b-4b7f-86dc-a383d8b5aa7b tempest-ProjectMemberTests-1855156353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.798s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:40:58 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-21ec49b3-872b-4b7f-86dc-a383d8b5aa7b tempest-ProjectMemberTests-1855156353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33b3e052-8cef-4998-85cc-f1b4c8043147) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ffabbbd-43d0-452b-8350-7761b1a101ae', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:40:58 devstack sudo[107853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-188d8b18-2b5d-4ebc-b894-304bb26f06b0 Sep 15 16:40:58 devstack sudo[107853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:58 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-21ec49b3-872b-4b7f-86dc-a383d8b5aa7b tempest-ProjectMemberTests-1855156353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3421594-a601-4e12-a531-1dbe5dd88e20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:40:58 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-21ec49b3-872b-4b7f-86dc-a383d8b5aa7b tempest-ProjectMemberTests-1855156353 None] Volume volume-2ffabbbd-43d0-452b-8350-7761b1a101ae (2ffabbbd-43d0-452b-8350-7761b1a101ae): created successfully Sep 15 16:40:58 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-21ec49b3-872b-4b7f-86dc-a383d8b5aa7b tempest-ProjectMemberTests-1855156353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3421594-a601-4e12-a531-1dbe5dd88e20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:40:58 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-21ec49b3-872b-4b7f-86dc-a383d8b5aa7b tempest-ProjectMemberTests-1855156353 None] Flow 'volume_create_manager' (1f573d83-faf6-495c-b9f0-c50dd405dd55) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:40:58 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-21ec49b3-872b-4b7f-86dc-a383d8b5aa7b tempest-ProjectMemberTests-1855156353 None] Created volume successfully. Sep 15 16:40:58 devstack sudo[107853]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8a21d92c-8ba2-4dd5-828a-88993c890e61 tempest-ProjectReaderTests-714592672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-188d8b18-2b5d-4ebc-b894-304bb26f06b0" returned: 0 in 0.359s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8a21d92c-8ba2-4dd5-828a-88993c890e61 tempest-ProjectReaderTests-714592672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-188d8b18-2b5d-4ebc-b894-304bb26f06b0.0ac6f8c4-c837-461d-8e2a-41bf17bbf941 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:58 devstack sudo[107859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-188d8b18-2b5d-4ebc-b894-304bb26f06b0.0ac6f8c4-c837-461d-8e2a-41bf17bbf941 Sep 15 16:40:58 devstack sudo[107859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:58 devstack sudo[107859]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8a21d92c-8ba2-4dd5-828a-88993c890e61 tempest-ProjectReaderTests-714592672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-188d8b18-2b5d-4ebc-b894-304bb26f06b0.0ac6f8c4-c837-461d-8e2a-41bf17bbf941" returned: 0 in 0.320s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8a21d92c-8ba2-4dd5-828a-88993c890e61 tempest-ProjectReaderTests-714592672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-188d8b18-2b5d-4ebc-b894-304bb26f06b0.0ac6f8c4-c837-461d-8e2a-41bf17bbf941 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:58 devstack sudo[107864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-188d8b18-2b5d-4ebc-b894-304bb26f06b0.0ac6f8c4-c837-461d-8e2a-41bf17bbf941 Sep 15 16:40:58 devstack sudo[107864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:59 devstack sudo[107864]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-8a21d92c-8ba2-4dd5-828a-88993c890e61 tempest-ProjectReaderTests-714592672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-188d8b18-2b5d-4ebc-b894-304bb26f06b0.0ac6f8c4-c837-461d-8e2a-41bf17bbf941" returned: 0 in 0.247s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:59 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-8a21d92c-8ba2-4dd5-828a-88993c890e61 tempest-ProjectReaderTests-714592672 None] Lock "cinder-quobyte-0ac6f8c4-c837-461d-8e2a-41bf17bbf941" released by "_delete_snapshot" :: held 1.416s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:40:59 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-8a21d92c-8ba2-4dd5-828a-88993c890e61 tempest-ProjectReaderTests-714592672 None] Lock "cinder-quobyte-188d8b18-2b5d-4ebc-b894-304bb26f06b0" released by "delete_snapshot" :: held 1.445s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:40:59 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-8a21d92c-8ba2-4dd5-828a-88993c890e61 tempest-ProjectReaderTests-714592672 None] Created reservations ['646936cd-15b6-448e-9228-91623837ab4e', 'd2a9e0c8-bec3-4e1a-a0e0-dea82c84c91b', '47f5a7e1-bf38-485a-96e4-b74f17ed534c', 'c87d1b18-30d4-4896-a061-43d9389fa286'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:40:59 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-8a21d92c-8ba2-4dd5-828a-88993c890e61 tempest-ProjectReaderTests-714592672 None] Delete snapshot completed successfully. Sep 15 16:40:59 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-8a21d92c-8ba2-4dd5-828a-88993c890e61 tempest-ProjectReaderTests-714592672 None] Lock "cinder-0ac6f8c4-c837-461d-8e2a-41bf17bbf941-delete_snapshot" released by "delete_snapshot" :: held 1.601s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:40:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-d2411063-f1f8-4996-b11a-870e6f75507c tempest-ProjectMemberTests-1855156353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:40:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-d2411063-f1f8-4996-b11a-870e6f75507c tempest-ProjectMemberTests-1855156353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:40:59 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-d2411063-f1f8-4996-b11a-870e6f75507c tempest-ProjectMemberTests-1855156353 None] Creating offline snapshot 55d41874-2a6d-4805-a74a-48ddd6e9682f of volume 2ffabbbd-43d0-452b-8350-7761b1a101ae {{(pid=86082) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 15 16:40:59 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[1543c985-90ce-4b66-99b8-ac2f670fda2c]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:40:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d2411063-f1f8-4996-b11a-870e6f75507c tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2ffabbbd-43d0-452b-8350-7761b1a101ae {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:59 devstack sudo[107867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2ffabbbd-43d0-452b-8350-7761b1a101ae Sep 15 16:40:59 devstack sudo[107867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:59 devstack sudo[107867]: pam_unix(sudo:session): session closed for user root Sep 15 16:40:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d2411063-f1f8-4996-b11a-870e6f75507c tempest-ProjectMemberTests-1855156353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2ffabbbd-43d0-452b-8350-7761b1a101ae" returned: 0 in 0.350s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:40:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d2411063-f1f8-4996-b11a-870e6f75507c tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2ffabbbd-43d0-452b-8350-7761b1a101ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2ffabbbd-43d0-452b-8350-7761b1a101ae.55d41874-2a6d-4805-a74a-48ddd6e9682f 1G {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:59 devstack sudo[107872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2ffabbbd-43d0-452b-8350-7761b1a101ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2ffabbbd-43d0-452b-8350-7761b1a101ae.55d41874-2a6d-4805-a74a-48ddd6e9682f 1G Sep 15 16:40:59 devstack sudo[107872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:40:59 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-0504bca0-2a1e-4ec2-9b3a-f7fb514caa40 tempest-ProjectReaderTests-714592672 None] Acquiring lock "cinder-188d8b18-2b5d-4ebc-b894-304bb26f06b0-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:40:59 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-0504bca0-2a1e-4ec2-9b3a-f7fb514caa40 tempest-ProjectReaderTests-714592672 None] Lock "cinder-188d8b18-2b5d-4ebc-b894-304bb26f06b0-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:40:59 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-0504bca0-2a1e-4ec2-9b3a-f7fb514caa40 tempest-ProjectReaderTests-714592672 None] Acquiring lock "cinder-quobyte-188d8b18-2b5d-4ebc-b894-304bb26f06b0" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:40:59 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-0504bca0-2a1e-4ec2-9b3a-f7fb514caa40 tempest-ProjectReaderTests-714592672 None] Lock "cinder-quobyte-188d8b18-2b5d-4ebc-b894-304bb26f06b0" acquired by "delete_volume" :: waited 0.013s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:40:59 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e9fd9c1-aa0f-4581-b6c2-348955d4f71a]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:40:59 devstack cinder-volume[86082]: DEBUG oslo_service.periodic_task [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86082) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 15 16:40:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:40:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:40:59 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:40:59 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:40:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:40:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0504bca0-2a1e-4ec2-9b3a-f7fb514caa40 tempest-ProjectReaderTests-714592672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-188d8b18-2b5d-4ebc-b894-304bb26f06b0 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:40:59 devstack sudo[107875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:40:59 devstack sudo[107875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:41:00 devstack sudo[107877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-188d8b18-2b5d-4ebc-b894-304bb26f06b0 Sep 15 16:41:00 devstack sudo[107877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:41:00 devstack sudo[107872]: pam_unix(sudo:session): session closed for user root Sep 15 16:41:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d2411063-f1f8-4996-b11a-870e6f75507c tempest-ProjectMemberTests-1855156353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2ffabbbd-43d0-452b-8350-7761b1a101ae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2ffabbbd-43d0-452b-8350-7761b1a101ae.55d41874-2a6d-4805-a74a-48ddd6e9682f 1G" returned: 0 in 0.504s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:41:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d2411063-f1f8-4996-b11a-870e6f75507c tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ffabbbd-43d0-452b-8350-7761b1a101ae -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2ffabbbd-43d0-452b-8350-7761b1a101ae.55d41874-2a6d-4805-a74a-48ddd6e9682f {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:41:00 devstack sudo[107875]: pam_unix(sudo:session): session closed for user root Sep 15 16:41:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.290s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:41:00 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:41:00 devstack sudo[107883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ffabbbd-43d0-452b-8350-7761b1a101ae -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2ffabbbd-43d0-452b-8350-7761b1a101ae.55d41874-2a6d-4805-a74a-48ddd6e9682f Sep 15 16:41:00 devstack sudo[107883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:41:00 devstack cinder-volume[86082]: DEBUG oslo_service.periodic_task [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Running periodic task VolumeManager._thread_info {{(pid=86082) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 15 16:41:00 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] thread count: 29 {{(pid=86082) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 15 16:41:00 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] thread info: [<_MainThread(MainThread, started 124875935469696)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86082) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 15 16:41:00 devstack sudo[107877]: pam_unix(sudo:session): session closed for user root Sep 15 16:41:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0504bca0-2a1e-4ec2-9b3a-f7fb514caa40 tempest-ProjectReaderTests-714592672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-188d8b18-2b5d-4ebc-b894-304bb26f06b0" returned: 0 in 0.422s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:41:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0504bca0-2a1e-4ec2-9b3a-f7fb514caa40 tempest-ProjectReaderTests-714592672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-188d8b18-2b5d-4ebc-b894-304bb26f06b0 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:41:00 devstack sudo[107889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-188d8b18-2b5d-4ebc-b894-304bb26f06b0 Sep 15 16:41:00 devstack sudo[107889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:41:00 devstack sudo[107883]: pam_unix(sudo:session): session closed for user root Sep 15 16:41:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d2411063-f1f8-4996-b11a-870e6f75507c tempest-ProjectMemberTests-1855156353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2ffabbbd-43d0-452b-8350-7761b1a101ae -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2ffabbbd-43d0-452b-8350-7761b1a101ae.55d41874-2a6d-4805-a74a-48ddd6e9682f" returned: 0 in 0.292s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:41:00 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-d2411063-f1f8-4996-b11a-870e6f75507c tempest-ProjectMemberTests-1855156353 None] /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2ffabbbd-43d0-452b-8350-7761b1a101ae.55d41874-2a6d-4805-a74a-48ddd6e9682f is being set with open permissions: ugo+rw Sep 15 16:41:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d2411063-f1f8-4996-b11a-870e6f75507c tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2ffabbbd-43d0-452b-8350-7761b1a101ae.55d41874-2a6d-4805-a74a-48ddd6e9682f {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:41:00 devstack sudo[107894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2ffabbbd-43d0-452b-8350-7761b1a101ae.55d41874-2a6d-4805-a74a-48ddd6e9682f Sep 15 16:41:00 devstack sudo[107894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:41:00 devstack sudo[107889]: pam_unix(sudo:session): session closed for user root Sep 15 16:41:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0504bca0-2a1e-4ec2-9b3a-f7fb514caa40 tempest-ProjectReaderTests-714592672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-188d8b18-2b5d-4ebc-b894-304bb26f06b0" returned: 0 in 0.259s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:41:00 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-0504bca0-2a1e-4ec2-9b3a-f7fb514caa40 tempest-ProjectReaderTests-714592672 None] Lock "cinder-quobyte-188d8b18-2b5d-4ebc-b894-304bb26f06b0" released by "delete_volume" :: held 0.772s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:41:00 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-0504bca0-2a1e-4ec2-9b3a-f7fb514caa40 tempest-ProjectReaderTests-714592672 None] Created reservations ['090253bf-eb04-4908-995f-697ef80a2e44', 'b29ddcb3-fa97-4fbc-9e75-b9d1d36edd3b', '23130842-704f-4dca-a3a4-63251bcf38e6', '0d0f0429-3672-4985-9456-eb918cfc7c3b'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:41:00 devstack sudo[107894]: pam_unix(sudo:session): session closed for user root Sep 15 16:41:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d2411063-f1f8-4996-b11a-870e6f75507c tempest-ProjectMemberTests-1855156353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2ffabbbd-43d0-452b-8350-7761b1a101ae.55d41874-2a6d-4805-a74a-48ddd6e9682f" returned: 0 in 0.265s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:41:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-0504bca0-2a1e-4ec2-9b3a-f7fb514caa40 tempest-ProjectReaderTests-714592672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:41:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-0504bca0-2a1e-4ec2-9b3a-f7fb514caa40 tempest-ProjectReaderTests-714592672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:41:00 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-0504bca0-2a1e-4ec2-9b3a-f7fb514caa40 tempest-ProjectReaderTests-714592672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:41:00 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-0504bca0-2a1e-4ec2-9b3a-f7fb514caa40 tempest-ProjectReaderTests-714592672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:41:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-0504bca0-2a1e-4ec2-9b3a-f7fb514caa40 tempest-ProjectReaderTests-714592672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:41:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0504bca0-2a1e-4ec2-9b3a-f7fb514caa40 tempest-ProjectReaderTests-714592672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:41:00 devstack sudo[107898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:41:00 devstack sudo[107898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:41:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d2411063-f1f8-4996-b11a-870e6f75507c tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2ffabbbd-43d0-452b-8350-7761b1a101ae.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:41:00 devstack sudo[107900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2ffabbbd-43d0-452b-8350-7761b1a101ae.info Sep 15 16:41:00 devstack sudo[107900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:41:00 devstack sudo[107898]: pam_unix(sudo:session): session closed for user root Sep 15 16:41:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-0504bca0-2a1e-4ec2-9b3a-f7fb514caa40 tempest-ProjectReaderTests-714592672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.250s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:41:00 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-0504bca0-2a1e-4ec2-9b3a-f7fb514caa40 tempest-ProjectReaderTests-714592672 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:41:00 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-0504bca0-2a1e-4ec2-9b3a-f7fb514caa40 tempest-ProjectReaderTests-714592672 None] Deleted volume successfully. Sep 15 16:41:00 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-0504bca0-2a1e-4ec2-9b3a-f7fb514caa40 tempest-ProjectReaderTests-714592672 None] Lock "cinder-188d8b18-2b5d-4ebc-b894-304bb26f06b0-delete_volume" released by "delete_volume" :: held 1.242s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:41:01 devstack sudo[107900]: pam_unix(sudo:session): session closed for user root Sep 15 16:41:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d2411063-f1f8-4996-b11a-870e6f75507c tempest-ProjectMemberTests-1855156353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2ffabbbd-43d0-452b-8350-7761b1a101ae.info" returned: 0 in 0.287s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:41:01 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-d2411063-f1f8-4996-b11a-870e6f75507c tempest-ProjectMemberTests-1855156353 None] /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2ffabbbd-43d0-452b-8350-7761b1a101ae.info is being set with open permissions: ugo+rw Sep 15 16:41:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d2411063-f1f8-4996-b11a-870e6f75507c tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2ffabbbd-43d0-452b-8350-7761b1a101ae.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:41:01 devstack sudo[107904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2ffabbbd-43d0-452b-8350-7761b1a101ae.info Sep 15 16:41:01 devstack sudo[107904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:41:01 devstack sudo[107904]: pam_unix(sudo:session): session closed for user root Sep 15 16:41:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d2411063-f1f8-4996-b11a-870e6f75507c tempest-ProjectMemberTests-1855156353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2ffabbbd-43d0-452b-8350-7761b1a101ae.info" returned: 0 in 0.274s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:41:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-d2411063-f1f8-4996-b11a-870e6f75507c tempest-ProjectMemberTests-1855156353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.081s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:41:01 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-d2411063-f1f8-4996-b11a-870e6f75507c tempest-ProjectMemberTests-1855156353 None] Create snapshot completed successfully Sep 15 16:41:01 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-faf2ef8c-0f0f-4dd1-8424-c5d833a0a3a6 tempest-ProjectReaderTests-714592672 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:41:01 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-faf2ef8c-0f0f-4dd1-8424-c5d833a0a3a6 tempest-ProjectReaderTests-714592672 None] Flow 'volume_create_manager' (93e4a576-3e3b-40bb-a7d4-04b309d31a07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:41:01 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-faf2ef8c-0f0f-4dd1-8424-c5d833a0a3a6 tempest-ProjectReaderTests-714592672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a94dc2f5-b685-4aad-a770-4cbefbca8ca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:41:01 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-faf2ef8c-0f0f-4dd1-8424-c5d833a0a3a6 tempest-ProjectReaderTests-714592672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a94dc2f5-b685-4aad-a770-4cbefbca8ca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:41:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1048476381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38b8af9a-220c-45b9-9780-7790fa0b9f8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68cde7c8450e4480a0855eacf56861b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:41:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:41:01Z,use_quota=True,user_id='8d100ae259564a538c7bf3f0e0d830cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:41:01 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-faf2ef8c-0f0f-4dd1-8424-c5d833a0a3a6 tempest-ProjectReaderTests-714592672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6663572-7b6c-4de7-9d60-ac0be8a817d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:41:01 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-faf2ef8c-0f0f-4dd1-8424-c5d833a0a3a6 tempest-ProjectReaderTests-714592672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6663572-7b6c-4de7-9d60-ac0be8a817d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:41:01 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-faf2ef8c-0f0f-4dd1-8424-c5d833a0a3a6 tempest-ProjectReaderTests-714592672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89585584-91c9-4bad-9784-1250813e8930) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:41:01 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-faf2ef8c-0f0f-4dd1-8424-c5d833a0a3a6 tempest-ProjectReaderTests-714592672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89585584-91c9-4bad-9784-1250813e8930) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '38b8af9a-220c-45b9-9780-7790fa0b9f8d', 'volume_name': 'volume-38b8af9a-220c-45b9-9780-7790fa0b9f8d', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:41:01 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-faf2ef8c-0f0f-4dd1-8424-c5d833a0a3a6 tempest-ProjectReaderTests-714592672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b505bae7-34ab-4339-97b5-fb613cb46def) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:41:01 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-faf2ef8c-0f0f-4dd1-8424-c5d833a0a3a6 tempest-ProjectReaderTests-714592672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b505bae7-34ab-4339-97b5-fb613cb46def) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:41:01 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-faf2ef8c-0f0f-4dd1-8424-c5d833a0a3a6 tempest-ProjectReaderTests-714592672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8fceb1f-a339-443f-9110-0bf3be6692d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:41:01 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-faf2ef8c-0f0f-4dd1-8424-c5d833a0a3a6 tempest-ProjectReaderTests-714592672 None] Volume 38b8af9a-220c-45b9-9780-7790fa0b9f8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-38b8af9a-220c-45b9-9780-7790fa0b9f8d', 'volume_size': 1} Sep 15 16:41:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-faf2ef8c-0f0f-4dd1-8424-c5d833a0a3a6 tempest-ProjectReaderTests-714592672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:41:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-faf2ef8c-0f0f-4dd1-8424-c5d833a0a3a6 tempest-ProjectReaderTests-714592672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:41:01 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-faf2ef8c-0f0f-4dd1-8424-c5d833a0a3a6 tempest-ProjectReaderTests-714592672 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:41:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1048476381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=38b8af9a-220c-45b9-9780-7790fa0b9f8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68cde7c8450e4480a0855eacf56861b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:41:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:41:01Z,use_quota=True,user_id='8d100ae259564a538c7bf3f0e0d830cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:41:01 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-faf2ef8c-0f0f-4dd1-8424-c5d833a0a3a6 tempest-ProjectReaderTests-714592672 None] Creating volume 38b8af9a-220c-45b9-9780-7790fa0b9f8d {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:41:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-faf2ef8c-0f0f-4dd1-8424-c5d833a0a3a6 tempest-ProjectReaderTests-714592672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:41:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-faf2ef8c-0f0f-4dd1-8424-c5d833a0a3a6 tempest-ProjectReaderTests-714592672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:41:01 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-faf2ef8c-0f0f-4dd1-8424-c5d833a0a3a6 tempest-ProjectReaderTests-714592672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:41:01 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-faf2ef8c-0f0f-4dd1-8424-c5d833a0a3a6 tempest-ProjectReaderTests-714592672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:41:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-faf2ef8c-0f0f-4dd1-8424-c5d833a0a3a6 tempest-ProjectReaderTests-714592672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:41:01 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-faf2ef8c-0f0f-4dd1-8424-c5d833a0a3a6 tempest-ProjectReaderTests-714592672 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:41:01 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-faf2ef8c-0f0f-4dd1-8424-c5d833a0a3a6 tempest-ProjectReaderTests-714592672 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:41:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-faf2ef8c-0f0f-4dd1-8424-c5d833a0a3a6 tempest-ProjectReaderTests-714592672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-38b8af9a-220c-45b9-9780-7790fa0b9f8d 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:41:01 devstack sudo[107907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-38b8af9a-220c-45b9-9780-7790fa0b9f8d 1073741824 Sep 15 16:41:01 devstack sudo[107907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:41:01 devstack sudo[107907]: pam_unix(sudo:session): session closed for user root Sep 15 16:41:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-faf2ef8c-0f0f-4dd1-8424-c5d833a0a3a6 tempest-ProjectReaderTests-714592672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-38b8af9a-220c-45b9-9780-7790fa0b9f8d 1073741824" returned: 0 in 0.413s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:41:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-faf2ef8c-0f0f-4dd1-8424-c5d833a0a3a6 tempest-ProjectReaderTests-714592672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-38b8af9a-220c-45b9-9780-7790fa0b9f8d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:41:01 devstack sudo[107912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-38b8af9a-220c-45b9-9780-7790fa0b9f8d Sep 15 16:41:01 devstack sudo[107912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:41:02 devstack sudo[107912]: pam_unix(sudo:session): session closed for user root Sep 15 16:41:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-faf2ef8c-0f0f-4dd1-8424-c5d833a0a3a6 tempest-ProjectReaderTests-714592672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-38b8af9a-220c-45b9-9780-7790fa0b9f8d" returned: 0 in 0.238s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:41:02 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-faf2ef8c-0f0f-4dd1-8424-c5d833a0a3a6 tempest-ProjectReaderTests-714592672 None] <== create_volume: return (693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:41:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-faf2ef8c-0f0f-4dd1-8424-c5d833a0a3a6 tempest-ProjectReaderTests-714592672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.695s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:41:02 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-faf2ef8c-0f0f-4dd1-8424-c5d833a0a3a6 tempest-ProjectReaderTests-714592672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8fceb1f-a339-443f-9110-0bf3be6692d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-38b8af9a-220c-45b9-9780-7790fa0b9f8d', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:41:02 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-faf2ef8c-0f0f-4dd1-8424-c5d833a0a3a6 tempest-ProjectReaderTests-714592672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65bcd8dc-c68b-4dc1-a354-3daec3e4274c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:41:02 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-faf2ef8c-0f0f-4dd1-8424-c5d833a0a3a6 tempest-ProjectReaderTests-714592672 None] Volume volume-38b8af9a-220c-45b9-9780-7790fa0b9f8d (38b8af9a-220c-45b9-9780-7790fa0b9f8d): created successfully Sep 15 16:41:02 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-faf2ef8c-0f0f-4dd1-8424-c5d833a0a3a6 tempest-ProjectReaderTests-714592672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65bcd8dc-c68b-4dc1-a354-3daec3e4274c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:41:02 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-faf2ef8c-0f0f-4dd1-8424-c5d833a0a3a6 tempest-ProjectReaderTests-714592672 None] Flow 'volume_create_manager' (93e4a576-3e3b-40bb-a7d4-04b309d31a07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:41:02 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-faf2ef8c-0f0f-4dd1-8424-c5d833a0a3a6 tempest-ProjectReaderTests-714592672 None] Created volume successfully. Sep 15 16:41:02 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-9d0b044a-4cf0-4473-857f-c729ed99483c tempest-ProjectMemberTests-1855156353 None] Acquiring lock "cinder-55d41874-2a6d-4805-a74a-48ddd6e9682f-delete_snapshot" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:41:02 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-9d0b044a-4cf0-4473-857f-c729ed99483c tempest-ProjectMemberTests-1855156353 None] Lock "cinder-55d41874-2a6d-4805-a74a-48ddd6e9682f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:41:02 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-9d0b044a-4cf0-4473-857f-c729ed99483c tempest-ProjectMemberTests-1855156353 None] Acquiring lock "cinder-quobyte-2ffabbbd-43d0-452b-8350-7761b1a101ae" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:41:02 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-9d0b044a-4cf0-4473-857f-c729ed99483c tempest-ProjectMemberTests-1855156353 None] Lock "cinder-quobyte-2ffabbbd-43d0-452b-8350-7761b1a101ae" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:41:02 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-9d0b044a-4cf0-4473-857f-c729ed99483c tempest-ProjectMemberTests-1855156353 None] Acquiring lock "cinder-quobyte-55d41874-2a6d-4805-a74a-48ddd6e9682f" by "_delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:41:02 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-9d0b044a-4cf0-4473-857f-c729ed99483c tempest-ProjectMemberTests-1855156353 None] Lock "cinder-quobyte-55d41874-2a6d-4805-a74a-48ddd6e9682f" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:41:02 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-9d0b044a-4cf0-4473-857f-c729ed99483c tempest-ProjectMemberTests-1855156353 None] Deleting offline snapshot 55d41874-2a6d-4805-a74a-48ddd6e9682f of volume 2ffabbbd-43d0-452b-8350-7761b1a101ae {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 15 16:41:02 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-9d0b044a-4cf0-4473-857f-c729ed99483c tempest-ProjectMemberTests-1855156353 None] snapshot_file for this snap is: volume-2ffabbbd-43d0-452b-8350-7761b1a101ae.55d41874-2a6d-4805-a74a-48ddd6e9682f {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 15 16:41:02 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[c286c498-d12a-4020-b2af-e416b3e2f29d]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:41:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9d0b044a-4cf0-4473-857f-c729ed99483c tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2ffabbbd-43d0-452b-8350-7761b1a101ae.55d41874-2a6d-4805-a74a-48ddd6e9682f {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:41:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-dd2f56d7-a603-4a53-a41d-498d1a893d8c tempest-ProjectReaderTests-714592672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:41:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-dd2f56d7-a603-4a53-a41d-498d1a893d8c tempest-ProjectReaderTests-714592672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:41:02 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-dd2f56d7-a603-4a53-a41d-498d1a893d8c tempest-ProjectReaderTests-714592672 None] Creating offline snapshot 78a033d4-41d8-4fe5-bcfb-6a651f6b2c9b of volume 38b8af9a-220c-45b9-9780-7790fa0b9f8d {{(pid=86082) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 15 16:41:02 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[65edcd6e-d35a-4ba1-89ef-d29beb026772]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:41:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-dd2f56d7-a603-4a53-a41d-498d1a893d8c tempest-ProjectReaderTests-714592672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-38b8af9a-220c-45b9-9780-7790fa0b9f8d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:41:02 devstack sudo[107915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2ffabbbd-43d0-452b-8350-7761b1a101ae.55d41874-2a6d-4805-a74a-48ddd6e9682f Sep 15 16:41:02 devstack sudo[107915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:41:02 devstack sudo[107916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-38b8af9a-220c-45b9-9780-7790fa0b9f8d Sep 15 16:41:02 devstack sudo[107916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:41:02 devstack sudo[107915]: pam_unix(sudo:session): session closed for user root Sep 15 16:41:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9d0b044a-4cf0-4473-857f-c729ed99483c tempest-ProjectMemberTests-1855156353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2ffabbbd-43d0-452b-8350-7761b1a101ae.55d41874-2a6d-4805-a74a-48ddd6e9682f" returned: 0 in 0.372s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:41:02 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-9d0b044a-4cf0-4473-857f-c729ed99483c tempest-ProjectMemberTests-1855156353 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2ffabbbd-43d0-452b-8350-7761b1a101ae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 16:41:02 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[494f7099-b293-4e79-83bc-4526993ebd97]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:41:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9d0b044a-4cf0-4473-857f-c729ed99483c tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2ffabbbd-43d0-452b-8350-7761b1a101ae {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:41:02 devstack sudo[107916]: pam_unix(sudo:session): session closed for user root Sep 15 16:41:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-dd2f56d7-a603-4a53-a41d-498d1a893d8c tempest-ProjectReaderTests-714592672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-38b8af9a-220c-45b9-9780-7790fa0b9f8d" returned: 0 in 0.376s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:41:02 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-dd2f56d7-a603-4a53-a41d-498d1a893d8c tempest-ProjectReaderTests-714592672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-38b8af9a-220c-45b9-9780-7790fa0b9f8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-38b8af9a-220c-45b9-9780-7790fa0b9f8d.78a033d4-41d8-4fe5-bcfb-6a651f6b2c9b 1G {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:41:02 devstack sudo[107927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-38b8af9a-220c-45b9-9780-7790fa0b9f8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-38b8af9a-220c-45b9-9780-7790fa0b9f8d.78a033d4-41d8-4fe5-bcfb-6a651f6b2c9b 1G Sep 15 16:41:03 devstack sudo[107927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:41:03 devstack sudo[107926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2ffabbbd-43d0-452b-8350-7761b1a101ae Sep 15 16:41:03 devstack sudo[107926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:41:03 devstack sudo[107926]: pam_unix(sudo:session): session closed for user root Sep 15 16:41:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9d0b044a-4cf0-4473-857f-c729ed99483c tempest-ProjectMemberTests-1855156353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2ffabbbd-43d0-452b-8350-7761b1a101ae" returned: 0 in 0.359s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:41:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9d0b044a-4cf0-4473-857f-c729ed99483c tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2ffabbbd-43d0-452b-8350-7761b1a101ae.55d41874-2a6d-4805-a74a-48ddd6e9682f {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:41:03 devstack sudo[107936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2ffabbbd-43d0-452b-8350-7761b1a101ae.55d41874-2a6d-4805-a74a-48ddd6e9682f Sep 15 16:41:03 devstack sudo[107936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:41:03 devstack sudo[107927]: pam_unix(sudo:session): session closed for user root Sep 15 16:41:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-dd2f56d7-a603-4a53-a41d-498d1a893d8c tempest-ProjectReaderTests-714592672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-38b8af9a-220c-45b9-9780-7790fa0b9f8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-38b8af9a-220c-45b9-9780-7790fa0b9f8d.78a033d4-41d8-4fe5-bcfb-6a651f6b2c9b 1G" returned: 0 in 0.418s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:41:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-dd2f56d7-a603-4a53-a41d-498d1a893d8c tempest-ProjectReaderTests-714592672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38b8af9a-220c-45b9-9780-7790fa0b9f8d -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-38b8af9a-220c-45b9-9780-7790fa0b9f8d.78a033d4-41d8-4fe5-bcfb-6a651f6b2c9b {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:41:03 devstack sudo[107938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38b8af9a-220c-45b9-9780-7790fa0b9f8d -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-38b8af9a-220c-45b9-9780-7790fa0b9f8d.78a033d4-41d8-4fe5-bcfb-6a651f6b2c9b Sep 15 16:41:03 devstack sudo[107938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:41:03 devstack sudo[107936]: pam_unix(sudo:session): session closed for user root Sep 15 16:41:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9d0b044a-4cf0-4473-857f-c729ed99483c tempest-ProjectMemberTests-1855156353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2ffabbbd-43d0-452b-8350-7761b1a101ae.55d41874-2a6d-4805-a74a-48ddd6e9682f" returned: 0 in 0.356s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:41:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9d0b044a-4cf0-4473-857f-c729ed99483c tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2ffabbbd-43d0-452b-8350-7761b1a101ae.55d41874-2a6d-4805-a74a-48ddd6e9682f {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:41:03 devstack sudo[107946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2ffabbbd-43d0-452b-8350-7761b1a101ae.55d41874-2a6d-4805-a74a-48ddd6e9682f Sep 15 16:41:03 devstack sudo[107946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:41:03 devstack sudo[107938]: pam_unix(sudo:session): session closed for user root Sep 15 16:41:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-dd2f56d7-a603-4a53-a41d-498d1a893d8c tempest-ProjectReaderTests-714592672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-38b8af9a-220c-45b9-9780-7790fa0b9f8d -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-38b8af9a-220c-45b9-9780-7790fa0b9f8d.78a033d4-41d8-4fe5-bcfb-6a651f6b2c9b" returned: 0 in 0.322s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:41:03 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-dd2f56d7-a603-4a53-a41d-498d1a893d8c tempest-ProjectReaderTests-714592672 None] /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-38b8af9a-220c-45b9-9780-7790fa0b9f8d.78a033d4-41d8-4fe5-bcfb-6a651f6b2c9b is being set with open permissions: ugo+rw Sep 15 16:41:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-dd2f56d7-a603-4a53-a41d-498d1a893d8c tempest-ProjectReaderTests-714592672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-38b8af9a-220c-45b9-9780-7790fa0b9f8d.78a033d4-41d8-4fe5-bcfb-6a651f6b2c9b {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:41:03 devstack sudo[107948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-38b8af9a-220c-45b9-9780-7790fa0b9f8d.78a033d4-41d8-4fe5-bcfb-6a651f6b2c9b Sep 15 16:41:03 devstack sudo[107948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:41:03 devstack sudo[107946]: pam_unix(sudo:session): session closed for user root Sep 15 16:41:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-9d0b044a-4cf0-4473-857f-c729ed99483c tempest-ProjectMemberTests-1855156353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2ffabbbd-43d0-452b-8350-7761b1a101ae.55d41874-2a6d-4805-a74a-48ddd6e9682f" returned: 0 in 0.270s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:41:03 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-9d0b044a-4cf0-4473-857f-c729ed99483c tempest-ProjectMemberTests-1855156353 None] Lock "cinder-quobyte-55d41874-2a6d-4805-a74a-48ddd6e9682f" released by "_delete_snapshot" :: held 1.481s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:41:03 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-9d0b044a-4cf0-4473-857f-c729ed99483c tempest-ProjectMemberTests-1855156353 None] Lock "cinder-quobyte-2ffabbbd-43d0-452b-8350-7761b1a101ae" released by "delete_snapshot" :: held 1.508s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:41:03 devstack sudo[107948]: pam_unix(sudo:session): session closed for user root Sep 15 16:41:03 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-dd2f56d7-a603-4a53-a41d-498d1a893d8c tempest-ProjectReaderTests-714592672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-38b8af9a-220c-45b9-9780-7790fa0b9f8d.78a033d4-41d8-4fe5-bcfb-6a651f6b2c9b" returned: 0 in 0.270s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:41:04 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-dd2f56d7-a603-4a53-a41d-498d1a893d8c tempest-ProjectReaderTests-714592672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-38b8af9a-220c-45b9-9780-7790fa0b9f8d.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:41:04 devstack sudo[107952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-38b8af9a-220c-45b9-9780-7790fa0b9f8d.info Sep 15 16:41:04 devstack sudo[107952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:41:04 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-9d0b044a-4cf0-4473-857f-c729ed99483c tempest-ProjectMemberTests-1855156353 None] Created reservations ['b13d1507-db42-47ca-9006-f3a14b89f3f5', '14f4d49b-648f-41b4-953c-2233af04d2cc', 'd5193bb7-f2b9-43a7-aeda-1d8b2cd73c43', '3d353184-d489-41dc-a4eb-7a276057ebc2'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:41:04 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-9d0b044a-4cf0-4473-857f-c729ed99483c tempest-ProjectMemberTests-1855156353 None] Delete snapshot completed successfully. Sep 15 16:41:04 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-9d0b044a-4cf0-4473-857f-c729ed99483c tempest-ProjectMemberTests-1855156353 None] Lock "cinder-55d41874-2a6d-4805-a74a-48ddd6e9682f-delete_snapshot" released by "delete_snapshot" :: held 1.676s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:41:04 devstack sudo[107952]: pam_unix(sudo:session): session closed for user root Sep 15 16:41:04 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-dd2f56d7-a603-4a53-a41d-498d1a893d8c tempest-ProjectReaderTests-714592672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-38b8af9a-220c-45b9-9780-7790fa0b9f8d.info" returned: 0 in 0.280s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:41:04 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-dd2f56d7-a603-4a53-a41d-498d1a893d8c tempest-ProjectReaderTests-714592672 None] /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-38b8af9a-220c-45b9-9780-7790fa0b9f8d.info is being set with open permissions: ugo+rw Sep 15 16:41:04 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-dd2f56d7-a603-4a53-a41d-498d1a893d8c tempest-ProjectReaderTests-714592672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-38b8af9a-220c-45b9-9780-7790fa0b9f8d.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:41:04 devstack sudo[107955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-38b8af9a-220c-45b9-9780-7790fa0b9f8d.info Sep 15 16:41:04 devstack sudo[107955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:41:04 devstack sudo[107955]: pam_unix(sudo:session): session closed for user root Sep 15 16:41:04 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-dd2f56d7-a603-4a53-a41d-498d1a893d8c tempest-ProjectReaderTests-714592672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-38b8af9a-220c-45b9-9780-7790fa0b9f8d.info" returned: 0 in 0.255s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:41:04 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-dd2f56d7-a603-4a53-a41d-498d1a893d8c tempest-ProjectReaderTests-714592672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.021s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:41:04 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-6700defe-81d0-4770-bb5d-5b1f13553c96 tempest-ProjectMemberTests-1855156353 None] Acquiring lock "cinder-2ffabbbd-43d0-452b-8350-7761b1a101ae-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:41:04 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-6700defe-81d0-4770-bb5d-5b1f13553c96 tempest-ProjectMemberTests-1855156353 None] Lock "cinder-2ffabbbd-43d0-452b-8350-7761b1a101ae-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:41:04 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-dd2f56d7-a603-4a53-a41d-498d1a893d8c tempest-ProjectReaderTests-714592672 None] Create snapshot completed successfully Sep 15 16:41:04 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-6700defe-81d0-4770-bb5d-5b1f13553c96 tempest-ProjectMemberTests-1855156353 None] Acquiring lock "cinder-quobyte-2ffabbbd-43d0-452b-8350-7761b1a101ae" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:41:04 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-6700defe-81d0-4770-bb5d-5b1f13553c96 tempest-ProjectMemberTests-1855156353 None] Lock "cinder-quobyte-2ffabbbd-43d0-452b-8350-7761b1a101ae" acquired by "delete_volume" :: waited 0.017s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:41:04 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[f89f9afc-8386-4179-8586-5a319f28899d]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:41:04 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-6700defe-81d0-4770-bb5d-5b1f13553c96 tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2ffabbbd-43d0-452b-8350-7761b1a101ae {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:41:04 devstack sudo[107958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2ffabbbd-43d0-452b-8350-7761b1a101ae Sep 15 16:41:04 devstack sudo[107958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:41:05 devstack sudo[107958]: pam_unix(sudo:session): session closed for user root Sep 15 16:41:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-6700defe-81d0-4770-bb5d-5b1f13553c96 tempest-ProjectMemberTests-1855156353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2ffabbbd-43d0-452b-8350-7761b1a101ae" returned: 0 in 0.355s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:41:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-6700defe-81d0-4770-bb5d-5b1f13553c96 tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2ffabbbd-43d0-452b-8350-7761b1a101ae {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:41:05 devstack sudo[107963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2ffabbbd-43d0-452b-8350-7761b1a101ae Sep 15 16:41:05 devstack sudo[107963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:41:05 devstack sudo[107963]: pam_unix(sudo:session): session closed for user root Sep 15 16:41:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-6700defe-81d0-4770-bb5d-5b1f13553c96 tempest-ProjectMemberTests-1855156353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2ffabbbd-43d0-452b-8350-7761b1a101ae" returned: 0 in 0.240s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:41:05 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-6700defe-81d0-4770-bb5d-5b1f13553c96 tempest-ProjectMemberTests-1855156353 None] Lock "cinder-quobyte-2ffabbbd-43d0-452b-8350-7761b1a101ae" released by "delete_volume" :: held 0.654s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:41:05 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-6700defe-81d0-4770-bb5d-5b1f13553c96 tempest-ProjectMemberTests-1855156353 None] Created reservations ['431627c4-ad41-4179-8e42-5afab678b71c', '9fce45ca-3703-4b2a-a0f6-cbc0fcb7f927', 'b5b09ac0-3dab-42ee-86fa-e4d4abaebc96', '4bf0bf37-beef-4816-8ce1-7b1ac93383b5'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:41:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-6700defe-81d0-4770-bb5d-5b1f13553c96 tempest-ProjectMemberTests-1855156353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:41:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-6700defe-81d0-4770-bb5d-5b1f13553c96 tempest-ProjectMemberTests-1855156353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:41:05 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-6700defe-81d0-4770-bb5d-5b1f13553c96 tempest-ProjectMemberTests-1855156353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:41:05 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-6700defe-81d0-4770-bb5d-5b1f13553c96 tempest-ProjectMemberTests-1855156353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:41:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-6700defe-81d0-4770-bb5d-5b1f13553c96 tempest-ProjectMemberTests-1855156353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:41:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-6700defe-81d0-4770-bb5d-5b1f13553c96 tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:41:05 devstack sudo[107966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:41:05 devstack sudo[107966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:41:05 devstack sudo[107966]: pam_unix(sudo:session): session closed for user root Sep 15 16:41:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-6700defe-81d0-4770-bb5d-5b1f13553c96 tempest-ProjectMemberTests-1855156353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.261s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:41:05 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-6700defe-81d0-4770-bb5d-5b1f13553c96 tempest-ProjectMemberTests-1855156353 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:41:05 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-6700defe-81d0-4770-bb5d-5b1f13553c96 tempest-ProjectMemberTests-1855156353 None] Deleted volume successfully. Sep 15 16:41:05 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-b74d267a-e3bf-464e-9ae1-4bddf4e1c365 tempest-ProjectReaderTests-714592672 None] Acquiring lock "cinder-78a033d4-41d8-4fe5-bcfb-6a651f6b2c9b-delete_snapshot" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:41:05 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-b74d267a-e3bf-464e-9ae1-4bddf4e1c365 tempest-ProjectReaderTests-714592672 None] Lock "cinder-78a033d4-41d8-4fe5-bcfb-6a651f6b2c9b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:41:05 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-b74d267a-e3bf-464e-9ae1-4bddf4e1c365 tempest-ProjectReaderTests-714592672 None] Acquiring lock "cinder-quobyte-38b8af9a-220c-45b9-9780-7790fa0b9f8d" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:41:05 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-6700defe-81d0-4770-bb5d-5b1f13553c96 tempest-ProjectMemberTests-1855156353 None] Lock "cinder-2ffabbbd-43d0-452b-8350-7761b1a101ae-delete_volume" released by "delete_volume" :: held 1.142s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:41:05 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-b74d267a-e3bf-464e-9ae1-4bddf4e1c365 tempest-ProjectReaderTests-714592672 None] Lock "cinder-quobyte-38b8af9a-220c-45b9-9780-7790fa0b9f8d" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:41:05 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-b74d267a-e3bf-464e-9ae1-4bddf4e1c365 tempest-ProjectReaderTests-714592672 None] Acquiring lock "cinder-quobyte-78a033d4-41d8-4fe5-bcfb-6a651f6b2c9b" by "_delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:41:05 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-b74d267a-e3bf-464e-9ae1-4bddf4e1c365 tempest-ProjectReaderTests-714592672 None] Lock "cinder-quobyte-78a033d4-41d8-4fe5-bcfb-6a651f6b2c9b" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:41:05 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-b74d267a-e3bf-464e-9ae1-4bddf4e1c365 tempest-ProjectReaderTests-714592672 None] Deleting offline snapshot 78a033d4-41d8-4fe5-bcfb-6a651f6b2c9b of volume 38b8af9a-220c-45b9-9780-7790fa0b9f8d {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 15 16:41:05 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-b74d267a-e3bf-464e-9ae1-4bddf4e1c365 tempest-ProjectReaderTests-714592672 None] snapshot_file for this snap is: volume-38b8af9a-220c-45b9-9780-7790fa0b9f8d.78a033d4-41d8-4fe5-bcfb-6a651f6b2c9b {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 15 16:41:05 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[f366e692-078f-4f23-a6c7-4b84665e6bfa]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:41:05 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b74d267a-e3bf-464e-9ae1-4bddf4e1c365 tempest-ProjectReaderTests-714592672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-38b8af9a-220c-45b9-9780-7790fa0b9f8d.78a033d4-41d8-4fe5-bcfb-6a651f6b2c9b {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:41:05 devstack sudo[107969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-38b8af9a-220c-45b9-9780-7790fa0b9f8d.78a033d4-41d8-4fe5-bcfb-6a651f6b2c9b Sep 15 16:41:05 devstack sudo[107969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:41:06 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-3d29a410-5860-44c4-983f-215597d09793 tempest-ProjectMemberTests-1855156353 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:41:06 devstack sudo[107969]: pam_unix(sudo:session): session closed for user root Sep 15 16:41:06 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-3d29a410-5860-44c4-983f-215597d09793 tempest-ProjectMemberTests-1855156353 None] Flow 'volume_create_manager' (3c06af92-d3ec-4a70-af77-8df59fb46f6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:41:06 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-3d29a410-5860-44c4-983f-215597d09793 tempest-ProjectMemberTests-1855156353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da19f96c-fadb-48fb-b08b-d07231e36d87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:41:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b74d267a-e3bf-464e-9ae1-4bddf4e1c365 tempest-ProjectReaderTests-714592672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-38b8af9a-220c-45b9-9780-7790fa0b9f8d.78a033d4-41d8-4fe5-bcfb-6a651f6b2c9b" returned: 0 in 0.417s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:41:06 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-b74d267a-e3bf-464e-9ae1-4bddf4e1c365 tempest-ProjectReaderTests-714592672 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-38b8af9a-220c-45b9-9780-7790fa0b9f8d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 16:41:06 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-3d29a410-5860-44c4-983f-215597d09793 tempest-ProjectMemberTests-1855156353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da19f96c-fadb-48fb-b08b-d07231e36d87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:41:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1796395079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=035a1708-5fc0-42ac-86d1-d5209179471e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a303ec1076004f4db43523c2f7b6a446',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:41:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:41:06Z,use_quota=True,user_id='d9953555b80c481b9eaabbc7d416d0b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:41:06 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-3d29a410-5860-44c4-983f-215597d09793 tempest-ProjectMemberTests-1855156353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3084132c-0c84-4521-b45c-08cdd5921669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:41:06 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-3d29a410-5860-44c4-983f-215597d09793 tempest-ProjectMemberTests-1855156353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3084132c-0c84-4521-b45c-08cdd5921669) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:41:06 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-3d29a410-5860-44c4-983f-215597d09793 tempest-ProjectMemberTests-1855156353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f70029c-6984-4e7a-bb76-9a6d40328f1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:41:06 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-3d29a410-5860-44c4-983f-215597d09793 tempest-ProjectMemberTests-1855156353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f70029c-6984-4e7a-bb76-9a6d40328f1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '035a1708-5fc0-42ac-86d1-d5209179471e', 'volume_name': 'volume-035a1708-5fc0-42ac-86d1-d5209179471e', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:41:06 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-3d29a410-5860-44c4-983f-215597d09793 tempest-ProjectMemberTests-1855156353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27ab3a1a-a6f3-444f-8a11-820f30d537a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:41:06 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-3d29a410-5860-44c4-983f-215597d09793 tempest-ProjectMemberTests-1855156353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27ab3a1a-a6f3-444f-8a11-820f30d537a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:41:06 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-3d29a410-5860-44c4-983f-215597d09793 tempest-ProjectMemberTests-1855156353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6537dcc5-4105-4d58-82b0-ae0c5d3c7ba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:41:06 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-3d29a410-5860-44c4-983f-215597d09793 tempest-ProjectMemberTests-1855156353 None] Volume 035a1708-5fc0-42ac-86d1-d5209179471e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-035a1708-5fc0-42ac-86d1-d5209179471e', 'volume_size': 1} Sep 15 16:41:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-3d29a410-5860-44c4-983f-215597d09793 tempest-ProjectMemberTests-1855156353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:41:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-3d29a410-5860-44c4-983f-215597d09793 tempest-ProjectMemberTests-1855156353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:41:06 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-3d29a410-5860-44c4-983f-215597d09793 tempest-ProjectMemberTests-1855156353 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:41:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1796395079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=035a1708-5fc0-42ac-86d1-d5209179471e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a303ec1076004f4db43523c2f7b6a446',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:41:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:41:06Z,use_quota=True,user_id='d9953555b80c481b9eaabbc7d416d0b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:41:06 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-3d29a410-5860-44c4-983f-215597d09793 tempest-ProjectMemberTests-1855156353 None] Creating volume 035a1708-5fc0-42ac-86d1-d5209179471e {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:41:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-3d29a410-5860-44c4-983f-215597d09793 tempest-ProjectMemberTests-1855156353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:41:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-3d29a410-5860-44c4-983f-215597d09793 tempest-ProjectMemberTests-1855156353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:41:06 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-3d29a410-5860-44c4-983f-215597d09793 tempest-ProjectMemberTests-1855156353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:41:06 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-3d29a410-5860-44c4-983f-215597d09793 tempest-ProjectMemberTests-1855156353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:41:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-3d29a410-5860-44c4-983f-215597d09793 tempest-ProjectMemberTests-1855156353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:41:06 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-3d29a410-5860-44c4-983f-215597d09793 tempest-ProjectMemberTests-1855156353 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:41:06 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-3d29a410-5860-44c4-983f-215597d09793 tempest-ProjectMemberTests-1855156353 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:41:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3d29a410-5860-44c4-983f-215597d09793 tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-035a1708-5fc0-42ac-86d1-d5209179471e 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:41:06 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e46e08d-e000-4e57-90cb-66902a3f5bfe]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:41:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b74d267a-e3bf-464e-9ae1-4bddf4e1c365 tempest-ProjectReaderTests-714592672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-38b8af9a-220c-45b9-9780-7790fa0b9f8d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:41:06 devstack sudo[107975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-035a1708-5fc0-42ac-86d1-d5209179471e 1073741824 Sep 15 16:41:06 devstack sudo[107975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:41:06 devstack sudo[107976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-38b8af9a-220c-45b9-9780-7790fa0b9f8d Sep 15 16:41:06 devstack sudo[107976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:41:06 devstack sudo[107976]: pam_unix(sudo:session): session closed for user root Sep 15 16:41:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b74d267a-e3bf-464e-9ae1-4bddf4e1c365 tempest-ProjectReaderTests-714592672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-38b8af9a-220c-45b9-9780-7790fa0b9f8d" returned: 0 in 0.381s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:41:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b74d267a-e3bf-464e-9ae1-4bddf4e1c365 tempest-ProjectReaderTests-714592672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-38b8af9a-220c-45b9-9780-7790fa0b9f8d.78a033d4-41d8-4fe5-bcfb-6a651f6b2c9b {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:41:06 devstack sudo[107986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-38b8af9a-220c-45b9-9780-7790fa0b9f8d.78a033d4-41d8-4fe5-bcfb-6a651f6b2c9b Sep 15 16:41:06 devstack sudo[107986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:41:06 devstack sudo[107975]: pam_unix(sudo:session): session closed for user root Sep 15 16:41:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3d29a410-5860-44c4-983f-215597d09793 tempest-ProjectMemberTests-1855156353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-035a1708-5fc0-42ac-86d1-d5209179471e 1073741824" returned: 0 in 0.463s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:41:06 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3d29a410-5860-44c4-983f-215597d09793 tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-035a1708-5fc0-42ac-86d1-d5209179471e {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:41:06 devstack sudo[107988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-035a1708-5fc0-42ac-86d1-d5209179471e Sep 15 16:41:06 devstack sudo[107988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:41:07 devstack sudo[107988]: pam_unix(sudo:session): session closed for user root Sep 15 16:41:07 devstack sudo[107986]: pam_unix(sudo:session): session closed for user root Sep 15 16:41:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-3d29a410-5860-44c4-983f-215597d09793 tempest-ProjectMemberTests-1855156353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-035a1708-5fc0-42ac-86d1-d5209179471e" returned: 0 in 0.247s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:41:07 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-3d29a410-5860-44c4-983f-215597d09793 tempest-ProjectMemberTests-1855156353 None] <== create_volume: return (749ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:41:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-3d29a410-5860-44c4-983f-215597d09793 tempest-ProjectMemberTests-1855156353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.752s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:41:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b74d267a-e3bf-464e-9ae1-4bddf4e1c365 tempest-ProjectReaderTests-714592672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-38b8af9a-220c-45b9-9780-7790fa0b9f8d.78a033d4-41d8-4fe5-bcfb-6a651f6b2c9b" returned: 0 in 0.352s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:41:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b74d267a-e3bf-464e-9ae1-4bddf4e1c365 tempest-ProjectReaderTests-714592672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-38b8af9a-220c-45b9-9780-7790fa0b9f8d.78a033d4-41d8-4fe5-bcfb-6a651f6b2c9b {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:41:07 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-3d29a410-5860-44c4-983f-215597d09793 tempest-ProjectMemberTests-1855156353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6537dcc5-4105-4d58-82b0-ae0c5d3c7ba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-035a1708-5fc0-42ac-86d1-d5209179471e', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:41:07 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-3d29a410-5860-44c4-983f-215597d09793 tempest-ProjectMemberTests-1855156353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (428155b6-d958-4711-aedd-911376920a3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:41:07 devstack sudo[107994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-38b8af9a-220c-45b9-9780-7790fa0b9f8d.78a033d4-41d8-4fe5-bcfb-6a651f6b2c9b Sep 15 16:41:07 devstack sudo[107994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:41:07 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-3d29a410-5860-44c4-983f-215597d09793 tempest-ProjectMemberTests-1855156353 None] Volume volume-035a1708-5fc0-42ac-86d1-d5209179471e (035a1708-5fc0-42ac-86d1-d5209179471e): created successfully Sep 15 16:41:07 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-3d29a410-5860-44c4-983f-215597d09793 tempest-ProjectMemberTests-1855156353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (428155b6-d958-4711-aedd-911376920a3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:41:07 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-3d29a410-5860-44c4-983f-215597d09793 tempest-ProjectMemberTests-1855156353 None] Flow 'volume_create_manager' (3c06af92-d3ec-4a70-af77-8df59fb46f6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:41:07 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-3d29a410-5860-44c4-983f-215597d09793 tempest-ProjectMemberTests-1855156353 None] Created volume successfully. Sep 15 16:41:07 devstack sudo[107994]: pam_unix(sudo:session): session closed for user root Sep 15 16:41:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-b74d267a-e3bf-464e-9ae1-4bddf4e1c365 tempest-ProjectReaderTests-714592672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-38b8af9a-220c-45b9-9780-7790fa0b9f8d.78a033d4-41d8-4fe5-bcfb-6a651f6b2c9b" returned: 0 in 0.249s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:41:07 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-b74d267a-e3bf-464e-9ae1-4bddf4e1c365 tempest-ProjectReaderTests-714592672 None] Lock "cinder-quobyte-78a033d4-41d8-4fe5-bcfb-6a651f6b2c9b" released by "_delete_snapshot" :: held 1.579s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:41:07 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-b74d267a-e3bf-464e-9ae1-4bddf4e1c365 tempest-ProjectReaderTests-714592672 None] Lock "cinder-quobyte-38b8af9a-220c-45b9-9780-7790fa0b9f8d" released by "delete_snapshot" :: held 1.600s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:41:07 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-b74d267a-e3bf-464e-9ae1-4bddf4e1c365 tempest-ProjectReaderTests-714592672 None] Created reservations ['b3a16729-1058-4c62-8649-781c80d1de2d', '7d414172-880d-4141-81c0-da3af0086c80', '5e769966-fb52-44cf-8eb8-29d21870c452', '70e4885a-c133-49dc-8049-599b6752787e'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:41:07 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-b74d267a-e3bf-464e-9ae1-4bddf4e1c365 tempest-ProjectReaderTests-714592672 None] Delete snapshot completed successfully. Sep 15 16:41:07 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-b74d267a-e3bf-464e-9ae1-4bddf4e1c365 tempest-ProjectReaderTests-714592672 None] Lock "cinder-78a033d4-41d8-4fe5-bcfb-6a651f6b2c9b-delete_snapshot" released by "delete_snapshot" :: held 1.726s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:41:07 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-278fff6d-8210-4717-a93a-2e3870352bf1 tempest-ProjectReaderTests-714592672 None] Acquiring lock "cinder-38b8af9a-220c-45b9-9780-7790fa0b9f8d-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:41:07 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-278fff6d-8210-4717-a93a-2e3870352bf1 tempest-ProjectReaderTests-714592672 None] Lock "cinder-38b8af9a-220c-45b9-9780-7790fa0b9f8d-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:41:07 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-278fff6d-8210-4717-a93a-2e3870352bf1 tempest-ProjectReaderTests-714592672 None] Acquiring lock "cinder-quobyte-38b8af9a-220c-45b9-9780-7790fa0b9f8d" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:41:07 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-278fff6d-8210-4717-a93a-2e3870352bf1 tempest-ProjectReaderTests-714592672 None] Lock "cinder-quobyte-38b8af9a-220c-45b9-9780-7790fa0b9f8d" acquired by "delete_volume" :: waited 0.016s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:41:07 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[88d44c1d-e799-478b-85bc-b41d4c9bbec4]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:41:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-278fff6d-8210-4717-a93a-2e3870352bf1 tempest-ProjectReaderTests-714592672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-38b8af9a-220c-45b9-9780-7790fa0b9f8d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:41:08 devstack sudo[107998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-38b8af9a-220c-45b9-9780-7790fa0b9f8d Sep 15 16:41:08 devstack sudo[107998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:41:08 devstack sudo[107998]: pam_unix(sudo:session): session closed for user root Sep 15 16:41:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-278fff6d-8210-4717-a93a-2e3870352bf1 tempest-ProjectReaderTests-714592672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-38b8af9a-220c-45b9-9780-7790fa0b9f8d" returned: 0 in 0.386s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:41:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-278fff6d-8210-4717-a93a-2e3870352bf1 tempest-ProjectReaderTests-714592672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-38b8af9a-220c-45b9-9780-7790fa0b9f8d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:41:08 devstack sudo[108003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-38b8af9a-220c-45b9-9780-7790fa0b9f8d Sep 15 16:41:08 devstack sudo[108003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:41:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c3003f32-caa9-4fff-8747-bcd94f81bc3b tempest-ProjectMemberTests-1855156353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:41:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c3003f32-caa9-4fff-8747-bcd94f81bc3b tempest-ProjectMemberTests-1855156353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:41:08 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-c3003f32-caa9-4fff-8747-bcd94f81bc3b tempest-ProjectMemberTests-1855156353 None] Creating offline snapshot 07c69860-edea-43ae-bc5e-501484707398 of volume 035a1708-5fc0-42ac-86d1-d5209179471e {{(pid=86082) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 15 16:41:08 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac3e4edc-004a-47d6-a4af-e8f5bbe8a5fd]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:41:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c3003f32-caa9-4fff-8747-bcd94f81bc3b tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-035a1708-5fc0-42ac-86d1-d5209179471e {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:41:08 devstack sudo[108005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-035a1708-5fc0-42ac-86d1-d5209179471e Sep 15 16:41:08 devstack sudo[108005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:41:08 devstack sudo[108003]: pam_unix(sudo:session): session closed for user root Sep 15 16:41:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-278fff6d-8210-4717-a93a-2e3870352bf1 tempest-ProjectReaderTests-714592672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-38b8af9a-220c-45b9-9780-7790fa0b9f8d" returned: 0 in 0.258s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:41:08 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-278fff6d-8210-4717-a93a-2e3870352bf1 tempest-ProjectReaderTests-714592672 None] Lock "cinder-quobyte-38b8af9a-220c-45b9-9780-7790fa0b9f8d" released by "delete_volume" :: held 0.704s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:41:08 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-278fff6d-8210-4717-a93a-2e3870352bf1 tempest-ProjectReaderTests-714592672 None] Created reservations ['ae29b9c9-1b9a-44a0-b54c-12a053822fd8', '400de0bf-85aa-44b9-bc55-d0085ab8da41', '1aa90969-1e19-4e2b-8256-bc88e057bb07', 'c77d579e-bcf4-4b1c-9ae3-27a0439ba592'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:41:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-278fff6d-8210-4717-a93a-2e3870352bf1 tempest-ProjectReaderTests-714592672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:41:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-278fff6d-8210-4717-a93a-2e3870352bf1 tempest-ProjectReaderTests-714592672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:41:08 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-278fff6d-8210-4717-a93a-2e3870352bf1 tempest-ProjectReaderTests-714592672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:41:08 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-278fff6d-8210-4717-a93a-2e3870352bf1 tempest-ProjectReaderTests-714592672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:41:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-278fff6d-8210-4717-a93a-2e3870352bf1 tempest-ProjectReaderTests-714592672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:41:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-278fff6d-8210-4717-a93a-2e3870352bf1 tempest-ProjectReaderTests-714592672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:41:08 devstack sudo[108008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:41:08 devstack sudo[108008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:41:08 devstack sudo[108005]: pam_unix(sudo:session): session closed for user root Sep 15 16:41:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c3003f32-caa9-4fff-8747-bcd94f81bc3b tempest-ProjectMemberTests-1855156353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-035a1708-5fc0-42ac-86d1-d5209179471e" returned: 0 in 0.372s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:41:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c3003f32-caa9-4fff-8747-bcd94f81bc3b tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-035a1708-5fc0-42ac-86d1-d5209179471e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-035a1708-5fc0-42ac-86d1-d5209179471e.07c69860-edea-43ae-bc5e-501484707398 1G {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:41:08 devstack sudo[108013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-035a1708-5fc0-42ac-86d1-d5209179471e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-035a1708-5fc0-42ac-86d1-d5209179471e.07c69860-edea-43ae-bc5e-501484707398 1G Sep 15 16:41:08 devstack sudo[108013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:41:09 devstack sudo[108008]: pam_unix(sudo:session): session closed for user root Sep 15 16:41:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-278fff6d-8210-4717-a93a-2e3870352bf1 tempest-ProjectReaderTests-714592672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.256s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:41:09 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-278fff6d-8210-4717-a93a-2e3870352bf1 tempest-ProjectReaderTests-714592672 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:41:09 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-278fff6d-8210-4717-a93a-2e3870352bf1 tempest-ProjectReaderTests-714592672 None] Deleted volume successfully. Sep 15 16:41:09 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-278fff6d-8210-4717-a93a-2e3870352bf1 tempest-ProjectReaderTests-714592672 None] Lock "cinder-38b8af9a-220c-45b9-9780-7790fa0b9f8d-delete_volume" released by "delete_volume" :: held 1.178s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:41:09 devstack sudo[108013]: pam_unix(sudo:session): session closed for user root Sep 15 16:41:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c3003f32-caa9-4fff-8747-bcd94f81bc3b tempest-ProjectMemberTests-1855156353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-035a1708-5fc0-42ac-86d1-d5209179471e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-035a1708-5fc0-42ac-86d1-d5209179471e.07c69860-edea-43ae-bc5e-501484707398 1G" returned: 0 in 0.414s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:41:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c3003f32-caa9-4fff-8747-bcd94f81bc3b tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-035a1708-5fc0-42ac-86d1-d5209179471e -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-035a1708-5fc0-42ac-86d1-d5209179471e.07c69860-edea-43ae-bc5e-501484707398 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:41:09 devstack sudo[108020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-035a1708-5fc0-42ac-86d1-d5209179471e -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-035a1708-5fc0-42ac-86d1-d5209179471e.07c69860-edea-43ae-bc5e-501484707398 Sep 15 16:41:09 devstack sudo[108020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:41:09 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-95f95af3-e25c-4fd3-8006-a22739122490 tempest-ProjectReaderTests-714592672 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:41:09 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-95f95af3-e25c-4fd3-8006-a22739122490 tempest-ProjectReaderTests-714592672 None] Flow 'volume_create_manager' (fc7d8b00-5b29-45a0-b9ba-a502a1e60bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:41:09 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-95f95af3-e25c-4fd3-8006-a22739122490 tempest-ProjectReaderTests-714592672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85f7f216-b3cf-4337-9f9f-d9da42f79472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:41:09 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-95f95af3-e25c-4fd3-8006-a22739122490 tempest-ProjectReaderTests-714592672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85f7f216-b3cf-4337-9f9f-d9da42f79472) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:41:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-485374141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8f50249-43b3-41af-80d1-4a2f5d470e3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68cde7c8450e4480a0855eacf56861b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:41:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:41:09Z,use_quota=True,user_id='8d100ae259564a538c7bf3f0e0d830cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:41:09 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-95f95af3-e25c-4fd3-8006-a22739122490 tempest-ProjectReaderTests-714592672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (921afc78-9733-44ae-8a29-0973895cc0be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:41:09 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-95f95af3-e25c-4fd3-8006-a22739122490 tempest-ProjectReaderTests-714592672 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (921afc78-9733-44ae-8a29-0973895cc0be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:41:09 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-95f95af3-e25c-4fd3-8006-a22739122490 tempest-ProjectReaderTests-714592672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adbcd6bb-e80e-45c2-b780-86269f71d20f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:41:09 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-95f95af3-e25c-4fd3-8006-a22739122490 tempest-ProjectReaderTests-714592672 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (adbcd6bb-e80e-45c2-b780-86269f71d20f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8f50249-43b3-41af-80d1-4a2f5d470e3c', 'volume_name': 'volume-c8f50249-43b3-41af-80d1-4a2f5d470e3c', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:41:09 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-95f95af3-e25c-4fd3-8006-a22739122490 tempest-ProjectReaderTests-714592672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (262260fb-be01-4a81-a938-fd6437e62391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:41:09 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-95f95af3-e25c-4fd3-8006-a22739122490 tempest-ProjectReaderTests-714592672 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (262260fb-be01-4a81-a938-fd6437e62391) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:41:09 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-95f95af3-e25c-4fd3-8006-a22739122490 tempest-ProjectReaderTests-714592672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed6525b3-ecac-4e2b-b5ca-9ab82877fbe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:41:09 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-95f95af3-e25c-4fd3-8006-a22739122490 tempest-ProjectReaderTests-714592672 None] Volume c8f50249-43b3-41af-80d1-4a2f5d470e3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8f50249-43b3-41af-80d1-4a2f5d470e3c', 'volume_size': 1} Sep 15 16:41:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-95f95af3-e25c-4fd3-8006-a22739122490 tempest-ProjectReaderTests-714592672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:41:09 devstack sudo[108020]: pam_unix(sudo:session): session closed for user root Sep 15 16:41:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c3003f32-caa9-4fff-8747-bcd94f81bc3b tempest-ProjectMemberTests-1855156353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-035a1708-5fc0-42ac-86d1-d5209179471e -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-035a1708-5fc0-42ac-86d1-d5209179471e.07c69860-edea-43ae-bc5e-501484707398" returned: 0 in 0.303s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:41:09 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-c3003f32-caa9-4fff-8747-bcd94f81bc3b tempest-ProjectMemberTests-1855156353 None] /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-035a1708-5fc0-42ac-86d1-d5209179471e.07c69860-edea-43ae-bc5e-501484707398 is being set with open permissions: ugo+rw Sep 15 16:41:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c3003f32-caa9-4fff-8747-bcd94f81bc3b tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-035a1708-5fc0-42ac-86d1-d5209179471e.07c69860-edea-43ae-bc5e-501484707398 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:41:09 devstack sudo[108025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-035a1708-5fc0-42ac-86d1-d5209179471e.07c69860-edea-43ae-bc5e-501484707398 Sep 15 16:41:09 devstack sudo[108025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:41:09 devstack sudo[108025]: pam_unix(sudo:session): session closed for user root Sep 15 16:41:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c3003f32-caa9-4fff-8747-bcd94f81bc3b tempest-ProjectMemberTests-1855156353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-035a1708-5fc0-42ac-86d1-d5209179471e.07c69860-edea-43ae-bc5e-501484707398" returned: 0 in 0.234s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:41:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c3003f32-caa9-4fff-8747-bcd94f81bc3b tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-035a1708-5fc0-42ac-86d1-d5209179471e.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:41:09 devstack sudo[108028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-035a1708-5fc0-42ac-86d1-d5209179471e.info Sep 15 16:41:09 devstack sudo[108028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:41:10 devstack sudo[108028]: pam_unix(sudo:session): session closed for user root Sep 15 16:41:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c3003f32-caa9-4fff-8747-bcd94f81bc3b tempest-ProjectMemberTests-1855156353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-035a1708-5fc0-42ac-86d1-d5209179471e.info" returned: 0 in 0.258s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:41:10 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-c3003f32-caa9-4fff-8747-bcd94f81bc3b tempest-ProjectMemberTests-1855156353 None] /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-035a1708-5fc0-42ac-86d1-d5209179471e.info is being set with open permissions: ugo+rw Sep 15 16:41:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c3003f32-caa9-4fff-8747-bcd94f81bc3b tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-035a1708-5fc0-42ac-86d1-d5209179471e.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:41:10 devstack sudo[108031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-035a1708-5fc0-42ac-86d1-d5209179471e.info Sep 15 16:41:10 devstack sudo[108031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:41:10 devstack sudo[108031]: pam_unix(sudo:session): session closed for user root Sep 15 16:41:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c3003f32-caa9-4fff-8747-bcd94f81bc3b tempest-ProjectMemberTests-1855156353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-035a1708-5fc0-42ac-86d1-d5209179471e.info" returned: 0 in 0.249s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:41:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c3003f32-caa9-4fff-8747-bcd94f81bc3b tempest-ProjectMemberTests-1855156353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.925s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:41:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-95f95af3-e25c-4fd3-8006-a22739122490 tempest-ProjectReaderTests-714592672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.814s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:41:10 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-95f95af3-e25c-4fd3-8006-a22739122490 tempest-ProjectReaderTests-714592672 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:41:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-485374141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8f50249-43b3-41af-80d1-4a2f5d470e3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68cde7c8450e4480a0855eacf56861b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:41:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:41:09Z,use_quota=True,user_id='8d100ae259564a538c7bf3f0e0d830cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:41:10 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-95f95af3-e25c-4fd3-8006-a22739122490 tempest-ProjectReaderTests-714592672 None] Creating volume c8f50249-43b3-41af-80d1-4a2f5d470e3c {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:41:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-95f95af3-e25c-4fd3-8006-a22739122490 tempest-ProjectReaderTests-714592672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:41:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-95f95af3-e25c-4fd3-8006-a22739122490 tempest-ProjectReaderTests-714592672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:41:10 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-95f95af3-e25c-4fd3-8006-a22739122490 tempest-ProjectReaderTests-714592672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:41:10 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-95f95af3-e25c-4fd3-8006-a22739122490 tempest-ProjectReaderTests-714592672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:41:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-95f95af3-e25c-4fd3-8006-a22739122490 tempest-ProjectReaderTests-714592672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:41:10 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-95f95af3-e25c-4fd3-8006-a22739122490 tempest-ProjectReaderTests-714592672 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:41:10 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-95f95af3-e25c-4fd3-8006-a22739122490 tempest-ProjectReaderTests-714592672 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:41:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-95f95af3-e25c-4fd3-8006-a22739122490 tempest-ProjectReaderTests-714592672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c8f50249-43b3-41af-80d1-4a2f5d470e3c 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:41:10 devstack sudo[108034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c8f50249-43b3-41af-80d1-4a2f5d470e3c 1073741824 Sep 15 16:41:10 devstack sudo[108034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:41:10 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-c3003f32-caa9-4fff-8747-bcd94f81bc3b tempest-ProjectMemberTests-1855156353 None] Create snapshot completed successfully Sep 15 16:41:10 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-86948e40-65f0-40a6-968d-80e596d5c5c4 tempest-ProjectMemberTests-1855156353 None] Acquiring lock "cinder-07c69860-edea-43ae-bc5e-501484707398-delete_snapshot" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:41:10 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-86948e40-65f0-40a6-968d-80e596d5c5c4 tempest-ProjectMemberTests-1855156353 None] Lock "cinder-07c69860-edea-43ae-bc5e-501484707398-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:41:10 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-86948e40-65f0-40a6-968d-80e596d5c5c4 tempest-ProjectMemberTests-1855156353 None] Acquiring lock "cinder-quobyte-035a1708-5fc0-42ac-86d1-d5209179471e" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:41:10 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-86948e40-65f0-40a6-968d-80e596d5c5c4 tempest-ProjectMemberTests-1855156353 None] Lock "cinder-quobyte-035a1708-5fc0-42ac-86d1-d5209179471e" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:41:10 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-86948e40-65f0-40a6-968d-80e596d5c5c4 tempest-ProjectMemberTests-1855156353 None] Acquiring lock "cinder-quobyte-07c69860-edea-43ae-bc5e-501484707398" by "_delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:41:10 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-86948e40-65f0-40a6-968d-80e596d5c5c4 tempest-ProjectMemberTests-1855156353 None] Lock "cinder-quobyte-07c69860-edea-43ae-bc5e-501484707398" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:41:10 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-86948e40-65f0-40a6-968d-80e596d5c5c4 tempest-ProjectMemberTests-1855156353 None] Deleting offline snapshot 07c69860-edea-43ae-bc5e-501484707398 of volume 035a1708-5fc0-42ac-86d1-d5209179471e {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 15 16:41:10 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-86948e40-65f0-40a6-968d-80e596d5c5c4 tempest-ProjectMemberTests-1855156353 None] snapshot_file for this snap is: volume-035a1708-5fc0-42ac-86d1-d5209179471e.07c69860-edea-43ae-bc5e-501484707398 {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 15 16:41:10 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4b9f3cd-c9f5-4568-b4bd-9e5ebfc6a300]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:41:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-86948e40-65f0-40a6-968d-80e596d5c5c4 tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-035a1708-5fc0-42ac-86d1-d5209179471e.07c69860-edea-43ae-bc5e-501484707398 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:41:10 devstack sudo[108039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-035a1708-5fc0-42ac-86d1-d5209179471e.07c69860-edea-43ae-bc5e-501484707398 Sep 15 16:41:10 devstack sudo[108039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:41:10 devstack sudo[108034]: pam_unix(sudo:session): session closed for user root Sep 15 16:41:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-95f95af3-e25c-4fd3-8006-a22739122490 tempest-ProjectReaderTests-714592672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c8f50249-43b3-41af-80d1-4a2f5d470e3c 1073741824" returned: 0 in 0.465s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:41:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-95f95af3-e25c-4fd3-8006-a22739122490 tempest-ProjectReaderTests-714592672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c8f50249-43b3-41af-80d1-4a2f5d470e3c {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:41:10 devstack sudo[108041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c8f50249-43b3-41af-80d1-4a2f5d470e3c Sep 15 16:41:10 devstack sudo[108041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:41:11 devstack sudo[108039]: pam_unix(sudo:session): session closed for user root Sep 15 16:41:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-86948e40-65f0-40a6-968d-80e596d5c5c4 tempest-ProjectMemberTests-1855156353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-035a1708-5fc0-42ac-86d1-d5209179471e.07c69860-edea-43ae-bc5e-501484707398" returned: 0 in 0.383s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:41:11 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-86948e40-65f0-40a6-968d-80e596d5c5c4 tempest-ProjectMemberTests-1855156353 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-035a1708-5fc0-42ac-86d1-d5209179471e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 16:41:11 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[01567d55-73a6-49e8-851f-44e6da81a088]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:41:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-86948e40-65f0-40a6-968d-80e596d5c5c4 tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-035a1708-5fc0-42ac-86d1-d5209179471e {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:41:11 devstack sudo[108041]: pam_unix(sudo:session): session closed for user root Sep 15 16:41:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-95f95af3-e25c-4fd3-8006-a22739122490 tempest-ProjectReaderTests-714592672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c8f50249-43b3-41af-80d1-4a2f5d470e3c" returned: 0 in 0.271s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:41:11 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-95f95af3-e25c-4fd3-8006-a22739122490 tempest-ProjectReaderTests-714592672 None] <== create_volume: return (774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:41:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-95f95af3-e25c-4fd3-8006-a22739122490 tempest-ProjectReaderTests-714592672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.778s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:41:11 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-95f95af3-e25c-4fd3-8006-a22739122490 tempest-ProjectReaderTests-714592672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed6525b3-ecac-4e2b-b5ca-9ab82877fbe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8f50249-43b3-41af-80d1-4a2f5d470e3c', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:41:11 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-95f95af3-e25c-4fd3-8006-a22739122490 tempest-ProjectReaderTests-714592672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5da15668-b373-40a2-bf53-6c3ebed379a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:41:11 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-95f95af3-e25c-4fd3-8006-a22739122490 tempest-ProjectReaderTests-714592672 None] Volume volume-c8f50249-43b3-41af-80d1-4a2f5d470e3c (c8f50249-43b3-41af-80d1-4a2f5d470e3c): created successfully Sep 15 16:41:11 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-95f95af3-e25c-4fd3-8006-a22739122490 tempest-ProjectReaderTests-714592672 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5da15668-b373-40a2-bf53-6c3ebed379a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:41:11 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-95f95af3-e25c-4fd3-8006-a22739122490 tempest-ProjectReaderTests-714592672 None] Flow 'volume_create_manager' (fc7d8b00-5b29-45a0-b9ba-a502a1e60bf4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:41:11 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-95f95af3-e25c-4fd3-8006-a22739122490 tempest-ProjectReaderTests-714592672 None] Created volume successfully. Sep 15 16:41:11 devstack sudo[108047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-035a1708-5fc0-42ac-86d1-d5209179471e Sep 15 16:41:11 devstack sudo[108047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:41:11 devstack sudo[108047]: pam_unix(sudo:session): session closed for user root Sep 15 16:41:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-86948e40-65f0-40a6-968d-80e596d5c5c4 tempest-ProjectMemberTests-1855156353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-035a1708-5fc0-42ac-86d1-d5209179471e" returned: 0 in 0.375s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:41:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-86948e40-65f0-40a6-968d-80e596d5c5c4 tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-035a1708-5fc0-42ac-86d1-d5209179471e.07c69860-edea-43ae-bc5e-501484707398 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:41:11 devstack sudo[108052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-035a1708-5fc0-42ac-86d1-d5209179471e.07c69860-edea-43ae-bc5e-501484707398 Sep 15 16:41:11 devstack sudo[108052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:41:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-332b025e-3674-40fd-9d79-c094893ad5db tempest-ProjectReaderTests-714592672 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:41:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-332b025e-3674-40fd-9d79-c094893ad5db tempest-ProjectReaderTests-714592672 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:41:11 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-332b025e-3674-40fd-9d79-c094893ad5db tempest-ProjectReaderTests-714592672 None] Creating offline snapshot b0698d66-9541-4da9-800f-44430956be34 of volume c8f50249-43b3-41af-80d1-4a2f5d470e3c {{(pid=86082) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 15 16:41:11 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[873b8181-86f9-438c-8d0a-30a8d650df0d]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:41:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-332b025e-3674-40fd-9d79-c094893ad5db tempest-ProjectReaderTests-714592672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c8f50249-43b3-41af-80d1-4a2f5d470e3c {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:41:11 devstack sudo[108052]: pam_unix(sudo:session): session closed for user root Sep 15 16:41:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-86948e40-65f0-40a6-968d-80e596d5c5c4 tempest-ProjectMemberTests-1855156353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-035a1708-5fc0-42ac-86d1-d5209179471e.07c69860-edea-43ae-bc5e-501484707398" returned: 0 in 0.357s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:41:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-86948e40-65f0-40a6-968d-80e596d5c5c4 tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-035a1708-5fc0-42ac-86d1-d5209179471e.07c69860-edea-43ae-bc5e-501484707398 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:41:11 devstack sudo[108059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-035a1708-5fc0-42ac-86d1-d5209179471e.07c69860-edea-43ae-bc5e-501484707398 Sep 15 16:41:11 devstack sudo[108059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:41:11 devstack sudo[108057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c8f50249-43b3-41af-80d1-4a2f5d470e3c Sep 15 16:41:11 devstack sudo[108057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:41:12 devstack sudo[108059]: pam_unix(sudo:session): session closed for user root Sep 15 16:41:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-86948e40-65f0-40a6-968d-80e596d5c5c4 tempest-ProjectMemberTests-1855156353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-035a1708-5fc0-42ac-86d1-d5209179471e.07c69860-edea-43ae-bc5e-501484707398" returned: 0 in 0.248s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:41:12 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-86948e40-65f0-40a6-968d-80e596d5c5c4 tempest-ProjectMemberTests-1855156353 None] Lock "cinder-quobyte-07c69860-edea-43ae-bc5e-501484707398" released by "_delete_snapshot" :: held 1.460s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:41:12 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-86948e40-65f0-40a6-968d-80e596d5c5c4 tempest-ProjectMemberTests-1855156353 None] Lock "cinder-quobyte-035a1708-5fc0-42ac-86d1-d5209179471e" released by "delete_snapshot" :: held 1.485s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:41:12 devstack sudo[108057]: pam_unix(sudo:session): session closed for user root Sep 15 16:41:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-332b025e-3674-40fd-9d79-c094893ad5db tempest-ProjectReaderTests-714592672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c8f50249-43b3-41af-80d1-4a2f5d470e3c" returned: 0 in 0.391s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:41:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-332b025e-3674-40fd-9d79-c094893ad5db tempest-ProjectReaderTests-714592672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c8f50249-43b3-41af-80d1-4a2f5d470e3c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c8f50249-43b3-41af-80d1-4a2f5d470e3c.b0698d66-9541-4da9-800f-44430956be34 1G {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:41:12 devstack sudo[108066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c8f50249-43b3-41af-80d1-4a2f5d470e3c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c8f50249-43b3-41af-80d1-4a2f5d470e3c.b0698d66-9541-4da9-800f-44430956be34 1G Sep 15 16:41:12 devstack sudo[108066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:41:12 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-86948e40-65f0-40a6-968d-80e596d5c5c4 tempest-ProjectMemberTests-1855156353 None] Created reservations ['ebf14543-ac22-49bb-ae87-bf0c758cf664', '83f388c7-7092-4068-bd2c-fe931aaa6071', 'e748864b-f473-42b1-b9da-dd76018a7783', '35699d51-0c4a-4f97-842e-85fc1d7a5852'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:41:12 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-86948e40-65f0-40a6-968d-80e596d5c5c4 tempest-ProjectMemberTests-1855156353 None] Delete snapshot completed successfully. Sep 15 16:41:12 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-86948e40-65f0-40a6-968d-80e596d5c5c4 tempest-ProjectMemberTests-1855156353 None] Lock "cinder-07c69860-edea-43ae-bc5e-501484707398-delete_snapshot" released by "delete_snapshot" :: held 1.650s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:41:12 devstack sudo[108066]: pam_unix(sudo:session): session closed for user root Sep 15 16:41:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-332b025e-3674-40fd-9d79-c094893ad5db tempest-ProjectReaderTests-714592672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c8f50249-43b3-41af-80d1-4a2f5d470e3c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c8f50249-43b3-41af-80d1-4a2f5d470e3c.b0698d66-9541-4da9-800f-44430956be34 1G" returned: 0 in 0.392s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:41:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-332b025e-3674-40fd-9d79-c094893ad5db tempest-ProjectReaderTests-714592672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c8f50249-43b3-41af-80d1-4a2f5d470e3c -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c8f50249-43b3-41af-80d1-4a2f5d470e3c.b0698d66-9541-4da9-800f-44430956be34 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:41:12 devstack sudo[108071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c8f50249-43b3-41af-80d1-4a2f5d470e3c -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c8f50249-43b3-41af-80d1-4a2f5d470e3c.b0698d66-9541-4da9-800f-44430956be34 Sep 15 16:41:12 devstack sudo[108071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:41:12 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-5e2147d0-8ebe-424d-9e48-7cee1fe63bbc tempest-ProjectMemberTests-1855156353 None] Acquiring lock "cinder-035a1708-5fc0-42ac-86d1-d5209179471e-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:41:12 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-5e2147d0-8ebe-424d-9e48-7cee1fe63bbc tempest-ProjectMemberTests-1855156353 None] Lock "cinder-035a1708-5fc0-42ac-86d1-d5209179471e-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:41:12 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-5e2147d0-8ebe-424d-9e48-7cee1fe63bbc tempest-ProjectMemberTests-1855156353 None] Acquiring lock "cinder-quobyte-035a1708-5fc0-42ac-86d1-d5209179471e" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:41:12 devstack sudo[108071]: pam_unix(sudo:session): session closed for user root Sep 15 16:41:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-332b025e-3674-40fd-9d79-c094893ad5db tempest-ProjectReaderTests-714592672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c8f50249-43b3-41af-80d1-4a2f5d470e3c -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c8f50249-43b3-41af-80d1-4a2f5d470e3c.b0698d66-9541-4da9-800f-44430956be34" returned: 0 in 0.328s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:41:12 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-332b025e-3674-40fd-9d79-c094893ad5db tempest-ProjectReaderTests-714592672 None] /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c8f50249-43b3-41af-80d1-4a2f5d470e3c.b0698d66-9541-4da9-800f-44430956be34 is being set with open permissions: ugo+rw Sep 15 16:41:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-332b025e-3674-40fd-9d79-c094893ad5db tempest-ProjectReaderTests-714592672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c8f50249-43b3-41af-80d1-4a2f5d470e3c.b0698d66-9541-4da9-800f-44430956be34 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:41:12 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-5e2147d0-8ebe-424d-9e48-7cee1fe63bbc tempest-ProjectMemberTests-1855156353 None] Lock "cinder-quobyte-035a1708-5fc0-42ac-86d1-d5209179471e" acquired by "delete_volume" :: waited 0.026s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:41:12 devstack sudo[108076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c8f50249-43b3-41af-80d1-4a2f5d470e3c.b0698d66-9541-4da9-800f-44430956be34 Sep 15 16:41:12 devstack sudo[108076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:41:12 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6d87149-89f0-4e4d-a3e8-35ea6ce8c4e9]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:41:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5e2147d0-8ebe-424d-9e48-7cee1fe63bbc tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-035a1708-5fc0-42ac-86d1-d5209179471e {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:41:13 devstack sudo[108078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-035a1708-5fc0-42ac-86d1-d5209179471e Sep 15 16:41:13 devstack sudo[108078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:41:13 devstack sudo[108076]: pam_unix(sudo:session): session closed for user root Sep 15 16:41:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-332b025e-3674-40fd-9d79-c094893ad5db tempest-ProjectReaderTests-714592672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c8f50249-43b3-41af-80d1-4a2f5d470e3c.b0698d66-9541-4da9-800f-44430956be34" returned: 0 in 0.251s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:41:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-332b025e-3674-40fd-9d79-c094893ad5db tempest-ProjectReaderTests-714592672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c8f50249-43b3-41af-80d1-4a2f5d470e3c.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:41:13 devstack sudo[108081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c8f50249-43b3-41af-80d1-4a2f5d470e3c.info Sep 15 16:41:13 devstack sudo[108081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:41:13 devstack sudo[108078]: pam_unix(sudo:session): session closed for user root Sep 15 16:41:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5e2147d0-8ebe-424d-9e48-7cee1fe63bbc tempest-ProjectMemberTests-1855156353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-035a1708-5fc0-42ac-86d1-d5209179471e" returned: 0 in 0.392s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:41:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5e2147d0-8ebe-424d-9e48-7cee1fe63bbc tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-035a1708-5fc0-42ac-86d1-d5209179471e {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:41:13 devstack sudo[108086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-035a1708-5fc0-42ac-86d1-d5209179471e Sep 15 16:41:13 devstack sudo[108086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:41:13 devstack sudo[108081]: pam_unix(sudo:session): session closed for user root Sep 15 16:41:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-332b025e-3674-40fd-9d79-c094893ad5db tempest-ProjectReaderTests-714592672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c8f50249-43b3-41af-80d1-4a2f5d470e3c.info" returned: 0 in 0.256s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:41:13 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-332b025e-3674-40fd-9d79-c094893ad5db tempest-ProjectReaderTests-714592672 None] /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c8f50249-43b3-41af-80d1-4a2f5d470e3c.info is being set with open permissions: ugo+rw Sep 15 16:41:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-332b025e-3674-40fd-9d79-c094893ad5db tempest-ProjectReaderTests-714592672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c8f50249-43b3-41af-80d1-4a2f5d470e3c.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:41:13 devstack sudo[108089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c8f50249-43b3-41af-80d1-4a2f5d470e3c.info Sep 15 16:41:13 devstack sudo[108089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:41:13 devstack sudo[108086]: pam_unix(sudo:session): session closed for user root Sep 15 16:41:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5e2147d0-8ebe-424d-9e48-7cee1fe63bbc tempest-ProjectMemberTests-1855156353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-035a1708-5fc0-42ac-86d1-d5209179471e" returned: 0 in 0.255s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:41:13 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-5e2147d0-8ebe-424d-9e48-7cee1fe63bbc tempest-ProjectMemberTests-1855156353 None] Lock "cinder-quobyte-035a1708-5fc0-42ac-86d1-d5209179471e" released by "delete_volume" :: held 0.713s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:41:13 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-5e2147d0-8ebe-424d-9e48-7cee1fe63bbc tempest-ProjectMemberTests-1855156353 None] Created reservations ['13360b82-e1f1-4c2e-90d0-d236209c175a', '0a8fe67d-55eb-4657-96de-f7f03e582501', '4f04ccdf-d4bd-4a9c-9d7a-cc0c93102cdb', 'c8ac9707-2ab1-4cea-a5f0-f1ee86f4da69'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:41:13 devstack sudo[108089]: pam_unix(sudo:session): session closed for user root Sep 15 16:41:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-332b025e-3674-40fd-9d79-c094893ad5db tempest-ProjectReaderTests-714592672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c8f50249-43b3-41af-80d1-4a2f5d470e3c.info" returned: 0 in 0.263s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:41:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-332b025e-3674-40fd-9d79-c094893ad5db tempest-ProjectReaderTests-714592672 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.961s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:41:13 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-332b025e-3674-40fd-9d79-c094893ad5db tempest-ProjectReaderTests-714592672 None] Create snapshot completed successfully Sep 15 16:41:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-5e2147d0-8ebe-424d-9e48-7cee1fe63bbc tempest-ProjectMemberTests-1855156353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:41:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-5e2147d0-8ebe-424d-9e48-7cee1fe63bbc tempest-ProjectMemberTests-1855156353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:41:13 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-5e2147d0-8ebe-424d-9e48-7cee1fe63bbc tempest-ProjectMemberTests-1855156353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:41:13 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-5e2147d0-8ebe-424d-9e48-7cee1fe63bbc tempest-ProjectMemberTests-1855156353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:41:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-5e2147d0-8ebe-424d-9e48-7cee1fe63bbc tempest-ProjectMemberTests-1855156353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:41:13 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5e2147d0-8ebe-424d-9e48-7cee1fe63bbc tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:41:13 devstack sudo[108093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:41:13 devstack sudo[108093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:41:13 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-48ef7fa9-9a3c-44b2-9935-dc62aa2c6820 tempest-ProjectReaderTests-714592672 None] Acquiring lock "cinder-b0698d66-9541-4da9-800f-44430956be34-delete_snapshot" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:41:13 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-48ef7fa9-9a3c-44b2-9935-dc62aa2c6820 tempest-ProjectReaderTests-714592672 None] Lock "cinder-b0698d66-9541-4da9-800f-44430956be34-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:41:13 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-48ef7fa9-9a3c-44b2-9935-dc62aa2c6820 tempest-ProjectReaderTests-714592672 None] Acquiring lock "cinder-quobyte-c8f50249-43b3-41af-80d1-4a2f5d470e3c" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:41:13 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-48ef7fa9-9a3c-44b2-9935-dc62aa2c6820 tempest-ProjectReaderTests-714592672 None] Lock "cinder-quobyte-c8f50249-43b3-41af-80d1-4a2f5d470e3c" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:41:13 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-48ef7fa9-9a3c-44b2-9935-dc62aa2c6820 tempest-ProjectReaderTests-714592672 None] Acquiring lock "cinder-quobyte-b0698d66-9541-4da9-800f-44430956be34" by "_delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:41:13 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-48ef7fa9-9a3c-44b2-9935-dc62aa2c6820 tempest-ProjectReaderTests-714592672 None] Lock "cinder-quobyte-b0698d66-9541-4da9-800f-44430956be34" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:41:13 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-48ef7fa9-9a3c-44b2-9935-dc62aa2c6820 tempest-ProjectReaderTests-714592672 None] Deleting offline snapshot b0698d66-9541-4da9-800f-44430956be34 of volume c8f50249-43b3-41af-80d1-4a2f5d470e3c {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 15 16:41:13 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-48ef7fa9-9a3c-44b2-9935-dc62aa2c6820 tempest-ProjectReaderTests-714592672 None] snapshot_file for this snap is: volume-c8f50249-43b3-41af-80d1-4a2f5d470e3c.b0698d66-9541-4da9-800f-44430956be34 {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 15 16:41:14 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[166941a1-08ff-42cb-ba53-fd27ebf202b1]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:41:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-48ef7fa9-9a3c-44b2-9935-dc62aa2c6820 tempest-ProjectReaderTests-714592672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c8f50249-43b3-41af-80d1-4a2f5d470e3c.b0698d66-9541-4da9-800f-44430956be34 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:41:14 devstack sudo[108093]: pam_unix(sudo:session): session closed for user root Sep 15 16:41:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-5e2147d0-8ebe-424d-9e48-7cee1fe63bbc tempest-ProjectMemberTests-1855156353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.305s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:41:14 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-5e2147d0-8ebe-424d-9e48-7cee1fe63bbc tempest-ProjectMemberTests-1855156353 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:41:14 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-5e2147d0-8ebe-424d-9e48-7cee1fe63bbc tempest-ProjectMemberTests-1855156353 None] Deleted volume successfully. Sep 15 16:41:14 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-5e2147d0-8ebe-424d-9e48-7cee1fe63bbc tempest-ProjectMemberTests-1855156353 None] Lock "cinder-035a1708-5fc0-42ac-86d1-d5209179471e-delete_volume" released by "delete_volume" :: held 1.301s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:41:14 devstack sudo[108095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c8f50249-43b3-41af-80d1-4a2f5d470e3c.b0698d66-9541-4da9-800f-44430956be34 Sep 15 16:41:14 devstack sudo[108095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:41:14 devstack sudo[108095]: pam_unix(sudo:session): session closed for user root Sep 15 16:41:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-48ef7fa9-9a3c-44b2-9935-dc62aa2c6820 tempest-ProjectReaderTests-714592672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c8f50249-43b3-41af-80d1-4a2f5d470e3c.b0698d66-9541-4da9-800f-44430956be34" returned: 0 in 0.414s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:41:14 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-48ef7fa9-9a3c-44b2-9935-dc62aa2c6820 tempest-ProjectReaderTests-714592672 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c8f50249-43b3-41af-80d1-4a2f5d470e3c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 16:41:14 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[132105c1-60fe-4018-8312-c6bdce657cec]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:41:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-48ef7fa9-9a3c-44b2-9935-dc62aa2c6820 tempest-ProjectReaderTests-714592672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c8f50249-43b3-41af-80d1-4a2f5d470e3c {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:41:14 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-7436765c-fb2c-4e72-a54b-f7047a63f6f7 tempest-ProjectMemberTests-1855156353 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:41:14 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7436765c-fb2c-4e72-a54b-f7047a63f6f7 tempest-ProjectMemberTests-1855156353 None] Flow 'volume_create_manager' (859e6a0f-ab62-4a7e-b53f-becac32a3ac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:41:14 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7436765c-fb2c-4e72-a54b-f7047a63f6f7 tempest-ProjectMemberTests-1855156353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8581773c-1e0e-40a2-b096-7c7249376590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:41:14 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7436765c-fb2c-4e72-a54b-f7047a63f6f7 tempest-ProjectMemberTests-1855156353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8581773c-1e0e-40a2-b096-7c7249376590) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:41:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1337282543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57ee4f2d-26e8-4a70-9674-6bb759ee39ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a303ec1076004f4db43523c2f7b6a446',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:41:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:41:14Z,use_quota=True,user_id='d9953555b80c481b9eaabbc7d416d0b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:41:14 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7436765c-fb2c-4e72-a54b-f7047a63f6f7 tempest-ProjectMemberTests-1855156353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9947e4c7-63b0-4b02-80e5-57faed9dff8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:41:14 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7436765c-fb2c-4e72-a54b-f7047a63f6f7 tempest-ProjectMemberTests-1855156353 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9947e4c7-63b0-4b02-80e5-57faed9dff8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:41:14 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7436765c-fb2c-4e72-a54b-f7047a63f6f7 tempest-ProjectMemberTests-1855156353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81a0177c-57cd-440b-9b18-016d48586b9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:41:14 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7436765c-fb2c-4e72-a54b-f7047a63f6f7 tempest-ProjectMemberTests-1855156353 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81a0177c-57cd-440b-9b18-016d48586b9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57ee4f2d-26e8-4a70-9674-6bb759ee39ad', 'volume_name': 'volume-57ee4f2d-26e8-4a70-9674-6bb759ee39ad', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:41:14 devstack sudo[108101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c8f50249-43b3-41af-80d1-4a2f5d470e3c Sep 15 16:41:14 devstack sudo[108101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:41:14 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7436765c-fb2c-4e72-a54b-f7047a63f6f7 tempest-ProjectMemberTests-1855156353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88a81e22-8907-41fe-a4db-b52cd30bc44e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:41:14 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7436765c-fb2c-4e72-a54b-f7047a63f6f7 tempest-ProjectMemberTests-1855156353 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88a81e22-8907-41fe-a4db-b52cd30bc44e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:41:14 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7436765c-fb2c-4e72-a54b-f7047a63f6f7 tempest-ProjectMemberTests-1855156353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7c488a5-b84e-421d-98c2-e101ebe91f1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:41:14 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-7436765c-fb2c-4e72-a54b-f7047a63f6f7 tempest-ProjectMemberTests-1855156353 None] Volume 57ee4f2d-26e8-4a70-9674-6bb759ee39ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57ee4f2d-26e8-4a70-9674-6bb759ee39ad', 'volume_size': 1} Sep 15 16:41:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-7436765c-fb2c-4e72-a54b-f7047a63f6f7 tempest-ProjectMemberTests-1855156353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:41:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-7436765c-fb2c-4e72-a54b-f7047a63f6f7 tempest-ProjectMemberTests-1855156353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:41:14 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-7436765c-fb2c-4e72-a54b-f7047a63f6f7 tempest-ProjectMemberTests-1855156353 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:41:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1337282543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57ee4f2d-26e8-4a70-9674-6bb759ee39ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a303ec1076004f4db43523c2f7b6a446',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:41:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:41:14Z,use_quota=True,user_id='d9953555b80c481b9eaabbc7d416d0b2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:41:14 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-7436765c-fb2c-4e72-a54b-f7047a63f6f7 tempest-ProjectMemberTests-1855156353 None] Creating volume 57ee4f2d-26e8-4a70-9674-6bb759ee39ad {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:41:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-7436765c-fb2c-4e72-a54b-f7047a63f6f7 tempest-ProjectMemberTests-1855156353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:41:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-7436765c-fb2c-4e72-a54b-f7047a63f6f7 tempest-ProjectMemberTests-1855156353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:41:14 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-7436765c-fb2c-4e72-a54b-f7047a63f6f7 tempest-ProjectMemberTests-1855156353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:41:14 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-7436765c-fb2c-4e72-a54b-f7047a63f6f7 tempest-ProjectMemberTests-1855156353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:41:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-7436765c-fb2c-4e72-a54b-f7047a63f6f7 tempest-ProjectMemberTests-1855156353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:41:14 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-7436765c-fb2c-4e72-a54b-f7047a63f6f7 tempest-ProjectMemberTests-1855156353 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:41:14 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-7436765c-fb2c-4e72-a54b-f7047a63f6f7 tempest-ProjectMemberTests-1855156353 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:41:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7436765c-fb2c-4e72-a54b-f7047a63f6f7 tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-57ee4f2d-26e8-4a70-9674-6bb759ee39ad 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:41:14 devstack sudo[108103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-57ee4f2d-26e8-4a70-9674-6bb759ee39ad 1073741824 Sep 15 16:41:14 devstack sudo[108103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:41:14 devstack sudo[108101]: pam_unix(sudo:session): session closed for user root Sep 15 16:41:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-48ef7fa9-9a3c-44b2-9935-dc62aa2c6820 tempest-ProjectReaderTests-714592672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c8f50249-43b3-41af-80d1-4a2f5d470e3c" returned: 0 in 0.369s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:41:14 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-48ef7fa9-9a3c-44b2-9935-dc62aa2c6820 tempest-ProjectReaderTests-714592672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c8f50249-43b3-41af-80d1-4a2f5d470e3c.b0698d66-9541-4da9-800f-44430956be34 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:41:14 devstack sudo[108110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c8f50249-43b3-41af-80d1-4a2f5d470e3c.b0698d66-9541-4da9-800f-44430956be34 Sep 15 16:41:14 devstack sudo[108110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:41:15 devstack sudo[108103]: pam_unix(sudo:session): session closed for user root Sep 15 16:41:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7436765c-fb2c-4e72-a54b-f7047a63f6f7 tempest-ProjectMemberTests-1855156353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-57ee4f2d-26e8-4a70-9674-6bb759ee39ad 1073741824" returned: 0 in 0.459s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:41:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7436765c-fb2c-4e72-a54b-f7047a63f6f7 tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-57ee4f2d-26e8-4a70-9674-6bb759ee39ad {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:41:15 devstack sudo[108115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-57ee4f2d-26e8-4a70-9674-6bb759ee39ad Sep 15 16:41:15 devstack sudo[108115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:41:15 devstack sudo[108110]: pam_unix(sudo:session): session closed for user root Sep 15 16:41:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-48ef7fa9-9a3c-44b2-9935-dc62aa2c6820 tempest-ProjectReaderTests-714592672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c8f50249-43b3-41af-80d1-4a2f5d470e3c.b0698d66-9541-4da9-800f-44430956be34" returned: 0 in 0.368s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:41:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-48ef7fa9-9a3c-44b2-9935-dc62aa2c6820 tempest-ProjectReaderTests-714592672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c8f50249-43b3-41af-80d1-4a2f5d470e3c.b0698d66-9541-4da9-800f-44430956be34 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:41:15 devstack sudo[108119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c8f50249-43b3-41af-80d1-4a2f5d470e3c.b0698d66-9541-4da9-800f-44430956be34 Sep 15 16:41:15 devstack sudo[108119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:41:15 devstack sudo[108115]: pam_unix(sudo:session): session closed for user root Sep 15 16:41:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7436765c-fb2c-4e72-a54b-f7047a63f6f7 tempest-ProjectMemberTests-1855156353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-57ee4f2d-26e8-4a70-9674-6bb759ee39ad" returned: 0 in 0.256s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:41:15 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-7436765c-fb2c-4e72-a54b-f7047a63f6f7 tempest-ProjectMemberTests-1855156353 None] <== create_volume: return (758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:41:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-7436765c-fb2c-4e72-a54b-f7047a63f6f7 tempest-ProjectMemberTests-1855156353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.760s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:41:15 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7436765c-fb2c-4e72-a54b-f7047a63f6f7 tempest-ProjectMemberTests-1855156353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7c488a5-b84e-421d-98c2-e101ebe91f1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57ee4f2d-26e8-4a70-9674-6bb759ee39ad', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:41:15 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7436765c-fb2c-4e72-a54b-f7047a63f6f7 tempest-ProjectMemberTests-1855156353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e47c063f-5a14-4e29-93c2-a3fee2de472e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:41:15 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-7436765c-fb2c-4e72-a54b-f7047a63f6f7 tempest-ProjectMemberTests-1855156353 None] Volume volume-57ee4f2d-26e8-4a70-9674-6bb759ee39ad (57ee4f2d-26e8-4a70-9674-6bb759ee39ad): created successfully Sep 15 16:41:15 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7436765c-fb2c-4e72-a54b-f7047a63f6f7 tempest-ProjectMemberTests-1855156353 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e47c063f-5a14-4e29-93c2-a3fee2de472e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:41:15 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-7436765c-fb2c-4e72-a54b-f7047a63f6f7 tempest-ProjectMemberTests-1855156353 None] Flow 'volume_create_manager' (859e6a0f-ab62-4a7e-b53f-becac32a3ac8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:41:15 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-7436765c-fb2c-4e72-a54b-f7047a63f6f7 tempest-ProjectMemberTests-1855156353 None] Created volume successfully. Sep 15 16:41:15 devstack sudo[108119]: pam_unix(sudo:session): session closed for user root Sep 15 16:41:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-48ef7fa9-9a3c-44b2-9935-dc62aa2c6820 tempest-ProjectReaderTests-714592672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c8f50249-43b3-41af-80d1-4a2f5d470e3c.b0698d66-9541-4da9-800f-44430956be34" returned: 0 in 0.275s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:41:15 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-48ef7fa9-9a3c-44b2-9935-dc62aa2c6820 tempest-ProjectReaderTests-714592672 None] Lock "cinder-quobyte-b0698d66-9541-4da9-800f-44430956be34" released by "_delete_snapshot" :: held 1.543s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:41:15 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-48ef7fa9-9a3c-44b2-9935-dc62aa2c6820 tempest-ProjectReaderTests-714592672 None] Lock "cinder-quobyte-c8f50249-43b3-41af-80d1-4a2f5d470e3c" released by "delete_snapshot" :: held 1.569s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:41:15 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-48ef7fa9-9a3c-44b2-9935-dc62aa2c6820 tempest-ProjectReaderTests-714592672 None] Created reservations ['6497f1e3-030f-47be-a619-34a2f587e9f3', 'e16789ca-bf78-4990-afcf-a6914963260b', '05cf1ef9-fdb6-4b83-b62e-4424c676850d', '26112d52-3d77-429c-b49f-53092f6d093e'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:41:15 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-48ef7fa9-9a3c-44b2-9935-dc62aa2c6820 tempest-ProjectReaderTests-714592672 None] Delete snapshot completed successfully. Sep 15 16:41:15 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-48ef7fa9-9a3c-44b2-9935-dc62aa2c6820 tempest-ProjectReaderTests-714592672 None] Lock "cinder-b0698d66-9541-4da9-800f-44430956be34-delete_snapshot" released by "delete_snapshot" :: held 1.722s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:41:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f1724a63-f859-405a-9169-05bea9bb4df2 tempest-ProjectMemberTests-1855156353 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:41:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f1724a63-f859-405a-9169-05bea9bb4df2 tempest-ProjectMemberTests-1855156353 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:41:15 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-f1724a63-f859-405a-9169-05bea9bb4df2 tempest-ProjectMemberTests-1855156353 None] Creating offline snapshot 9ffb7d03-d0b4-4a97-84fb-ab8f09a50665 of volume 57ee4f2d-26e8-4a70-9674-6bb759ee39ad {{(pid=86082) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 15 16:41:15 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a2767a3-78db-4039-8662-9be3a7350de2]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:41:15 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f1724a63-f859-405a-9169-05bea9bb4df2 tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-57ee4f2d-26e8-4a70-9674-6bb759ee39ad {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:41:15 devstack sudo[108123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-57ee4f2d-26e8-4a70-9674-6bb759ee39ad Sep 15 16:41:15 devstack sudo[108123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:41:16 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-646eee36-9a13-40c3-9b49-2ef9f2896e18 tempest-ProjectReaderTests-714592672 None] Acquiring lock "cinder-c8f50249-43b3-41af-80d1-4a2f5d470e3c-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:41:16 devstack sudo[108123]: pam_unix(sudo:session): session closed for user root Sep 15 16:41:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f1724a63-f859-405a-9169-05bea9bb4df2 tempest-ProjectMemberTests-1855156353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-57ee4f2d-26e8-4a70-9674-6bb759ee39ad" returned: 0 in 0.362s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:41:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f1724a63-f859-405a-9169-05bea9bb4df2 tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-57ee4f2d-26e8-4a70-9674-6bb759ee39ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-57ee4f2d-26e8-4a70-9674-6bb759ee39ad.9ffb7d03-d0b4-4a97-84fb-ab8f09a50665 1G {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:41:16 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-646eee36-9a13-40c3-9b49-2ef9f2896e18 tempest-ProjectReaderTests-714592672 None] Lock "cinder-c8f50249-43b3-41af-80d1-4a2f5d470e3c-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:41:16 devstack sudo[108128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-57ee4f2d-26e8-4a70-9674-6bb759ee39ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-57ee4f2d-26e8-4a70-9674-6bb759ee39ad.9ffb7d03-d0b4-4a97-84fb-ab8f09a50665 1G Sep 15 16:41:16 devstack sudo[108128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:41:16 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-646eee36-9a13-40c3-9b49-2ef9f2896e18 tempest-ProjectReaderTests-714592672 None] Acquiring lock "cinder-quobyte-c8f50249-43b3-41af-80d1-4a2f5d470e3c" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:41:16 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-646eee36-9a13-40c3-9b49-2ef9f2896e18 tempest-ProjectReaderTests-714592672 None] Lock "cinder-quobyte-c8f50249-43b3-41af-80d1-4a2f5d470e3c" acquired by "delete_volume" :: waited 0.018s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:41:16 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[5849271d-7c0a-4e83-b9cb-81af214b1813]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:41:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-646eee36-9a13-40c3-9b49-2ef9f2896e18 tempest-ProjectReaderTests-714592672 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c8f50249-43b3-41af-80d1-4a2f5d470e3c {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:41:16 devstack sudo[108130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c8f50249-43b3-41af-80d1-4a2f5d470e3c Sep 15 16:41:16 devstack sudo[108130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:41:16 devstack sudo[108128]: pam_unix(sudo:session): session closed for user root Sep 15 16:41:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f1724a63-f859-405a-9169-05bea9bb4df2 tempest-ProjectMemberTests-1855156353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-57ee4f2d-26e8-4a70-9674-6bb759ee39ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-57ee4f2d-26e8-4a70-9674-6bb759ee39ad.9ffb7d03-d0b4-4a97-84fb-ab8f09a50665 1G" returned: 0 in 0.425s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:41:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f1724a63-f859-405a-9169-05bea9bb4df2 tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57ee4f2d-26e8-4a70-9674-6bb759ee39ad -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-57ee4f2d-26e8-4a70-9674-6bb759ee39ad.9ffb7d03-d0b4-4a97-84fb-ab8f09a50665 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:41:16 devstack sudo[108135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57ee4f2d-26e8-4a70-9674-6bb759ee39ad -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-57ee4f2d-26e8-4a70-9674-6bb759ee39ad.9ffb7d03-d0b4-4a97-84fb-ab8f09a50665 Sep 15 16:41:16 devstack sudo[108135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:41:16 devstack sudo[108130]: pam_unix(sudo:session): session closed for user root Sep 15 16:41:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-646eee36-9a13-40c3-9b49-2ef9f2896e18 tempest-ProjectReaderTests-714592672 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c8f50249-43b3-41af-80d1-4a2f5d470e3c" returned: 0 in 0.410s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:41:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-646eee36-9a13-40c3-9b49-2ef9f2896e18 tempest-ProjectReaderTests-714592672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c8f50249-43b3-41af-80d1-4a2f5d470e3c {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:41:16 devstack sudo[108140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c8f50249-43b3-41af-80d1-4a2f5d470e3c Sep 15 16:41:16 devstack sudo[108140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:41:16 devstack sudo[108135]: pam_unix(sudo:session): session closed for user root Sep 15 16:41:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f1724a63-f859-405a-9169-05bea9bb4df2 tempest-ProjectMemberTests-1855156353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57ee4f2d-26e8-4a70-9674-6bb759ee39ad -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-57ee4f2d-26e8-4a70-9674-6bb759ee39ad.9ffb7d03-d0b4-4a97-84fb-ab8f09a50665" returned: 0 in 0.296s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:41:16 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-f1724a63-f859-405a-9169-05bea9bb4df2 tempest-ProjectMemberTests-1855156353 None] /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-57ee4f2d-26e8-4a70-9674-6bb759ee39ad.9ffb7d03-d0b4-4a97-84fb-ab8f09a50665 is being set with open permissions: ugo+rw Sep 15 16:41:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f1724a63-f859-405a-9169-05bea9bb4df2 tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-57ee4f2d-26e8-4a70-9674-6bb759ee39ad.9ffb7d03-d0b4-4a97-84fb-ab8f09a50665 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:41:16 devstack sudo[108145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-57ee4f2d-26e8-4a70-9674-6bb759ee39ad.9ffb7d03-d0b4-4a97-84fb-ab8f09a50665 Sep 15 16:41:16 devstack sudo[108145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:41:16 devstack sudo[108140]: pam_unix(sudo:session): session closed for user root Sep 15 16:41:16 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-646eee36-9a13-40c3-9b49-2ef9f2896e18 tempest-ProjectReaderTests-714592672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-c8f50249-43b3-41af-80d1-4a2f5d470e3c" returned: 0 in 0.282s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:41:16 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-646eee36-9a13-40c3-9b49-2ef9f2896e18 tempest-ProjectReaderTests-714592672 None] Lock "cinder-quobyte-c8f50249-43b3-41af-80d1-4a2f5d470e3c" released by "delete_volume" :: held 0.759s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:41:16 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-646eee36-9a13-40c3-9b49-2ef9f2896e18 tempest-ProjectReaderTests-714592672 None] Created reservations ['0137f34f-84e5-4b1b-905c-0ce30a741e71', '2ef1981a-9009-4b43-ae7f-cf81de89eb40', '824d899b-0951-4524-8b0f-b829dac43f1c', '9e83df8a-c000-4ca6-937b-22cbca3ec7b7'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:41:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-646eee36-9a13-40c3-9b49-2ef9f2896e18 tempest-ProjectReaderTests-714592672 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:41:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-646eee36-9a13-40c3-9b49-2ef9f2896e18 tempest-ProjectReaderTests-714592672 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:41:17 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-646eee36-9a13-40c3-9b49-2ef9f2896e18 tempest-ProjectReaderTests-714592672 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:41:17 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-646eee36-9a13-40c3-9b49-2ef9f2896e18 tempest-ProjectReaderTests-714592672 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:41:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-646eee36-9a13-40c3-9b49-2ef9f2896e18 tempest-ProjectReaderTests-714592672 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:41:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-646eee36-9a13-40c3-9b49-2ef9f2896e18 tempest-ProjectReaderTests-714592672 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:41:17 devstack sudo[108149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:41:17 devstack sudo[108149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:41:17 devstack sudo[108145]: pam_unix(sudo:session): session closed for user root Sep 15 16:41:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f1724a63-f859-405a-9169-05bea9bb4df2 tempest-ProjectMemberTests-1855156353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-57ee4f2d-26e8-4a70-9674-6bb759ee39ad.9ffb7d03-d0b4-4a97-84fb-ab8f09a50665" returned: 0 in 0.281s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:41:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f1724a63-f859-405a-9169-05bea9bb4df2 tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-57ee4f2d-26e8-4a70-9674-6bb759ee39ad.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:41:17 devstack sudo[108151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-57ee4f2d-26e8-4a70-9674-6bb759ee39ad.info Sep 15 16:41:17 devstack sudo[108151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:41:17 devstack sudo[108149]: pam_unix(sudo:session): session closed for user root Sep 15 16:41:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-646eee36-9a13-40c3-9b49-2ef9f2896e18 tempest-ProjectReaderTests-714592672 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.285s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:41:17 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-646eee36-9a13-40c3-9b49-2ef9f2896e18 tempest-ProjectReaderTests-714592672 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:41:17 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-646eee36-9a13-40c3-9b49-2ef9f2896e18 tempest-ProjectReaderTests-714592672 None] Deleted volume successfully. Sep 15 16:41:17 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-646eee36-9a13-40c3-9b49-2ef9f2896e18 tempest-ProjectReaderTests-714592672 None] Lock "cinder-c8f50249-43b3-41af-80d1-4a2f5d470e3c-delete_volume" released by "delete_volume" :: held 1.254s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:41:17 devstack sudo[108151]: pam_unix(sudo:session): session closed for user root Sep 15 16:41:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f1724a63-f859-405a-9169-05bea9bb4df2 tempest-ProjectMemberTests-1855156353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-57ee4f2d-26e8-4a70-9674-6bb759ee39ad.info" returned: 0 in 0.285s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:41:17 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-f1724a63-f859-405a-9169-05bea9bb4df2 tempest-ProjectMemberTests-1855156353 None] /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-57ee4f2d-26e8-4a70-9674-6bb759ee39ad.info is being set with open permissions: ugo+rw Sep 15 16:41:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f1724a63-f859-405a-9169-05bea9bb4df2 tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-57ee4f2d-26e8-4a70-9674-6bb759ee39ad.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:41:17 devstack sudo[108156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-57ee4f2d-26e8-4a70-9674-6bb759ee39ad.info Sep 15 16:41:17 devstack sudo[108156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:41:17 devstack sudo[108156]: pam_unix(sudo:session): session closed for user root Sep 15 16:41:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-f1724a63-f859-405a-9169-05bea9bb4df2 tempest-ProjectMemberTests-1855156353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-57ee4f2d-26e8-4a70-9674-6bb759ee39ad.info" returned: 0 in 0.242s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:41:17 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-f1724a63-f859-405a-9169-05bea9bb4df2 tempest-ProjectMemberTests-1855156353 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.979s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:41:17 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-f1724a63-f859-405a-9169-05bea9bb4df2 tempest-ProjectMemberTests-1855156353 None] Create snapshot completed successfully Sep 15 16:41:17 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-defd0ece-5420-4c22-a36c-078bf0babb40 tempest-ProjectMemberTests-1855156353 None] Acquiring lock "cinder-9ffb7d03-d0b4-4a97-84fb-ab8f09a50665-delete_snapshot" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:41:17 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-defd0ece-5420-4c22-a36c-078bf0babb40 tempest-ProjectMemberTests-1855156353 None] Lock "cinder-9ffb7d03-d0b4-4a97-84fb-ab8f09a50665-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:41:17 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-defd0ece-5420-4c22-a36c-078bf0babb40 tempest-ProjectMemberTests-1855156353 None] Acquiring lock "cinder-quobyte-57ee4f2d-26e8-4a70-9674-6bb759ee39ad" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:41:17 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-defd0ece-5420-4c22-a36c-078bf0babb40 tempest-ProjectMemberTests-1855156353 None] Lock "cinder-quobyte-57ee4f2d-26e8-4a70-9674-6bb759ee39ad" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:41:17 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-defd0ece-5420-4c22-a36c-078bf0babb40 tempest-ProjectMemberTests-1855156353 None] Acquiring lock "cinder-quobyte-9ffb7d03-d0b4-4a97-84fb-ab8f09a50665" by "_delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:41:18 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-defd0ece-5420-4c22-a36c-078bf0babb40 tempest-ProjectMemberTests-1855156353 None] Lock "cinder-quobyte-9ffb7d03-d0b4-4a97-84fb-ab8f09a50665" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:41:18 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-defd0ece-5420-4c22-a36c-078bf0babb40 tempest-ProjectMemberTests-1855156353 None] Deleting offline snapshot 9ffb7d03-d0b4-4a97-84fb-ab8f09a50665 of volume 57ee4f2d-26e8-4a70-9674-6bb759ee39ad {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 15 16:41:18 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-defd0ece-5420-4c22-a36c-078bf0babb40 tempest-ProjectMemberTests-1855156353 None] snapshot_file for this snap is: volume-57ee4f2d-26e8-4a70-9674-6bb759ee39ad.9ffb7d03-d0b4-4a97-84fb-ab8f09a50665 {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 15 16:41:18 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7d393af-3d01-4d79-9fb1-b07822c5a056]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:41:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-defd0ece-5420-4c22-a36c-078bf0babb40 tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-57ee4f2d-26e8-4a70-9674-6bb759ee39ad.9ffb7d03-d0b4-4a97-84fb-ab8f09a50665 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:41:18 devstack sudo[108159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-57ee4f2d-26e8-4a70-9674-6bb759ee39ad.9ffb7d03-d0b4-4a97-84fb-ab8f09a50665 Sep 15 16:41:18 devstack sudo[108159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:41:18 devstack sudo[108159]: pam_unix(sudo:session): session closed for user root Sep 15 16:41:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-defd0ece-5420-4c22-a36c-078bf0babb40 tempest-ProjectMemberTests-1855156353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-57ee4f2d-26e8-4a70-9674-6bb759ee39ad.9ffb7d03-d0b4-4a97-84fb-ab8f09a50665" returned: 0 in 0.438s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:41:18 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-defd0ece-5420-4c22-a36c-078bf0babb40 tempest-ProjectMemberTests-1855156353 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-57ee4f2d-26e8-4a70-9674-6bb759ee39ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 16:41:18 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[efe1e593-5b52-4761-97a4-1c3c0e7e7680]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:41:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-defd0ece-5420-4c22-a36c-078bf0babb40 tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-57ee4f2d-26e8-4a70-9674-6bb759ee39ad {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:41:18 devstack sudo[108165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-57ee4f2d-26e8-4a70-9674-6bb759ee39ad Sep 15 16:41:18 devstack sudo[108165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:41:18 devstack sudo[108165]: pam_unix(sudo:session): session closed for user root Sep 15 16:41:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-defd0ece-5420-4c22-a36c-078bf0babb40 tempest-ProjectMemberTests-1855156353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-57ee4f2d-26e8-4a70-9674-6bb759ee39ad" returned: 0 in 0.382s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:41:18 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-defd0ece-5420-4c22-a36c-078bf0babb40 tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-57ee4f2d-26e8-4a70-9674-6bb759ee39ad.9ffb7d03-d0b4-4a97-84fb-ab8f09a50665 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:41:18 devstack sudo[108170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-57ee4f2d-26e8-4a70-9674-6bb759ee39ad.9ffb7d03-d0b4-4a97-84fb-ab8f09a50665 Sep 15 16:41:18 devstack sudo[108170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:41:19 devstack sudo[108170]: pam_unix(sudo:session): session closed for user root Sep 15 16:41:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-defd0ece-5420-4c22-a36c-078bf0babb40 tempest-ProjectMemberTests-1855156353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-57ee4f2d-26e8-4a70-9674-6bb759ee39ad.9ffb7d03-d0b4-4a97-84fb-ab8f09a50665" returned: 0 in 0.357s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:41:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-defd0ece-5420-4c22-a36c-078bf0babb40 tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-57ee4f2d-26e8-4a70-9674-6bb759ee39ad.9ffb7d03-d0b4-4a97-84fb-ab8f09a50665 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:41:19 devstack sudo[108176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-57ee4f2d-26e8-4a70-9674-6bb759ee39ad.9ffb7d03-d0b4-4a97-84fb-ab8f09a50665 Sep 15 16:41:19 devstack sudo[108176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:41:19 devstack sudo[108176]: pam_unix(sudo:session): session closed for user root Sep 15 16:41:19 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-defd0ece-5420-4c22-a36c-078bf0babb40 tempest-ProjectMemberTests-1855156353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-57ee4f2d-26e8-4a70-9674-6bb759ee39ad.9ffb7d03-d0b4-4a97-84fb-ab8f09a50665" returned: 0 in 0.255s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:41:19 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-defd0ece-5420-4c22-a36c-078bf0babb40 tempest-ProjectMemberTests-1855156353 None] Lock "cinder-quobyte-9ffb7d03-d0b4-4a97-84fb-ab8f09a50665" released by "_delete_snapshot" :: held 1.565s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:41:19 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-defd0ece-5420-4c22-a36c-078bf0babb40 tempest-ProjectMemberTests-1855156353 None] Lock "cinder-quobyte-57ee4f2d-26e8-4a70-9674-6bb759ee39ad" released by "delete_snapshot" :: held 1.589s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:41:19 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:SELECT=204,cinder:INSERT=74,cinder:UPDATE=291,cinder:DELETE=17 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 16:41:19 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:UPDATE=285,cinder:DELETE=32,cinder:SELECT=225,cinder:INSERT=80 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 16:41:19 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-defd0ece-5420-4c22-a36c-078bf0babb40 tempest-ProjectMemberTests-1855156353 None] Created reservations ['720e082e-a11d-4252-91a1-ff27646965a8', '044c9037-fc71-4d5b-8d9b-b8f90398eabe', '6b71588f-7202-48a2-b80f-a4adb8c425e1', '06780a6a-bf91-4ff2-a9eb-fbbad53c8326'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:41:19 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-defd0ece-5420-4c22-a36c-078bf0babb40 tempest-ProjectMemberTests-1855156353 None] Delete snapshot completed successfully. Sep 15 16:41:19 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-defd0ece-5420-4c22-a36c-078bf0babb40 tempest-ProjectMemberTests-1855156353 None] Lock "cinder-9ffb7d03-d0b4-4a97-84fb-ab8f09a50665-delete_snapshot" released by "delete_snapshot" :: held 1.745s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:41:20 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-d2d6ccca-7f29-474a-8f4b-5587dff7c157 tempest-ProjectMemberTests-1855156353 None] Acquiring lock "cinder-57ee4f2d-26e8-4a70-9674-6bb759ee39ad-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:41:20 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-d2d6ccca-7f29-474a-8f4b-5587dff7c157 tempest-ProjectMemberTests-1855156353 None] Lock "cinder-57ee4f2d-26e8-4a70-9674-6bb759ee39ad-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:41:20 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-d2d6ccca-7f29-474a-8f4b-5587dff7c157 tempest-ProjectMemberTests-1855156353 None] Acquiring lock "cinder-quobyte-57ee4f2d-26e8-4a70-9674-6bb759ee39ad" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:41:20 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-d2d6ccca-7f29-474a-8f4b-5587dff7c157 tempest-ProjectMemberTests-1855156353 None] Lock "cinder-quobyte-57ee4f2d-26e8-4a70-9674-6bb759ee39ad" acquired by "delete_volume" :: waited 0.022s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:41:20 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[20f4a081-eac5-41b0-ae7b-fc74c3e46e4b]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:41:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d2d6ccca-7f29-474a-8f4b-5587dff7c157 tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-57ee4f2d-26e8-4a70-9674-6bb759ee39ad {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:41:20 devstack sudo[108179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-57ee4f2d-26e8-4a70-9674-6bb759ee39ad Sep 15 16:41:20 devstack sudo[108179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:41:20 devstack sudo[108179]: pam_unix(sudo:session): session closed for user root Sep 15 16:41:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d2d6ccca-7f29-474a-8f4b-5587dff7c157 tempest-ProjectMemberTests-1855156353 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-57ee4f2d-26e8-4a70-9674-6bb759ee39ad" returned: 0 in 0.390s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:41:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d2d6ccca-7f29-474a-8f4b-5587dff7c157 tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-57ee4f2d-26e8-4a70-9674-6bb759ee39ad {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:41:20 devstack sudo[108198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-57ee4f2d-26e8-4a70-9674-6bb759ee39ad Sep 15 16:41:20 devstack sudo[108198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:41:20 devstack sudo[108198]: pam_unix(sudo:session): session closed for user root Sep 15 16:41:20 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d2d6ccca-7f29-474a-8f4b-5587dff7c157 tempest-ProjectMemberTests-1855156353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-57ee4f2d-26e8-4a70-9674-6bb759ee39ad" returned: 0 in 0.265s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:41:20 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-d2d6ccca-7f29-474a-8f4b-5587dff7c157 tempest-ProjectMemberTests-1855156353 None] Lock "cinder-quobyte-57ee4f2d-26e8-4a70-9674-6bb759ee39ad" released by "delete_volume" :: held 0.722s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:41:20 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-d2d6ccca-7f29-474a-8f4b-5587dff7c157 tempest-ProjectMemberTests-1855156353 None] Created reservations ['feab110c-c00f-4393-83f7-95e2b059da90', '7a95439d-e8f0-4b9e-b6fb-5eff364106b3', '2ba6f8ec-4a25-41e0-801c-a935a131305d', 'e11881eb-59b3-4116-b50b-149be398d588'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:41:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-d2d6ccca-7f29-474a-8f4b-5587dff7c157 tempest-ProjectMemberTests-1855156353 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:41:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-d2d6ccca-7f29-474a-8f4b-5587dff7c157 tempest-ProjectMemberTests-1855156353 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:41:21 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-d2d6ccca-7f29-474a-8f4b-5587dff7c157 tempest-ProjectMemberTests-1855156353 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:41:21 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-d2d6ccca-7f29-474a-8f4b-5587dff7c157 tempest-ProjectMemberTests-1855156353 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:41:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-d2d6ccca-7f29-474a-8f4b-5587dff7c157 tempest-ProjectMemberTests-1855156353 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:41:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d2d6ccca-7f29-474a-8f4b-5587dff7c157 tempest-ProjectMemberTests-1855156353 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:41:21 devstack sudo[108223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:41:21 devstack sudo[108223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:41:21 devstack sudo[108223]: pam_unix(sudo:session): session closed for user root Sep 15 16:41:21 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-d2d6ccca-7f29-474a-8f4b-5587dff7c157 tempest-ProjectMemberTests-1855156353 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.257s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:41:21 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-d2d6ccca-7f29-474a-8f4b-5587dff7c157 tempest-ProjectMemberTests-1855156353 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:41:21 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-d2d6ccca-7f29-474a-8f4b-5587dff7c157 tempest-ProjectMemberTests-1855156353 None] Deleted volume successfully. Sep 15 16:41:21 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-d2d6ccca-7f29-474a-8f4b-5587dff7c157 tempest-ProjectMemberTests-1855156353 None] Lock "cinder-57ee4f2d-26e8-4a70-9674-6bb759ee39ad-delete_volume" released by "delete_volume" :: held 1.193s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:41:31 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:SELECT=11,cinder:INSERT=3,cinder:UPDATE=15 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 16:41:31 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:INSERT=5,cinder:UPDATE=12,cinder:SELECT=6,cinder:DELETE=1 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 16:41:51 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:SELECT=1 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 16:41:51 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:UPDATE=1 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 16:41:56 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-c84a6d18-1083-476f-8701-7eb673134a04 tempest-SnapshotDependencyTests-459979785 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:41:56 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c84a6d18-1083-476f-8701-7eb673134a04 tempest-SnapshotDependencyTests-459979785 None] Flow 'volume_create_manager' (0b3061a6-76b8-4ef5-9d78-85375e42fa24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:41:56 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c84a6d18-1083-476f-8701-7eb673134a04 tempest-SnapshotDependencyTests-459979785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7d2ebff-18fb-496c-be32-8f005c9d93e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:41:56 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c84a6d18-1083-476f-8701-7eb673134a04 tempest-SnapshotDependencyTests-459979785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7d2ebff-18fb-496c-be32-8f005c9d93e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:41:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1048776795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1798c48a-e458-429d-95ec-43a43e8c2355,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cb0bcdab42c4c5db25412f66b807f01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:41:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:41:57Z,use_quota=True,user_id='4e0951c33dbe4a66b18b5d2fadd0e95a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:41:56 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c84a6d18-1083-476f-8701-7eb673134a04 tempest-SnapshotDependencyTests-459979785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (300a7d5e-e1fb-49df-9aa4-786c67208fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:41:56 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c84a6d18-1083-476f-8701-7eb673134a04 tempest-SnapshotDependencyTests-459979785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (300a7d5e-e1fb-49df-9aa4-786c67208fc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:41:56 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c84a6d18-1083-476f-8701-7eb673134a04 tempest-SnapshotDependencyTests-459979785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e21e7806-dde6-47ad-b5df-89cf31d3d780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:41:56 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c84a6d18-1083-476f-8701-7eb673134a04 tempest-SnapshotDependencyTests-459979785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e21e7806-dde6-47ad-b5df-89cf31d3d780) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1798c48a-e458-429d-95ec-43a43e8c2355', 'volume_name': 'volume-1798c48a-e458-429d-95ec-43a43e8c2355', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:41:56 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c84a6d18-1083-476f-8701-7eb673134a04 tempest-SnapshotDependencyTests-459979785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7ff8aa4-ea62-4162-9be7-700b1eb8ef54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:41:56 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c84a6d18-1083-476f-8701-7eb673134a04 tempest-SnapshotDependencyTests-459979785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7ff8aa4-ea62-4162-9be7-700b1eb8ef54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:41:56 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c84a6d18-1083-476f-8701-7eb673134a04 tempest-SnapshotDependencyTests-459979785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aed16620-7714-417b-aa60-c5818ef9feb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:41:56 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-c84a6d18-1083-476f-8701-7eb673134a04 tempest-SnapshotDependencyTests-459979785 None] Volume 1798c48a-e458-429d-95ec-43a43e8c2355: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1798c48a-e458-429d-95ec-43a43e8c2355', 'volume_size': 1} Sep 15 16:41:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c84a6d18-1083-476f-8701-7eb673134a04 tempest-SnapshotDependencyTests-459979785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:41:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c84a6d18-1083-476f-8701-7eb673134a04 tempest-SnapshotDependencyTests-459979785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:41:56 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c84a6d18-1083-476f-8701-7eb673134a04 tempest-SnapshotDependencyTests-459979785 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:41:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1048776795',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1798c48a-e458-429d-95ec-43a43e8c2355,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cb0bcdab42c4c5db25412f66b807f01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:41:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:41:57Z,use_quota=True,user_id='4e0951c33dbe4a66b18b5d2fadd0e95a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)}" {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 15 16:41:56 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-c84a6d18-1083-476f-8701-7eb673134a04 tempest-SnapshotDependencyTests-459979785 None] Creating volume 1798c48a-e458-429d-95ec-43a43e8c2355 {{(pid=86082) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 15 16:41:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c84a6d18-1083-476f-8701-7eb673134a04 tempest-SnapshotDependencyTests-459979785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:41:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c84a6d18-1083-476f-8701-7eb673134a04 tempest-SnapshotDependencyTests-459979785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:41:56 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c84a6d18-1083-476f-8701-7eb673134a04 tempest-SnapshotDependencyTests-459979785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:41:56 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c84a6d18-1083-476f-8701-7eb673134a04 tempest-SnapshotDependencyTests-459979785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:41:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c84a6d18-1083-476f-8701-7eb673134a04 tempest-SnapshotDependencyTests-459979785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:41:56 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c84a6d18-1083-476f-8701-7eb673134a04 tempest-SnapshotDependencyTests-459979785 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:41:56 devstack cinder-volume[86082]: INFO cinder.volume.drivers.remotefs [None req-c84a6d18-1083-476f-8701-7eb673134a04 tempest-SnapshotDependencyTests-459979785 None] casted to osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a Sep 15 16:41:56 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c84a6d18-1083-476f-8701-7eb673134a04 tempest-SnapshotDependencyTests-459979785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1798c48a-e458-429d-95ec-43a43e8c2355 1073741824 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:41:56 devstack sudo[108243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1798c48a-e458-429d-95ec-43a43e8c2355 1073741824 Sep 15 16:41:56 devstack sudo[108243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:41:57 devstack sudo[108243]: pam_unix(sudo:session): session closed for user root Sep 15 16:41:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c84a6d18-1083-476f-8701-7eb673134a04 tempest-SnapshotDependencyTests-459979785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1798c48a-e458-429d-95ec-43a43e8c2355 1073741824" returned: 0 in 0.426s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:41:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c84a6d18-1083-476f-8701-7eb673134a04 tempest-SnapshotDependencyTests-459979785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1798c48a-e458-429d-95ec-43a43e8c2355 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:41:57 devstack sudo[108249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1798c48a-e458-429d-95ec-43a43e8c2355 Sep 15 16:41:57 devstack sudo[108249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:41:57 devstack sudo[108249]: pam_unix(sudo:session): session closed for user root Sep 15 16:41:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c84a6d18-1083-476f-8701-7eb673134a04 tempest-SnapshotDependencyTests-459979785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1798c48a-e458-429d-95ec-43a43e8c2355" returned: 0 in 0.250s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:41:57 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c84a6d18-1083-476f-8701-7eb673134a04 tempest-SnapshotDependencyTests-459979785 None] <== create_volume: return (717ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'} {{(pid=86082) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 15 16:41:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c84a6d18-1083-476f-8701-7eb673134a04 tempest-SnapshotDependencyTests-459979785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.720s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:41:57 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c84a6d18-1083-476f-8701-7eb673134a04 tempest-SnapshotDependencyTests-459979785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aed16620-7714-417b-aa60-c5818ef9feb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1798c48a-e458-429d-95ec-43a43e8c2355', 'volume_size': 1}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:41:57 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c84a6d18-1083-476f-8701-7eb673134a04 tempest-SnapshotDependencyTests-459979785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (467f8609-0779-4666-a4a4-0fd2ecd65b32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:41:57 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-c84a6d18-1083-476f-8701-7eb673134a04 tempest-SnapshotDependencyTests-459979785 None] Volume volume-1798c48a-e458-429d-95ec-43a43e8c2355 (1798c48a-e458-429d-95ec-43a43e8c2355): created successfully Sep 15 16:41:57 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c84a6d18-1083-476f-8701-7eb673134a04 tempest-SnapshotDependencyTests-459979785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (467f8609-0779-4666-a4a4-0fd2ecd65b32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:41:57 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c84a6d18-1083-476f-8701-7eb673134a04 tempest-SnapshotDependencyTests-459979785 None] Flow 'volume_create_manager' (0b3061a6-76b8-4ef5-9d78-85375e42fa24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:41:57 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-c84a6d18-1083-476f-8701-7eb673134a04 tempest-SnapshotDependencyTests-459979785 None] Created volume successfully. Sep 15 16:41:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-7745823e-8041-438e-b112-63bc92e8d108 tempest-SnapshotDependencyTests-459979785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:41:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-7745823e-8041-438e-b112-63bc92e8d108 tempest-SnapshotDependencyTests-459979785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:41:57 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-7745823e-8041-438e-b112-63bc92e8d108 tempest-SnapshotDependencyTests-459979785 None] Creating offline snapshot 41c1489a-67a8-4486-91c8-6d049feaca7c of volume 1798c48a-e458-429d-95ec-43a43e8c2355 {{(pid=86082) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 15 16:41:57 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[504568d0-58d8-4431-8f59-6f33b9c99dfe]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:41:57 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7745823e-8041-438e-b112-63bc92e8d108 tempest-SnapshotDependencyTests-459979785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1798c48a-e458-429d-95ec-43a43e8c2355 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:41:57 devstack sudo[108253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1798c48a-e458-429d-95ec-43a43e8c2355 Sep 15 16:41:57 devstack sudo[108253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:41:58 devstack sudo[108253]: pam_unix(sudo:session): session closed for user root Sep 15 16:41:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7745823e-8041-438e-b112-63bc92e8d108 tempest-SnapshotDependencyTests-459979785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1798c48a-e458-429d-95ec-43a43e8c2355" returned: 0 in 0.358s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:41:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7745823e-8041-438e-b112-63bc92e8d108 tempest-SnapshotDependencyTests-459979785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1798c48a-e458-429d-95ec-43a43e8c2355,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1798c48a-e458-429d-95ec-43a43e8c2355.41c1489a-67a8-4486-91c8-6d049feaca7c 1G {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:41:58 devstack sudo[108258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1798c48a-e458-429d-95ec-43a43e8c2355,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1798c48a-e458-429d-95ec-43a43e8c2355.41c1489a-67a8-4486-91c8-6d049feaca7c 1G Sep 15 16:41:58 devstack sudo[108258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:41:58 devstack sudo[108258]: pam_unix(sudo:session): session closed for user root Sep 15 16:41:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7745823e-8041-438e-b112-63bc92e8d108 tempest-SnapshotDependencyTests-459979785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1798c48a-e458-429d-95ec-43a43e8c2355,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1798c48a-e458-429d-95ec-43a43e8c2355.41c1489a-67a8-4486-91c8-6d049feaca7c 1G" returned: 0 in 0.396s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:41:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7745823e-8041-438e-b112-63bc92e8d108 tempest-SnapshotDependencyTests-459979785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1798c48a-e458-429d-95ec-43a43e8c2355 -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1798c48a-e458-429d-95ec-43a43e8c2355.41c1489a-67a8-4486-91c8-6d049feaca7c {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:41:58 devstack sudo[108264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1798c48a-e458-429d-95ec-43a43e8c2355 -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1798c48a-e458-429d-95ec-43a43e8c2355.41c1489a-67a8-4486-91c8-6d049feaca7c Sep 15 16:41:58 devstack sudo[108264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:41:58 devstack sudo[108264]: pam_unix(sudo:session): session closed for user root Sep 15 16:41:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7745823e-8041-438e-b112-63bc92e8d108 tempest-SnapshotDependencyTests-459979785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1798c48a-e458-429d-95ec-43a43e8c2355 -F qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1798c48a-e458-429d-95ec-43a43e8c2355.41c1489a-67a8-4486-91c8-6d049feaca7c" returned: 0 in 0.287s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:41:58 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-7745823e-8041-438e-b112-63bc92e8d108 tempest-SnapshotDependencyTests-459979785 None] /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1798c48a-e458-429d-95ec-43a43e8c2355.41c1489a-67a8-4486-91c8-6d049feaca7c is being set with open permissions: ugo+rw Sep 15 16:41:58 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7745823e-8041-438e-b112-63bc92e8d108 tempest-SnapshotDependencyTests-459979785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1798c48a-e458-429d-95ec-43a43e8c2355.41c1489a-67a8-4486-91c8-6d049feaca7c {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:41:58 devstack sudo[108269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1798c48a-e458-429d-95ec-43a43e8c2355.41c1489a-67a8-4486-91c8-6d049feaca7c Sep 15 16:41:58 devstack sudo[108269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:41:59 devstack sudo[108269]: pam_unix(sudo:session): session closed for user root Sep 15 16:41:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7745823e-8041-438e-b112-63bc92e8d108 tempest-SnapshotDependencyTests-459979785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1798c48a-e458-429d-95ec-43a43e8c2355.41c1489a-67a8-4486-91c8-6d049feaca7c" returned: 0 in 0.246s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:41:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7745823e-8041-438e-b112-63bc92e8d108 tempest-SnapshotDependencyTests-459979785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1798c48a-e458-429d-95ec-43a43e8c2355.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:41:59 devstack sudo[108272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1798c48a-e458-429d-95ec-43a43e8c2355.info Sep 15 16:41:59 devstack sudo[108272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:41:59 devstack sudo[108272]: pam_unix(sudo:session): session closed for user root Sep 15 16:41:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7745823e-8041-438e-b112-63bc92e8d108 tempest-SnapshotDependencyTests-459979785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1798c48a-e458-429d-95ec-43a43e8c2355.info" returned: 0 in 0.248s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:41:59 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-7745823e-8041-438e-b112-63bc92e8d108 tempest-SnapshotDependencyTests-459979785 None] /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1798c48a-e458-429d-95ec-43a43e8c2355.info is being set with open permissions: ugo+rw Sep 15 16:41:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7745823e-8041-438e-b112-63bc92e8d108 tempest-SnapshotDependencyTests-459979785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1798c48a-e458-429d-95ec-43a43e8c2355.info {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:41:59 devstack sudo[108275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1798c48a-e458-429d-95ec-43a43e8c2355.info Sep 15 16:41:59 devstack sudo[108275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:41:59 devstack sudo[108275]: pam_unix(sudo:session): session closed for user root Sep 15 16:41:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-7745823e-8041-438e-b112-63bc92e8d108 tempest-SnapshotDependencyTests-459979785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1798c48a-e458-429d-95ec-43a43e8c2355.info" returned: 0 in 0.244s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:41:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-7745823e-8041-438e-b112-63bc92e8d108 tempest-SnapshotDependencyTests-459979785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.870s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:41:59 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-7745823e-8041-438e-b112-63bc92e8d108 tempest-SnapshotDependencyTests-459979785 None] Create snapshot completed successfully Sep 15 16:41:59 devstack cinder-volume[86082]: DEBUG oslo_service.periodic_task [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86082) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 15 16:41:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:41:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:41:59 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:41:59 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:41:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:41:59 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:41:59 devstack sudo[108278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:41:59 devstack sudo[108278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:42:00 devstack sudo[108278]: pam_unix(sudo:session): session closed for user root Sep 15 16:42:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.273s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:42:00 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:42:00 devstack cinder-volume[86082]: DEBUG oslo_service.periodic_task [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] Running periodic task VolumeManager._thread_info {{(pid=86082) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 15 16:42:00 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] thread count: 29 {{(pid=86082) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 15 16:42:00 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-c1e37657-4021-4a58-8569-76154ff382b4 None None] thread info: [<_MainThread(MainThread, started 124875935469696)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86082) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 15 16:42:00 devstack cinder-volume[86082]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccd31fb1-e14f-41ad-9354-2683da34d8b2 tempest-SnapshotDependencyTests-459979785 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86082) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 15 16:42:00 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ccd31fb1-e14f-41ad-9354-2683da34d8b2 tempest-SnapshotDependencyTests-459979785 None] Flow 'volume_create_manager' (bc7b6bf8-ba86-45b4-b11e-ee2e705deb9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:42:00 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ccd31fb1-e14f-41ad-9354-2683da34d8b2 tempest-SnapshotDependencyTests-459979785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bc06d80-256d-464f-bbf0-f991ff4f421c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:42:00 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ccd31fb1-e14f-41ad-9354-2683da34d8b2 tempest-SnapshotDependencyTests-459979785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bc06d80-256d-464f-bbf0-f991ff4f421c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-15T14:42:00Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fac96ec-c766-4a53-a4b4-53d8f3b22a1d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0cb0bcdab42c4c5db25412f66b807f01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-15T14:42:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=41c1489a-67a8-4486-91c8-6d049feaca7c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-15T14:42:00Z,use_quota=True,user_id='4e0951c33dbe4a66b18b5d2fadd0e95a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e41e3096-6c15-483f-be63-cc18db6152b4),volume_type_id=e41e3096-6c15-483f-be63-cc18db6152b4)' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:42:00 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ccd31fb1-e14f-41ad-9354-2683da34d8b2 tempest-SnapshotDependencyTests-459979785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfecbe7b-70e4-4879-8f31-f00de2992351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:42:00 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ccd31fb1-e14f-41ad-9354-2683da34d8b2 tempest-SnapshotDependencyTests-459979785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bfecbe7b-70e4-4879-8f31-f00de2992351) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:42:00 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ccd31fb1-e14f-41ad-9354-2683da34d8b2 tempest-SnapshotDependencyTests-459979785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b00ad579-2dd5-40ea-a77d-2d6bed4876fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:42:00 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ccd31fb1-e14f-41ad-9354-2683da34d8b2 tempest-SnapshotDependencyTests-459979785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b00ad579-2dd5-40ea-a77d-2d6bed4876fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2fac96ec-c766-4a53-a4b4-53d8f3b22a1d', 'volume_name': 'volume-2fac96ec-c766-4a53-a4b4-53d8f3b22a1d', 'volume_size': 1, 'snapshot_id': '41c1489a-67a8-4486-91c8-6d049feaca7c'}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:42:00 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ccd31fb1-e14f-41ad-9354-2683da34d8b2 tempest-SnapshotDependencyTests-459979785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5220890b-573b-4fb6-973f-53df6fea6abe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:42:00 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ccd31fb1-e14f-41ad-9354-2683da34d8b2 tempest-SnapshotDependencyTests-459979785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5220890b-573b-4fb6-973f-53df6fea6abe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:42:00 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ccd31fb1-e14f-41ad-9354-2683da34d8b2 tempest-SnapshotDependencyTests-459979785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fa08be9-2978-43c6-aea8-1bdd0e0dbb20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:42:00 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-ccd31fb1-e14f-41ad-9354-2683da34d8b2 tempest-SnapshotDependencyTests-459979785 None] Volume 2fac96ec-c766-4a53-a4b4-53d8f3b22a1d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2fac96ec-c766-4a53-a4b4-53d8f3b22a1d', 'volume_size': 1, 'snapshot_id': '41c1489a-67a8-4486-91c8-6d049feaca7c'} Sep 15 16:42:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-ccd31fb1-e14f-41ad-9354-2683da34d8b2 tempest-SnapshotDependencyTests-459979785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:42:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-ccd31fb1-e14f-41ad-9354-2683da34d8b2 tempest-SnapshotDependencyTests-459979785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:42:00 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-ccd31fb1-e14f-41ad-9354-2683da34d8b2 tempest-SnapshotDependencyTests-459979785 None] Acquiring lock "cinder-quobyte-41c1489a-67a8-4486-91c8-6d049feaca7c-2fac96ec-c766-4a53-a4b4-53d8f3b22a1d" by "_create_volume_from_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:42:00 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-ccd31fb1-e14f-41ad-9354-2683da34d8b2 tempest-SnapshotDependencyTests-459979785 None] Lock "cinder-quobyte-41c1489a-67a8-4486-91c8-6d049feaca7c-2fac96ec-c766-4a53-a4b4-53d8f3b22a1d" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:42:00 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-ccd31fb1-e14f-41ad-9354-2683da34d8b2 tempest-SnapshotDependencyTests-459979785 None] Creating volume 2fac96ec-c766-4a53-a4b4-53d8f3b22a1d from snapshot 41c1489a-67a8-4486-91c8-6d049feaca7c {{(pid=86082) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 15 16:42:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-ccd31fb1-e14f-41ad-9354-2683da34d8b2 tempest-SnapshotDependencyTests-459979785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:42:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-ccd31fb1-e14f-41ad-9354-2683da34d8b2 tempest-SnapshotDependencyTests-459979785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:42:00 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-ccd31fb1-e14f-41ad-9354-2683da34d8b2 tempest-SnapshotDependencyTests-459979785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:42:00 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-ccd31fb1-e14f-41ad-9354-2683da34d8b2 tempest-SnapshotDependencyTests-459979785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:42:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-ccd31fb1-e14f-41ad-9354-2683da34d8b2 tempest-SnapshotDependencyTests-459979785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:42:00 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-ccd31fb1-e14f-41ad-9354-2683da34d8b2 tempest-SnapshotDependencyTests-459979785 None] Selected osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a as target Quobyte volume. {{(pid=86082) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 15 16:42:00 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-ccd31fb1-e14f-41ad-9354-2683da34d8b2 tempest-SnapshotDependencyTests-459979785 None] Acquiring lock "cinder-quobyte-2fac96ec-c766-4a53-a4b4-53d8f3b22a1d" by "_copy_volume_from_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:42:00 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-ccd31fb1-e14f-41ad-9354-2683da34d8b2 tempest-SnapshotDependencyTests-459979785 None] Lock "cinder-quobyte-2fac96ec-c766-4a53-a4b4-53d8f3b22a1d" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:42:00 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-ccd31fb1-e14f-41ad-9354-2683da34d8b2 tempest-SnapshotDependencyTests-459979785 None] snapshot: 41c1489a-67a8-4486-91c8-6d049feaca7c, volume: 2fac96ec-c766-4a53-a4b4-53d8f3b22a1d, {{(pid=86082) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 15 16:42:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-ccd31fb1-e14f-41ad-9354-2683da34d8b2 tempest-SnapshotDependencyTests-459979785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:42:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-ccd31fb1-e14f-41ad-9354-2683da34d8b2 tempest-SnapshotDependencyTests-459979785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:42:00 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-ccd31fb1-e14f-41ad-9354-2683da34d8b2 tempest-SnapshotDependencyTests-459979785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:42:00 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-ccd31fb1-e14f-41ad-9354-2683da34d8b2 tempest-SnapshotDependencyTests-459979785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:42:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-ccd31fb1-e14f-41ad-9354-2683da34d8b2 tempest-SnapshotDependencyTests-459979785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:42:00 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[06fc67d3-9473-417e-a192-4e2fdf01bf40]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:42:00 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ccd31fb1-e14f-41ad-9354-2683da34d8b2 tempest-SnapshotDependencyTests-459979785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1798c48a-e458-429d-95ec-43a43e8c2355.41c1489a-67a8-4486-91c8-6d049feaca7c {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:42:00 devstack sudo[108281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1798c48a-e458-429d-95ec-43a43e8c2355.41c1489a-67a8-4486-91c8-6d049feaca7c Sep 15 16:42:00 devstack sudo[108281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:42:01 devstack sudo[108281]: pam_unix(sudo:session): session closed for user root Sep 15 16:42:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ccd31fb1-e14f-41ad-9354-2683da34d8b2 tempest-SnapshotDependencyTests-459979785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1798c48a-e458-429d-95ec-43a43e8c2355.41c1489a-67a8-4486-91c8-6d049feaca7c" returned: 0 in 0.353s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:42:01 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-ccd31fb1-e14f-41ad-9354-2683da34d8b2 tempest-SnapshotDependencyTests-459979785 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1798c48a-e458-429d-95ec-43a43e8c2355(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 16:42:01 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b8a6fa9-4a6d-4015-847c-a440f615a0b3]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:42:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ccd31fb1-e14f-41ad-9354-2683da34d8b2 tempest-SnapshotDependencyTests-459979785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1798c48a-e458-429d-95ec-43a43e8c2355 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:42:01 devstack sudo[108286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1798c48a-e458-429d-95ec-43a43e8c2355 Sep 15 16:42:01 devstack sudo[108286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:42:01 devstack sudo[108286]: pam_unix(sudo:session): session closed for user root Sep 15 16:42:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ccd31fb1-e14f-41ad-9354-2683da34d8b2 tempest-SnapshotDependencyTests-459979785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1798c48a-e458-429d-95ec-43a43e8c2355" returned: 0 in 0.354s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:42:01 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-ccd31fb1-e14f-41ad-9354-2683da34d8b2 tempest-SnapshotDependencyTests-459979785 None] will copy from snapshot at /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1798c48a-e458-429d-95ec-43a43e8c2355 {{(pid=86082) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 15 16:42:01 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-ccd31fb1-e14f-41ad-9354-2683da34d8b2 tempest-SnapshotDependencyTests-459979785 None] Creating direct copy from snapshot {{(pid=86082) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 15 16:42:01 devstack cinder-volume[86082]: DEBUG cinder.utils [None req-ccd31fb1-e14f-41ad-9354-2683da34d8b2 tempest-SnapshotDependencyTests-459979785 None] Path /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2fac96ec-c766-4a53-a4b4-53d8f3b22a1d not found in is_blk_device check {{(pid=86082) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 15 16:42:01 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ccd31fb1-e14f-41ad-9354-2683da34d8b2 tempest-SnapshotDependencyTests-459979785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1798c48a-e458-429d-95ec-43a43e8c2355 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2fac96ec-c766-4a53-a4b4-53d8f3b22a1d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:42:01 devstack sudo[108291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1798c48a-e458-429d-95ec-43a43e8c2355 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2fac96ec-c766-4a53-a4b4-53d8f3b22a1d Sep 15 16:42:01 devstack sudo[108291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:42:07 devstack sudo[108291]: pam_unix(sudo:session): session closed for user root Sep 15 16:42:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ccd31fb1-e14f-41ad-9354-2683da34d8b2 tempest-SnapshotDependencyTests-459979785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1798c48a-e458-429d-95ec-43a43e8c2355 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2fac96ec-c766-4a53-a4b4-53d8f3b22a1d" returned: 0 in 5.789s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:42:07 devstack cinder-volume[86082]: DEBUG cinder.image.image_utils [None req-ccd31fb1-e14f-41ad-9354-2683da34d8b2 tempest-SnapshotDependencyTests-459979785 None] Image conversion details: src /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1798c48a-e458-429d-95ec-43a43e8c2355, size 1024.00 MB, duration 5.79 sec, destination /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2fac96ec-c766-4a53-a4b4-53d8f3b22a1d {{(pid=86082) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 15 16:42:07 devstack cinder-volume[86082]: INFO cinder.image.image_utils [None req-ccd31fb1-e14f-41ad-9354-2683da34d8b2 tempest-SnapshotDependencyTests-459979785 None] Converted 1024.00 MB image at 176.84 MB/s Sep 15 16:42:07 devstack cinder-volume[86082]: WARNING cinder.volume.drivers.remotefs [None req-ccd31fb1-e14f-41ad-9354-2683da34d8b2 tempest-SnapshotDependencyTests-459979785 None] /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2fac96ec-c766-4a53-a4b4-53d8f3b22a1d is being set with open permissions: ugo+rw Sep 15 16:42:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ccd31fb1-e14f-41ad-9354-2683da34d8b2 tempest-SnapshotDependencyTests-459979785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2fac96ec-c766-4a53-a4b4-53d8f3b22a1d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:42:07 devstack sudo[108305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2fac96ec-c766-4a53-a4b4-53d8f3b22a1d Sep 15 16:42:07 devstack sudo[108305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:42:07 devstack sudo[108305]: pam_unix(sudo:session): session closed for user root Sep 15 16:42:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-ccd31fb1-e14f-41ad-9354-2683da34d8b2 tempest-SnapshotDependencyTests-459979785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2fac96ec-c766-4a53-a4b4-53d8f3b22a1d" returned: 0 in 0.236s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:42:07 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-ccd31fb1-e14f-41ad-9354-2683da34d8b2 tempest-SnapshotDependencyTests-459979785 None] Lock "cinder-quobyte-2fac96ec-c766-4a53-a4b4-53d8f3b22a1d" released by "_copy_volume_from_snapshot" :: held 6.817s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:42:07 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-ccd31fb1-e14f-41ad-9354-2683da34d8b2 tempest-SnapshotDependencyTests-459979785 None] Lock "cinder-quobyte-41c1489a-67a8-4486-91c8-6d049feaca7c-2fac96ec-c766-4a53-a4b4-53d8f3b22a1d" released by "_create_volume_from_snapshot" :: held 6.874s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:42:07 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-ccd31fb1-e14f-41ad-9354-2683da34d8b2 tempest-SnapshotDependencyTests-459979785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.889s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:42:07 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ccd31fb1-e14f-41ad-9354-2683da34d8b2 tempest-SnapshotDependencyTests-459979785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fa08be9-2978-43c6-aea8-1bdd0e0dbb20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fac96ec-c766-4a53-a4b4-53d8f3b22a1d', 'volume_size': 1, 'snapshot_id': '41c1489a-67a8-4486-91c8-6d049feaca7c'}' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:42:07 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ccd31fb1-e14f-41ad-9354-2683da34d8b2 tempest-SnapshotDependencyTests-459979785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b0c3188-9432-4515-9c75-c975e9cc8d35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 15 16:42:07 devstack cinder-volume[86082]: INFO cinder.volume.flows.manager.create_volume [None req-ccd31fb1-e14f-41ad-9354-2683da34d8b2 tempest-SnapshotDependencyTests-459979785 None] Volume volume-2fac96ec-c766-4a53-a4b4-53d8f3b22a1d (2fac96ec-c766-4a53-a4b4-53d8f3b22a1d): created successfully Sep 15 16:42:07 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ccd31fb1-e14f-41ad-9354-2683da34d8b2 tempest-SnapshotDependencyTests-459979785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b0c3188-9432-4515-9c75-c975e9cc8d35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86082) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 15 16:42:07 devstack cinder-volume[86082]: DEBUG cinder.volume.manager [None req-ccd31fb1-e14f-41ad-9354-2683da34d8b2 tempest-SnapshotDependencyTests-459979785 None] Flow 'volume_create_manager' (bc7b6bf8-ba86-45b4-b11e-ee2e705deb9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86082) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 15 16:42:07 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-ccd31fb1-e14f-41ad-9354-2683da34d8b2 tempest-SnapshotDependencyTests-459979785 None] Created volume successfully. Sep 15 16:42:08 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c1922f89-fb3b-403a-89df-91289c2f5d98 tempest-SnapshotDependencyTests-459979785 None] Acquiring lock "cinder-41c1489a-67a8-4486-91c8-6d049feaca7c-delete_snapshot" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:42:08 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c1922f89-fb3b-403a-89df-91289c2f5d98 tempest-SnapshotDependencyTests-459979785 None] Lock "cinder-41c1489a-67a8-4486-91c8-6d049feaca7c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:42:08 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c1922f89-fb3b-403a-89df-91289c2f5d98 tempest-SnapshotDependencyTests-459979785 None] Acquiring lock "cinder-quobyte-1798c48a-e458-429d-95ec-43a43e8c2355" by "delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:42:08 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c1922f89-fb3b-403a-89df-91289c2f5d98 tempest-SnapshotDependencyTests-459979785 None] Lock "cinder-quobyte-1798c48a-e458-429d-95ec-43a43e8c2355" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:42:08 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c1922f89-fb3b-403a-89df-91289c2f5d98 tempest-SnapshotDependencyTests-459979785 None] Acquiring lock "cinder-quobyte-41c1489a-67a8-4486-91c8-6d049feaca7c" by "_delete_snapshot" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:42:08 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c1922f89-fb3b-403a-89df-91289c2f5d98 tempest-SnapshotDependencyTests-459979785 None] Lock "cinder-quobyte-41c1489a-67a8-4486-91c8-6d049feaca7c" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:42:08 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-c1922f89-fb3b-403a-89df-91289c2f5d98 tempest-SnapshotDependencyTests-459979785 None] Deleting offline snapshot 41c1489a-67a8-4486-91c8-6d049feaca7c of volume 1798c48a-e458-429d-95ec-43a43e8c2355 {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 15 16:42:08 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-c1922f89-fb3b-403a-89df-91289c2f5d98 tempest-SnapshotDependencyTests-459979785 None] snapshot_file for this snap is: volume-1798c48a-e458-429d-95ec-43a43e8c2355.41c1489a-67a8-4486-91c8-6d049feaca7c {{(pid=86082) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 15 16:42:08 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2d5b9cf-9f2b-444b-af73-d8e8f0d23651]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:42:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c1922f89-fb3b-403a-89df-91289c2f5d98 tempest-SnapshotDependencyTests-459979785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1798c48a-e458-429d-95ec-43a43e8c2355.41c1489a-67a8-4486-91c8-6d049feaca7c {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:42:08 devstack sudo[108308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1798c48a-e458-429d-95ec-43a43e8c2355.41c1489a-67a8-4486-91c8-6d049feaca7c Sep 15 16:42:08 devstack sudo[108308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:42:08 devstack sudo[108308]: pam_unix(sudo:session): session closed for user root Sep 15 16:42:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c1922f89-fb3b-403a-89df-91289c2f5d98 tempest-SnapshotDependencyTests-459979785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1798c48a-e458-429d-95ec-43a43e8c2355.41c1489a-67a8-4486-91c8-6d049feaca7c" returned: 0 in 0.353s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:42:08 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.remotefs [None req-c1922f89-fb3b-403a-89df-91289c2f5d98 tempest-SnapshotDependencyTests-459979785 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1798c48a-e458-429d-95ec-43a43e8c2355(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86082) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 15 16:42:08 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccc8a6b1-46be-4831-a2f9-79da4aae3e65]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:42:08 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c1922f89-fb3b-403a-89df-91289c2f5d98 tempest-SnapshotDependencyTests-459979785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1798c48a-e458-429d-95ec-43a43e8c2355 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:42:08 devstack sudo[108314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1798c48a-e458-429d-95ec-43a43e8c2355 Sep 15 16:42:08 devstack sudo[108314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:42:09 devstack sudo[108314]: pam_unix(sudo:session): session closed for user root Sep 15 16:42:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c1922f89-fb3b-403a-89df-91289c2f5d98 tempest-SnapshotDependencyTests-459979785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1798c48a-e458-429d-95ec-43a43e8c2355" returned: 0 in 0.520s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:42:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c1922f89-fb3b-403a-89df-91289c2f5d98 tempest-SnapshotDependencyTests-459979785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1798c48a-e458-429d-95ec-43a43e8c2355.41c1489a-67a8-4486-91c8-6d049feaca7c {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:42:09 devstack sudo[108320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1798c48a-e458-429d-95ec-43a43e8c2355.41c1489a-67a8-4486-91c8-6d049feaca7c Sep 15 16:42:09 devstack sudo[108320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:42:09 devstack sudo[108320]: pam_unix(sudo:session): session closed for user root Sep 15 16:42:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c1922f89-fb3b-403a-89df-91289c2f5d98 tempest-SnapshotDependencyTests-459979785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1798c48a-e458-429d-95ec-43a43e8c2355.41c1489a-67a8-4486-91c8-6d049feaca7c" returned: 0 in 0.320s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:42:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c1922f89-fb3b-403a-89df-91289c2f5d98 tempest-SnapshotDependencyTests-459979785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1798c48a-e458-429d-95ec-43a43e8c2355.41c1489a-67a8-4486-91c8-6d049feaca7c {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:42:09 devstack sudo[108325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1798c48a-e458-429d-95ec-43a43e8c2355.41c1489a-67a8-4486-91c8-6d049feaca7c Sep 15 16:42:09 devstack sudo[108325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:42:09 devstack sudo[108325]: pam_unix(sudo:session): session closed for user root Sep 15 16:42:09 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-c1922f89-fb3b-403a-89df-91289c2f5d98 tempest-SnapshotDependencyTests-459979785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1798c48a-e458-429d-95ec-43a43e8c2355.41c1489a-67a8-4486-91c8-6d049feaca7c" returned: 0 in 0.238s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:42:09 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c1922f89-fb3b-403a-89df-91289c2f5d98 tempest-SnapshotDependencyTests-459979785 None] Lock "cinder-quobyte-41c1489a-67a8-4486-91c8-6d049feaca7c" released by "_delete_snapshot" :: held 1.537s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:42:09 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c1922f89-fb3b-403a-89df-91289c2f5d98 tempest-SnapshotDependencyTests-459979785 None] Lock "cinder-quobyte-1798c48a-e458-429d-95ec-43a43e8c2355" released by "delete_snapshot" :: held 1.561s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:42:09 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-c1922f89-fb3b-403a-89df-91289c2f5d98 tempest-SnapshotDependencyTests-459979785 None] Created reservations ['0cc8f8e2-623c-433d-811d-2f8f49e6b3ec', '1a7b69e9-d875-49df-b426-f8d04cb2bea4', 'b864311e-55b8-479b-b367-61412657caa7', '23e32583-5e60-40a8-adb0-8e9b375290f1'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:42:09 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-c1922f89-fb3b-403a-89df-91289c2f5d98 tempest-SnapshotDependencyTests-459979785 None] Delete snapshot completed successfully. Sep 15 16:42:09 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-c1922f89-fb3b-403a-89df-91289c2f5d98 tempest-SnapshotDependencyTests-459979785 None] Lock "cinder-41c1489a-67a8-4486-91c8-6d049feaca7c-delete_snapshot" released by "delete_snapshot" :: held 1.690s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:42:10 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-bfd5ed96-0e7a-4296-9d6e-b375d18ee917 tempest-SnapshotDependencyTests-459979785 None] Acquiring lock "cinder-1798c48a-e458-429d-95ec-43a43e8c2355-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:42:10 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-bfd5ed96-0e7a-4296-9d6e-b375d18ee917 tempest-SnapshotDependencyTests-459979785 None] Lock "cinder-1798c48a-e458-429d-95ec-43a43e8c2355-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:42:10 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-bfd5ed96-0e7a-4296-9d6e-b375d18ee917 tempest-SnapshotDependencyTests-459979785 None] Acquiring lock "cinder-quobyte-1798c48a-e458-429d-95ec-43a43e8c2355" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:42:10 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-bfd5ed96-0e7a-4296-9d6e-b375d18ee917 tempest-SnapshotDependencyTests-459979785 None] Lock "cinder-quobyte-1798c48a-e458-429d-95ec-43a43e8c2355" acquired by "delete_volume" :: waited 0.014s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:42:10 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4a7490c-cb43-46bc-8342-7a218087beb5]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:42:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-bfd5ed96-0e7a-4296-9d6e-b375d18ee917 tempest-SnapshotDependencyTests-459979785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1798c48a-e458-429d-95ec-43a43e8c2355 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:42:10 devstack sudo[108328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1798c48a-e458-429d-95ec-43a43e8c2355 Sep 15 16:42:10 devstack sudo[108328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:42:10 devstack sudo[108328]: pam_unix(sudo:session): session closed for user root Sep 15 16:42:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-bfd5ed96-0e7a-4296-9d6e-b375d18ee917 tempest-SnapshotDependencyTests-459979785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1798c48a-e458-429d-95ec-43a43e8c2355" returned: 0 in 0.356s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:42:10 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-bfd5ed96-0e7a-4296-9d6e-b375d18ee917 tempest-SnapshotDependencyTests-459979785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1798c48a-e458-429d-95ec-43a43e8c2355 {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:42:10 devstack sudo[108333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1798c48a-e458-429d-95ec-43a43e8c2355 Sep 15 16:42:10 devstack sudo[108333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:42:11 devstack sudo[108333]: pam_unix(sudo:session): session closed for user root Sep 15 16:42:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-bfd5ed96-0e7a-4296-9d6e-b375d18ee917 tempest-SnapshotDependencyTests-459979785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-1798c48a-e458-429d-95ec-43a43e8c2355" returned: 0 in 0.246s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:42:11 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-bfd5ed96-0e7a-4296-9d6e-b375d18ee917 tempest-SnapshotDependencyTests-459979785 None] Lock "cinder-quobyte-1798c48a-e458-429d-95ec-43a43e8c2355" released by "delete_volume" :: held 0.659s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:42:11 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-bfd5ed96-0e7a-4296-9d6e-b375d18ee917 tempest-SnapshotDependencyTests-459979785 None] Created reservations ['cad68ec1-6aa0-46e0-af8c-133336d9b50c', 'ea0dc3dc-9372-486b-8e93-a0fbce5f2ed7', '2e4dc0e1-ee6a-429c-af3d-fdfd28b9d093', 'c0f51f81-00da-49ea-9cad-c99db9a70057'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:42:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-bfd5ed96-0e7a-4296-9d6e-b375d18ee917 tempest-SnapshotDependencyTests-459979785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:42:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-bfd5ed96-0e7a-4296-9d6e-b375d18ee917 tempest-SnapshotDependencyTests-459979785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:42:11 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-bfd5ed96-0e7a-4296-9d6e-b375d18ee917 tempest-SnapshotDependencyTests-459979785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:42:11 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-bfd5ed96-0e7a-4296-9d6e-b375d18ee917 tempest-SnapshotDependencyTests-459979785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:42:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-bfd5ed96-0e7a-4296-9d6e-b375d18ee917 tempest-SnapshotDependencyTests-459979785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:42:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-bfd5ed96-0e7a-4296-9d6e-b375d18ee917 tempest-SnapshotDependencyTests-459979785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:42:11 devstack sudo[108336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:42:11 devstack sudo[108336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:42:11 devstack sudo[108336]: pam_unix(sudo:session): session closed for user root Sep 15 16:42:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-bfd5ed96-0e7a-4296-9d6e-b375d18ee917 tempest-SnapshotDependencyTests-459979785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.247s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:42:11 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-bfd5ed96-0e7a-4296-9d6e-b375d18ee917 tempest-SnapshotDependencyTests-459979785 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:42:11 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-bfd5ed96-0e7a-4296-9d6e-b375d18ee917 tempest-SnapshotDependencyTests-459979785 None] Deleted volume successfully. Sep 15 16:42:11 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-bfd5ed96-0e7a-4296-9d6e-b375d18ee917 tempest-SnapshotDependencyTests-459979785 None] Lock "cinder-1798c48a-e458-429d-95ec-43a43e8c2355-delete_volume" released by "delete_volume" :: held 1.095s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:42:11 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-6492c65f-ea40-4384-a50d-a3ad5cce1252 tempest-SnapshotDependencyTests-459979785 None] Acquiring lock "cinder-2fac96ec-c766-4a53-a4b4-53d8f3b22a1d-delete_volume" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:42:11 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-6492c65f-ea40-4384-a50d-a3ad5cce1252 tempest-SnapshotDependencyTests-459979785 None] Lock "cinder-2fac96ec-c766-4a53-a4b4-53d8f3b22a1d-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:42:11 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-6492c65f-ea40-4384-a50d-a3ad5cce1252 tempest-SnapshotDependencyTests-459979785 None] Acquiring lock "cinder-quobyte-2fac96ec-c766-4a53-a4b4-53d8f3b22a1d" by "delete_volume" {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 15 16:42:11 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-6492c65f-ea40-4384-a50d-a3ad5cce1252 tempest-SnapshotDependencyTests-459979785 None] Lock "cinder-quobyte-2fac96ec-c766-4a53-a4b4-53d8f3b22a1d" acquired by "delete_volume" :: waited 0.015s {{(pid=86082) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 15 16:42:11 devstack cinder-volume[86082]: DEBUG oslo.privsep.daemon [-] privsep: reply[59ec91ab-f76c-4ba1-9320-c1abfb2edc95]: (4, 'qcow2') {{(pid=87801) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 15 16:42:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-6492c65f-ea40-4384-a50d-a3ad5cce1252 tempest-SnapshotDependencyTests-459979785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2fac96ec-c766-4a53-a4b4-53d8f3b22a1d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:42:11 devstack sudo[108339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2fac96ec-c766-4a53-a4b4-53d8f3b22a1d Sep 15 16:42:11 devstack sudo[108339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:42:11 devstack sudo[108339]: pam_unix(sudo:session): session closed for user root Sep 15 16:42:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-6492c65f-ea40-4384-a50d-a3ad5cce1252 tempest-SnapshotDependencyTests-459979785 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2fac96ec-c766-4a53-a4b4-53d8f3b22a1d" returned: 0 in 0.358s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:42:11 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-6492c65f-ea40-4384-a50d-a3ad5cce1252 tempest-SnapshotDependencyTests-459979785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2fac96ec-c766-4a53-a4b4-53d8f3b22a1d {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:42:11 devstack sudo[108345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2fac96ec-c766-4a53-a4b4-53d8f3b22a1d Sep 15 16:42:11 devstack sudo[108345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:42:12 devstack sudo[108345]: pam_unix(sudo:session): session closed for user root Sep 15 16:42:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-6492c65f-ea40-4384-a50d-a3ad5cce1252 tempest-SnapshotDependencyTests-459979785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb/volume-2fac96ec-c766-4a53-a4b4-53d8f3b22a1d" returned: 0 in 0.239s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:42:12 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-6492c65f-ea40-4384-a50d-a3ad5cce1252 tempest-SnapshotDependencyTests-459979785 None] Lock "cinder-quobyte-2fac96ec-c766-4a53-a4b4-53d8f3b22a1d" released by "delete_volume" :: held 0.637s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:42:12 devstack cinder-volume[86082]: DEBUG cinder.quota [None req-6492c65f-ea40-4384-a50d-a3ad5cce1252 tempest-SnapshotDependencyTests-459979785 None] Created reservations ['4ed9d340-ed06-4a6a-99cb-c43104bae831', 'f40a64d6-63e2-47f6-99f9-9e4b8a220b01', '58651bb6-56cb-42fd-bf2b-afaeeb56bbb6', '89862a63-1dfd-47a6-b93f-4fa612a92eb6'] {{(pid=86082) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 15 16:42:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-6492c65f-ea40-4384-a50d-a3ad5cce1252 tempest-SnapshotDependencyTests-459979785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 15 16:42:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-6492c65f-ea40-4384-a50d-a3ad5cce1252 tempest-SnapshotDependencyTests-459979785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 15 16:42:12 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-6492c65f-ea40-4384-a50d-a3ad5cce1252 tempest-SnapshotDependencyTests-459979785 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a': None} {{(pid=86082) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 15 16:42:12 devstack cinder-volume[86082]: DEBUG cinder.volume.drivers.quobyte [None req-6492c65f-ea40-4384-a50d-a3ad5cce1252 tempest-SnapshotDependencyTests-459979785 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-f21192de-b78b-455a-ad7a-4d6f5eb80f3a'] {{(pid=86082) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 15 16:42:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.lockutils [None req-6492c65f-ea40-4384-a50d-a3ad5cce1252 tempest-SnapshotDependencyTests-459979785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86082) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 15 16:42:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-6492c65f-ea40-4384-a50d-a3ad5cce1252 tempest-SnapshotDependencyTests-459979785 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 15 16:42:12 devstack sudo[108348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb Sep 15 16:42:12 devstack sudo[108348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 15 16:42:12 devstack sudo[108348]: pam_unix(sudo:session): session closed for user root Sep 15 16:42:12 devstack cinder-volume[86082]: DEBUG oslo_concurrency.processutils [None req-6492c65f-ea40-4384-a50d-a3ad5cce1252 tempest-SnapshotDependencyTests-459979785 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/1840ec257ab361e76d7224a20c5dc1fb" returned: 0 in 0.241s {{(pid=86082) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 15 16:42:12 devstack cinder-volume[86082]: DEBUG cinder.manager [None req-6492c65f-ea40-4384-a50d-a3ad5cce1252 tempest-SnapshotDependencyTests-459979785 None] Notifying Schedulers of capabilities ... {{(pid=86082) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 15 16:42:12 devstack cinder-volume[86082]: INFO cinder.volume.manager [None req-6492c65f-ea40-4384-a50d-a3ad5cce1252 tempest-SnapshotDependencyTests-459979785 None] Deleted volume successfully. Sep 15 16:42:12 devstack cinder-volume[86082]: DEBUG cinder.coordination [None req-6492c65f-ea40-4384-a50d-a3ad5cce1252 tempest-SnapshotDependencyTests-459979785 None] Lock "cinder-2fac96ec-c766-4a53-a4b4-53d8f3b22a1d-delete_volume" released by "delete_volume" :: held 1.054s {{(pid=86082) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 15 16:42:22 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:SELECT=26,cinder:UPDATE=32,cinder:INSERT=6,cinder:DELETE=3 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 15 16:42:22 devstack cinder-volume[86082]: DEBUG dbcounter [-] [86082] Writing DB stats cinder:UPDATE=26,cinder:SELECT=23,cinder:DELETE=2,cinder:INSERT=9 {{(pid=86082) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}